-- Logs begin at Fri 2021-10-15 03:01:50 UTC, end at Fri 2021-10-15 04:22:55 UTC. -- Oct 15 03:25:34.305211 dv-cinder-814100-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 15 03:25:34.313132 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 15 03:25:34.315134 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 15 03:25:34 2021] *** Oct 15 03:25:34.315134 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 15 03:25:34.315134 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 15 03:25:34.315134 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: nodename: dv-cinder-814100-1-iscsi Oct 15 03:25:34.315134 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: machine: x86_64 Oct 15 03:25:34.315134 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: clock source: unix Oct 15 03:25:34.315469 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: pcre jit disabled Oct 15 03:25:34.315469 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: detected number of CPU cores: 4 Oct 15 03:25:34.315469 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: current working directory: / Oct 15 03:25:34.315469 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: detected binary path: /usr/bin/uwsgi-core Oct 15 03:25:34.315469 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: your processes number limit is 47680 Oct 15 03:25:34.315469 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: your memory page size is 4096 bytes Oct 15 03:25:34.315469 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: detected max file descriptor number: 2048 Oct 15 03:25:34.315469 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: lock engine: pthread robust mutexes Oct 15 03:25:34.315469 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: thunder lock: enabled Oct 15 03:25:34.316049 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 15 03:25:34.316049 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 15 03:25:34.362480 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: Python main interpreter initialized at 0x5635255419c0 Oct 15 03:25:34.362480 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: python threads support enabled Oct 15 03:25:34.362480 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: your server socket listen backlog is limited to 100 connections Oct 15 03:25:34.362480 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: your mercy for graceful operations on workers is 90 seconds Oct 15 03:25:34.362859 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: mapped 403077 bytes (393 KB) for 2 cores Oct 15 03:25:34.362934 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: *** Operational MODE: preforking *** Oct 15 03:25:34.363223 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: *** uWSGI is running in multiple interpreter mode *** Oct 15 03:25:34.363223 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: spawned uWSGI master process (pid: 79346) Oct 15 03:25:34.363433 dv-cinder-814100-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 15 03:25:34.364581 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: spawned uWSGI worker 1 (pid: 79361, cores: 1) Oct 15 03:25:34.364581 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: spawned uWSGI worker 2 (pid: 79362, cores: 1) Oct 15 03:25:34.364581 dv-cinder-814100-1-iscsi devstack@keystone.service[79346]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 15 03:25:39.427931 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 03:25:39.427931 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: from cryptography.utils import int_from_bytes Oct 15 03:25:39.428702 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 03:25:39.428702 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: from cryptography.utils import int_from_bytes Oct 15 03:25:39.430479 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 03:25:39.430479 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: from cryptography.utils import int_from_bytes Oct 15 03:25:39.430930 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 03:25:39.430930 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: from cryptography.utils import int_from_bytes Oct 15 03:25:39.477286 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 15 03:25:39.477472 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 15 03:25:39.477660 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] command line args: [] {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 15 03:25:39.477840 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 15 03:25:39.478428 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 15 03:25:39.478569 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 15 03:25:39.478657 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ================================================================================ {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 15 03:25:39.478765 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] command line args: [] {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 15 03:25:39.478872 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] admin_token = **** {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.479034 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 15 03:25:39.479119 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] config_dir = [] {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.479205 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ================================================================================ {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 15 03:25:39.479278 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.479446 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] config_source = [] {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.479530 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] admin_token = **** {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.479608 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] debug = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.479708 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] config_dir = [] {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.479831 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.480133 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.480133 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] config_source = [] {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.480323 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.480416 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] debug = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.480520 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.480625 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.480760 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.480859 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.480859 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.481041 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.481041 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] list_limit = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.481237 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.481333 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] log_config_append = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.481425 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.481531 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.481635 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] list_limit = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.481732 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] log_dir = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.481831 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] log_config_append = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.481939 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] log_file = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.482042 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.482128 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.482258 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] log_dir = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.482343 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.482415 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] log_file = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.482538 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.482622 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.482695 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.482826 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.482912 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.482994 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.483067 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.483138 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.483219 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.483292 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.483410 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.483487 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.483610 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.483739 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.483832 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.483907 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.484119 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.484243 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.484351 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.484487 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.484608 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.484764 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.484880 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.485028 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.485139 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.485273 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.485273 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.485499 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.485639 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.485753 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] publish_errors = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.485900 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.486011 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.486127 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.486266 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] publish_errors = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.486383 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.486517 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.486630 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.486744 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.486859 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.487037 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.487129 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] standard_threads = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.487239 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.487314 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.487385 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.487464 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.487543 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] standard_threads = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.487652 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.487652 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] use_journal = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.487809 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.487893 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] use_json = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.487978 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.488051 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] use_stderr = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.488121 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.488192 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] use_syslog = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.488289 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] use_journal = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.488373 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.488453 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] use_json = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.488565 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] use_stderr = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.488643 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.488744 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] use_syslog = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.488828 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.488978 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 03:25:39.489070 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.489247 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.489327 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.489489 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.489567 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.489731 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.489821 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.489978 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.490057 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.490213 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.490296 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.490458 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.490617 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.490692 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.490763 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.490940 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.491019 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.491174 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.491263 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.491419 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.491497 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.491654 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.491760 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.491923 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.492018 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.492170 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.492320 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.492446 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.492528 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.492645 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.492733 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.492889 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.492968 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.493125 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.493210 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.493376 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.493456 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.494228 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.494370 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.494474 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.494548 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.494722 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.494802 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.494952 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.495037 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.495190 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.495277 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.495421 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.495501 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.495655 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.495750 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.495932 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.496011 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.496179 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.496261 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.496411 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.496497 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.496641 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.496720 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.496870 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.496945 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.497119 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.497199 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.497353 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.497430 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.497596 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.497675 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.497827 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.497906 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.498062 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.498148 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.498292 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.498378 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.498526 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.498610 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.498757 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.498836 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.498987 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.499073 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.499217 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.499302 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.499452 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.499531 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.499852 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.499944 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.499944 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.500086 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.500160 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.500232 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.500379 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.500460 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.500615 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.500689 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.500850 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.500917 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.501096 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.501165 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.501325 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.501391 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.501561 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.501628 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.501793 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.501920 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.502063 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.502175 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.502284 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.502432 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.502550 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.502691 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.502801 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.502910 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.503048 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.503165 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.503275 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.503420 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.503530 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.503665 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.503820 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.503939 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.504079 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.504200 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.504348 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.504463 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.504602 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.504712 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.504823 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.504971 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.505081 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.505228 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.505339 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.505449 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.505586 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.505707 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.505846 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.505959 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.506069 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.506147 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.506254 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.506339 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.506447 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.506531 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.506605 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.506684 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.506756 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.506880 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.506958 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.507030 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.507108 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.507189 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.507262 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.507345 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.507424 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.507570 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.507656 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.507834 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.507926 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.508084 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.508161 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.508324 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.508404 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.508552 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.508630 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.508786 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.508901 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.509016 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.509099 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.509275 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.509353 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.509509 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.509588 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.509746 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.509824 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.509981 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.510061 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.510224 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.510304 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.510470 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.510559 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.510715 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.510793 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.510946 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] auth.external = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.511038 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.511176 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.511255 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.511457 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.511566 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.511701 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.511795 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.511936 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] auth.password = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.512018 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] auth.external = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.512165 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] auth.token = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.512251 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.512403 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.512491 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.512635 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.512715 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.512879 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.512959 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] auth.password = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.513111 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.513199 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] auth.token = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.513355 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.513436 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.513593 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.513671 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.513821 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.513908 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.514055 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] credential.caching = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.514143 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.514299 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.514379 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.514544 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.514655 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.514777 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.514866 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.515017 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.515097 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] credential.caching = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.515259 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.515339 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.515491 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.515580 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.515756 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.515840 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.516008 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.516088 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.516244 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.516337 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.516481 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.516561 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.516733 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.516847 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.516990 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.517079 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.517230 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.517312 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.517481 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.517561 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.517735 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.517824 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.517969 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] federation.caching = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.518058 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.518202 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.518287 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.518459 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.518548 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.518702 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.518783 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.518931 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.519011 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] federation.caching = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.519175 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.519263 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.519408 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.519488 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.519658 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.519753 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.519914 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.519997 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.520166 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.520246 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.520403 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.520483 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.520648 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.520750 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.520881 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] identity.caching = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.520968 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.521124 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.521207 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.521365 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.521446 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.521596 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.521677 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.521828 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.521908 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] identity.caching = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.522073 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.522157 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.522303 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.522386 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.522538 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.522618 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.522773 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.522854 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.523018 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.523097 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.523247 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.523326 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.523475 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.523557 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.523768 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.523881 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.523958 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.524030 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.524196 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.524280 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.524440 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.524520 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.524673 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.524752 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.524946 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.525028 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.525199 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.525279 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.525440 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.525527 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.525675 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.525758 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.525904 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.525985 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.526137 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.526218 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.526364 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.526447 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.526595 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.526676 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.526830 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.526911 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.527066 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.527150 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.527308 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.527389 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.527534 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.527614 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.527798 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.527881 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.528043 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.528134 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.528273 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.528354 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.528515 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.528603 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.528756 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.528836 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.528987 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.529077 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.529220 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.529311 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.529447 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.529529 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.529680 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.529770 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.529912 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.529992 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.530147 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.530226 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.530379 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.530466 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.530612 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.530692 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.530850 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.530930 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.531092 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.531179 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.531321 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.531401 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.531549 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.531636 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.531818 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.531913 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.532064 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.532146 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.532296 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.532376 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.532529 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.532617 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.532760 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.532841 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.532989 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.user = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.533071 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.533227 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.533315 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.533482 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.533563 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.533712 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.533793 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.533944 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.user = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.534032 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.534188 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.534269 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.534431 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.534510 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.534664 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.534754 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.534895 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.534977 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.535136 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.535217 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.535369 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.535458 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.535602 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.535748 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.535858 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.535939 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.536096 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.536194 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.536334 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.536416 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.536572 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.536654 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.536805 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.536893 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.537056 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.537137 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.537306 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.537386 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.537553 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.537642 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.537801 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.537882 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.538042 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.538122 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.538274 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.538364 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.538504 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.538584 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.538747 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.538828 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.538982 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.539070 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.539219 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.539299 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.539454 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.539533 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.539711 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.539808 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.539951 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.540032 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.540185 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.540266 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.540926 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.541023 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.541172 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.541253 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.541419 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.541501 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.541659 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.541749 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.541890 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.541992 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.542125 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.542219 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.542365 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] resource.caching = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.542475 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.542612 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.542698 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.542858 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.542976 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.543090 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.543224 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.543337 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.543470 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] resource.caching = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.543585 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.543748 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.543852 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.544006 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.544090 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.544251 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.544331 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.544507 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.544588 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.544762 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] role.caching = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.544843 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.545000 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.545079 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] role.driver = sql {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.545227 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.545382 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.545460 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.545534 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.545711 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.545792 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.545947 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] role.caching = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.546035 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.546189 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.546270 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] role.driver = sql {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.546423 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.546502 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.546666 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.546750 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.546928 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.547020 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.547150 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.547231 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.547381 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.547471 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.547624 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.547721 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.547893 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.547975 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.548138 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.548231 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.548381 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.548463 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.548618 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.548772 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.548874 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.549011 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.549136 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.549259 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.549389 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.549505 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.549640 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.549738 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.549985 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.550065 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.550215 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.550302 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.550466 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.550555 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.550715 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.550796 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.550949 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.551029 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.551178 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.551260 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.551407 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.551488 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.551636 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.551737 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.551909 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.551993 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.552160 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.552240 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.552404 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.552484 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.552637 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.552718 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.552869 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.552948 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.553097 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.553179 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.553328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] token.caching = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.553410 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.553561 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.553641 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.553805 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.553885 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.554039 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.554122 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.554278 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.554357 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.554518 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] token.caching = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.554598 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.554751 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.554832 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.554992 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.555108 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.555235 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.555374 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.555468 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.555546 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.555720 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.555853 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.555973 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.556695 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.556837 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.556958 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.557076 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.557193 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.557309 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.557426 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.557552 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.557670 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.557786 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.557902 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.558018 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.558134 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.558259 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] database.connection = **** {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.558378 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.558494 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.558611 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.558727 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.558843 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.558968 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.559086 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.559202 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.559320 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.559436 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.559552 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] database.connection = **** {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.560767 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.560904 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.561023 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.561139 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.561255 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.561373 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.561503 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.561622 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.561739 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.561856 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.561972 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.561972 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.561972 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.561972 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.561972 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.561972 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.562638 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.562754 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.562871 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.562996 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.563114 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.563231 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 15 03:25:39.563348 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.563348 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.563348 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.563348 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.563825 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.563825 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.564058 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.564174 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.564423 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.564666 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 03:25:39.564839 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 15 03:25:39.591590 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.591841 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.592066 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.593174 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.593409 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.593642 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.602003 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.604267 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.630419 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.630646 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.632164 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.632400 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.682920 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.683656 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.822111 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.822308 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.822308 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.822460 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.887894 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.888116 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.888254 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.888345 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.888492 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.888578 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.888726 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.888810 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.888935 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.889019 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.889155 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.889374 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.912197 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.912426 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.912544 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.912654 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.912782 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.912865 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.913012 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.913095 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.913239 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.913324 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.913461 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.913543 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.913681 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.913900 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.925054 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.925441 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.937533 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.937764 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.937883 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.938030 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.938114 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.938258 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.938352 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.938476 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.938560 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.938687 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.938770 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.938899 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.938982 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.939152 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 15 03:25:39.956567 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.956712 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.956797 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 15 03:25:39.956925 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 15 03:25:39.957090 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.957260 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.957343 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 15 03:25:39.957465 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 15 03:25:39.957556 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.957736 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.957818 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.957998 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.958079 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.958248 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.958337 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.958504 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.969349 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.969622 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.969717 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.969883 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.969966 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.970171 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.970256 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.970460 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.980196 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:39.980580 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:39.983381 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:39.983653 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.983826 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:39.983954 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.984107 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.984233 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.984392 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.984509 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.984674 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.984764 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.984955 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.985036 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.985213 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.985294 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.985481 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.985572 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.985753 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.985834 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.986010 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.986091 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.986279 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:39.986543 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.012361 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.013094 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.013923 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.014197 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.014677 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.014955 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.019437 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.019729 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.020005 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.020292 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.020589 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.020858 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.027736 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.028014 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.028584 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.028867 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.032372 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.032651 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.032925 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.033200 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.033285 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.033465 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.033573 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.033730 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.033855 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.033993 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.034134 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.034255 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.034405 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.034674 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.034945 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.035213 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.052642 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.052913 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.053771 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.054049 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.057420 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.058599 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.061088 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.061377 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.062326 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.062623 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.066286 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.067578 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.069818 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.071183 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.073939 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.074184 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.074463 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.074741 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.075010 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.075277 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.075360 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.075576 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.075885 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.076174 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.076460 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.076748 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.094535 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.094814 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.095078 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.095346 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.096187 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.096495 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.096766 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.097031 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.103266 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.105060 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.105151 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.105336 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.106824 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.107108 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.108341 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.108612 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.108886 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.109169 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.109442 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.110241 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.110520 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.110806 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.111090 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.111370 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.122515 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.122788 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.123072 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.123348 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.123625 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.123922 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.124193 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.124478 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.124758 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.125036 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.125408 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.125688 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.125964 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.126240 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.142106 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.144422 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.145314 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.147622 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.148681 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.151328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.151454 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.153187 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.154221 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.154688 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.154901 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.155188 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.155368 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.155900 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.163344 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.165089 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.165184 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.167904 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.168472 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.168825 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.169102 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.169372 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.171224 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.171513 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.172465 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.172465 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.178325 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.178610 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.178883 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.181188 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.181486 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.181770 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.186775 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.187051 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.187330 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.187602 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.187915 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.188177 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.188583 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.188707 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.188977 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.189267 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.189540 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.189804 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.190062 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.190331 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.191073 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 15 03:25:40.191364 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.191790 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.192074 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.192347 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.192618 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.192900 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.193176 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.193455 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.193724 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.193995 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.194266 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.194532 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.194810 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 15 03:25:40.232671 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5635255419c0 pid: 79362 (default app) Oct 15 03:25:40.233259 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5635255419c0 pid: 79361 (default app) Oct 15 03:25:40.236185 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c425e-3318-4173-8b69-4606b20a7576 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:40.236474 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c425e-3318-4173-8b69-4606b20a7576 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:40.236750 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c425e-3318-4173-8b69-4606b20a7576 None None] PATH_INFO: `/v3` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:40.241546 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Fri Oct 15 03:25:40 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:25:47.868305 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379617e2-3986-48d8-8c6d-cf11924579fb None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:47.868881 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379617e2-3986-48d8-8c6d-cf11924579fb None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:47.868881 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379617e2-3986-48d8-8c6d-cf11924579fb None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:47.873897 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1/2] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:25:47 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:25:47.879832 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74758847-e487-4a8d-9926-a449057b53e5 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:47.880268 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74758847-e487-4a8d-9926-a449057b53e5 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:47.880392 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74758847-e487-4a8d-9926-a449057b53e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:47.910335 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG oslo_db.sqlalchemy.engines [None req-74758847-e487-4a8d-9926-a449057b53e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 03:25:48.097973 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG passlib.handlers.bcrypt [None req-74758847-e487-4a8d-9926-a449057b53e5 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79362) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 15 03:25:48.098401 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG passlib.handlers.bcrypt [None req-74758847-e487-4a8d-9926-a449057b53e5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79362) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 15 03:25:48.153342 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-74758847-e487-4a8d-9926-a449057b53e5 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:25:48.154893 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-74758847-e487-4a8d-9926-a449057b53e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:25:48.286943 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:25:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:25:48.433687 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379617e2-3986-48d8-8c6d-cf11924579fb None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:48.466925 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG oslo_db.sqlalchemy.engines [None req-379617e2-3986-48d8-8c6d-cf11924579fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 03:25:48.594312 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379617e2-3986-48d8-8c6d-cf11924579fb None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:48.598511 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6abc23-310a-441e-9f47-cac52f625b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:48.599406 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6abc23-310a-441e-9f47-cac52f625b03 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:48.599705 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6abc23-310a-441e-9f47-cac52f625b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:48.599995 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6abc23-310a-441e-9f47-cac52f625b03 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:48.608797 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6abc23-310a-441e-9f47-cac52f625b03 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:48.660752 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fc6abc23-310a-441e-9f47-cac52f625b03 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 15 03:25:48.661083 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6abc23-310a-441e-9f47-cac52f625b03 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:48.670477 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:25:48 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:25:48.678448 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74758847-e487-4a8d-9926-a449057b53e5 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:48.693005 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74758847-e487-4a8d-9926-a449057b53e5 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:48.698354 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c61323-481c-4934-80a1-7d345e82c6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:48.699481 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c61323-481c-4934-80a1-7d345e82c6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:48.699798 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c61323-481c-4934-80a1-7d345e82c6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:48.700077 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c61323-481c-4934-80a1-7d345e82c6d8 admin admin] PATH_INFO: `/v3/projects/38d38c962f4f466f9c11db2457ea0b1e` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:48.701610 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c61323-481c-4934-80a1-7d345e82c6d8 admin admin] RBAC: Authorizing `identity:get_project(project_id=38d38c962f4f466f9c11db2457ea0b1e)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:48.751294 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c9c61323-481c-4934-80a1-7d345e82c6d8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 15 03:25:48.751643 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c61323-481c-4934-80a1-7d345e82c6d8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:48.756166 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 3/5] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:25:48 2021] GET /identity/v3/projects/38d38c962f4f466f9c11db2457ea0b1e => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:25:50.965863 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496119e-1f97-41e6-8458-462000abd30a None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:50.966470 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496119e-1f97-41e6-8458-462000abd30a None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:50.966470 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496119e-1f97-41e6-8458-462000abd30a None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:50.970917 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 3/6] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:25:50 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:25:50.977258 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f5f82-821e-4b6b-8335-10bf5739dc93 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:50.977714 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f5f82-821e-4b6b-8335-10bf5739dc93 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:50.978461 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f5f82-821e-4b6b-8335-10bf5739dc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:50.998181 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-318f5f82-821e-4b6b-8335-10bf5739dc93 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:25:50.999726 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-318f5f82-821e-4b6b-8335-10bf5739dc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:25:51.007491 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:25:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:25:51.030841 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496119e-1f97-41e6-8458-462000abd30a None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:51.043203 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496119e-1f97-41e6-8458-462000abd30a None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:51.047333 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55f882-3eea-4c5e-a6e3-0053f9e63c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:51.047981 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55f882-3eea-4c5e-a6e3-0053f9e63c42 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:51.048259 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55f882-3eea-4c5e-a6e3-0053f9e63c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:51.048529 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55f882-3eea-4c5e-a6e3-0053f9e63c42 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:51.055911 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55f882-3eea-4c5e-a6e3-0053f9e63c42 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:51.057663 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55f882-3eea-4c5e-a6e3-0053f9e63c42 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:51.066042 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:25:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:25:51.071653 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f5f82-821e-4b6b-8335-10bf5739dc93 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:51.080393 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f5f82-821e-4b6b-8335-10bf5739dc93 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:51.084739 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64935ce4-1532-431e-9871-5f603bd79e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:51.085578 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64935ce4-1532-431e-9871-5f603bd79e13 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:51.085864 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64935ce4-1532-431e-9871-5f603bd79e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:51.086139 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64935ce4-1532-431e-9871-5f603bd79e13 admin admin] PATH_INFO: `/v3/users/54e89668dd2f4bda9877cf539179b3ec` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:51.088105 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64935ce4-1532-431e-9871-5f603bd79e13 admin admin] RBAC: Authorizing `identity:get_user(user_id=54e89668dd2f4bda9877cf539179b3ec)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:51.089927 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64935ce4-1532-431e-9871-5f603bd79e13 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:51.091458 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 5/9] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:25:51 2021] GET /identity/v3/users/54e89668dd2f4bda9877cf539179b3ec => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:25:53.350840 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e76f38-2272-41b8-a99d-93c708022c28 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:53.351403 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e76f38-2272-41b8-a99d-93c708022c28 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:53.351403 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e76f38-2272-41b8-a99d-93c708022c28 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:53.353164 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 5/10] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:25:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:25:53.359038 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40978188-c87a-4f1e-9857-b4a7a9a8d101 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:53.359459 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40978188-c87a-4f1e-9857-b4a7a9a8d101 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:53.359600 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40978188-c87a-4f1e-9857-b4a7a9a8d101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:53.377337 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-40978188-c87a-4f1e-9857-b4a7a9a8d101 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:25:53.378521 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-40978188-c87a-4f1e-9857-b4a7a9a8d101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:25:53.386730 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 6/11] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:25:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:25:53.400694 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926374a7-a0b0-41b4-81f1-1f2270200730 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:53.400983 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926374a7-a0b0-41b4-81f1-1f2270200730 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:53.401261 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926374a7-a0b0-41b4-81f1-1f2270200730 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:53.402995 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 6/12] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:25:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:25:53.408759 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb579c00-8a93-4b37-bce4-15e981590e1a None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:53.409053 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb579c00-8a93-4b37-bce4-15e981590e1a None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:53.409339 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb579c00-8a93-4b37-bce4-15e981590e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:53.410508 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926374a7-a0b0-41b4-81f1-1f2270200730 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:53.422722 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926374a7-a0b0-41b4-81f1-1f2270200730 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:53.427090 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129e0a4-52cb-456f-90da-971c8e28a579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:53.427239 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-cb579c00-8a93-4b37-bce4-15e981590e1a None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:25:53.427902 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129e0a4-52cb-456f-90da-971c8e28a579 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:53.428187 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129e0a4-52cb-456f-90da-971c8e28a579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:53.428321 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-cb579c00-8a93-4b37-bce4-15e981590e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:25:53.428462 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129e0a4-52cb-456f-90da-971c8e28a579 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:53.438420 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 7/13] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:25:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:25:53.444537 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129e0a4-52cb-456f-90da-971c8e28a579 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:25:53.451405 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-c129e0a4-52cb-456f-90da-971c8e28a579 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:25:53.452620 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 7/14] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:25:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:25:53.458967 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb579c00-8a93-4b37-bce4-15e981590e1a None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:53.461271 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129e0a4-52cb-456f-90da-971c8e28a579 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:53.468184 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb579c00-8a93-4b37-bce4-15e981590e1a None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:53.470541 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129e0a4-52cb-456f-90da-971c8e28a579 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:53.472568 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1cf296-031f-4fee-a980-1621a74b3858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:53.473216 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cf296-031f-4fee-a980-1621a74b3858 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:53.473499 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cf296-031f-4fee-a980-1621a74b3858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:53.473773 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cf296-031f-4fee-a980-1621a74b3858 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:53.474801 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1cf296-031f-4fee-a980-1621a74b3858 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:25:53.475104 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1cf296-031f-4fee-a980-1621a74b3858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:53.475837 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6145b-c0d2-4972-ac67-86d746a21028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:53.476450 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6145b-c0d2-4972-ac67-86d746a21028 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:53.476734 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6145b-c0d2-4972-ac67-86d746a21028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:53.476853 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING py.warnings [None req-3b1cf296-031f-4fee-a980-1621a74b3858 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:25:53.476853 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: warnings.warn(msg) Oct 15 03:25:53.476853 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: Oct 15 03:25:53.477065 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6145b-c0d2-4972-ac67-86d746a21028 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:53.478274 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1cf296-031f-4fee-a980-1621a74b3858 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:53.485620 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6145b-c0d2-4972-ac67-86d746a21028 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:53.487384 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6145b-c0d2-4972-ac67-86d746a21028 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:53.492351 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 8/15] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:25:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:25:53.496651 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 8/16] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:25:53 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:25:53.499015 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1cf296-031f-4fee-a980-1621a74b3858 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:53.502393 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6145b-c0d2-4972-ac67-86d746a21028 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:53.508291 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1cf296-031f-4fee-a980-1621a74b3858 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:53.510571 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6145b-c0d2-4972-ac67-86d746a21028 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:53.512858 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcef367-793e-425c-a6ac-711e3ef4c757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:53.513687 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcef367-793e-425c-a6ac-711e3ef4c757 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:53.513971 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcef367-793e-425c-a6ac-711e3ef4c757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:53.514249 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcef367-793e-425c-a6ac-711e3ef4c757 admin admin] PATH_INFO: `/v3/users/54e89668dd2f4bda9877cf539179b3ec` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:53.514910 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e3ca0-8673-474b-aaf7-4cbba679238a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:53.515449 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcef367-793e-425c-a6ac-711e3ef4c757 admin admin] RBAC: Authorizing `identity:get_user(user_id=54e89668dd2f4bda9877cf539179b3ec)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:53.515645 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e3ca0-8673-474b-aaf7-4cbba679238a admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:53.515960 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e3ca0-8673-474b-aaf7-4cbba679238a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:53.516235 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e3ca0-8673-474b-aaf7-4cbba679238a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:53.517294 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcef367-793e-425c-a6ac-711e3ef4c757 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:53.517687 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e3ca0-8673-474b-aaf7-4cbba679238a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:53.518825 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 9/17] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:25:53 2021] GET /identity/v3/users/54e89668dd2f4bda9877cf539179b3ec => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:25:53.519367 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e3ca0-8673-474b-aaf7-4cbba679238a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:53.525399 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 9/18] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:25:53 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:25:53.525567 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcef367-793e-425c-a6ac-711e3ef4c757 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:53.534546 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcef367-793e-425c-a6ac-711e3ef4c757 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:53.539213 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0da995-add5-40cd-9bdf-1325cac658da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:53.540599 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0da995-add5-40cd-9bdf-1325cac658da admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:53.540887 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0da995-add5-40cd-9bdf-1325cac658da admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:53.541164 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0da995-add5-40cd-9bdf-1325cac658da admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:53.542451 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0da995-add5-40cd-9bdf-1325cac658da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:53.544251 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0da995-add5-40cd-9bdf-1325cac658da admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:53.545926 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 10/19] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:25:53 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:25:53.552688 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e3ca0-8673-474b-aaf7-4cbba679238a admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:53.563200 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e3ca0-8673-474b-aaf7-4cbba679238a admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:53.567634 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c78bae-4b7e-458c-8dc1-e159d3806c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:53.568318 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c78bae-4b7e-458c-8dc1-e159d3806c21 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:53.568601 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c78bae-4b7e-458c-8dc1-e159d3806c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:53.568876 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c78bae-4b7e-458c-8dc1-e159d3806c21 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:53.569724 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c78bae-4b7e-458c-8dc1-e159d3806c21 admin admin] RBAC: Adding query filter params (role.id=15ba70b0cba04962a6d0b80b50c07004, scope.domain.id=default, user.id=54e89668dd2f4bda9877cf539179b3ec) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:25:53.570031 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c78bae-4b7e-458c-8dc1-e159d3806c21 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:53.571913 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING py.warnings [None req-c1c78bae-4b7e-458c-8dc1-e159d3806c21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:25:53.571913 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: warnings.warn(msg) Oct 15 03:25:53.571913 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: Oct 15 03:25:53.573117 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c78bae-4b7e-458c-8dc1-e159d3806c21 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:53.582675 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 10/20] 10.222.0.30 () {56 vars in 1343 bytes} [Fri Oct 15 03:25:53 2021] GET /identity/v3/role_assignments?user.id=54e89668dd2f4bda9877cf539179b3ec&scope.domain.id=default&role.id=15ba70b0cba04962a6d0b80b50c07004 => generated 233 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:25:56.210918 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171f5e3-f931-4173-beed-265301005f5a None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:56.211454 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171f5e3-f931-4173-beed-265301005f5a None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:56.211454 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171f5e3-f931-4173-beed-265301005f5a None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:56.213594 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 11/21] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:25:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:25:56.219538 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8156caa-f017-4291-9a41-a1ce12c15fc5 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:56.219958 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8156caa-f017-4291-9a41-a1ce12c15fc5 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:56.220135 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8156caa-f017-4291-9a41-a1ce12c15fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:56.263248 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG passlib.handlers.bcrypt [None req-d8156caa-f017-4291-9a41-a1ce12c15fc5 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79361) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 15 03:25:56.263669 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG passlib.handlers.bcrypt [None req-d8156caa-f017-4291-9a41-a1ce12c15fc5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79361) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 15 03:25:56.310389 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-d8156caa-f017-4291-9a41-a1ce12c15fc5 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:25:56.312243 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d8156caa-f017-4291-9a41-a1ce12c15fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:25:56.341791 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 11/22] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:25:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:25:56.386497 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171f5e3-f931-4173-beed-265301005f5a None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:56.399209 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171f5e3-f931-4173-beed-265301005f5a None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:56.407280 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170d9e7-ea9f-490d-9041-9a119a3f26c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:56.408269 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170d9e7-ea9f-490d-9041-9a119a3f26c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:56.408693 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170d9e7-ea9f-490d-9041-9a119a3f26c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:56.409101 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170d9e7-ea9f-490d-9041-9a119a3f26c7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:56.426572 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170d9e7-ea9f-490d-9041-9a119a3f26c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:56.428757 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170d9e7-ea9f-490d-9041-9a119a3f26c7 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:56.450551 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-3170d9e7-ea9f-490d-9041-9a119a3f26c7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:25:56.452186 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 12/23] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:25:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:25:56.458674 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8156caa-f017-4291-9a41-a1ce12c15fc5 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:56.468873 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8156caa-f017-4291-9a41-a1ce12c15fc5 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:56.480305 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa700b-720d-40f8-b3fd-5c618d362514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:56.481623 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa700b-720d-40f8-b3fd-5c618d362514 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:56.482067 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa700b-720d-40f8-b3fd-5c618d362514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:56.482485 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa700b-720d-40f8-b3fd-5c618d362514 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:56.483583 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa700b-720d-40f8-b3fd-5c618d362514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:25:56.484077 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa700b-720d-40f8-b3fd-5c618d362514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:56.485429 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING py.warnings [None req-d5fa700b-720d-40f8-b3fd-5c618d362514 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:25:56.485429 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: warnings.warn(msg) Oct 15 03:25:56.485429 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: Oct 15 03:25:56.486703 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa700b-720d-40f8-b3fd-5c618d362514 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:56.513199 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d31b77-f6a4-474f-a2a9-710296863f41 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:56.513730 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d31b77-f6a4-474f-a2a9-710296863f41 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:56.514144 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d31b77-f6a4-474f-a2a9-710296863f41 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:56.516087 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:25:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:25:56.516905 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 12/25] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:25:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:25:56.522041 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343782bf-b1b3-4ff2-ba59-e32be62856dd None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:56.522621 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343782bf-b1b3-4ff2-ba59-e32be62856dd None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:56.523035 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343782bf-b1b3-4ff2-ba59-e32be62856dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:56.528707 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa700b-720d-40f8-b3fd-5c618d362514 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:56.552540 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa700b-720d-40f8-b3fd-5c618d362514 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:56.558403 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-343782bf-b1b3-4ff2-ba59-e32be62856dd None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:25:56.566337 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-343782bf-b1b3-4ff2-ba59-e32be62856dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:25:56.567617 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c88f1-66f4-437f-9b17-98790b3b74d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:56.569384 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c88f1-66f4-437f-9b17-98790b3b74d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:56.569807 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c88f1-66f4-437f-9b17-98790b3b74d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:56.571214 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c88f1-66f4-437f-9b17-98790b3b74d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:56.572327 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c88f1-66f4-437f-9b17-98790b3b74d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:56.573820 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING py.warnings [None req-203c88f1-66f4-437f-9b17-98790b3b74d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:25:56.573820 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: warnings.warn(msg) Oct 15 03:25:56.573820 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: Oct 15 03:25:56.576796 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c88f1-66f4-437f-9b17-98790b3b74d9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:56.587245 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 14/26] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:25:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:25:56.620531 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343782bf-b1b3-4ff2-ba59-e32be62856dd None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:56.632367 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343782bf-b1b3-4ff2-ba59-e32be62856dd None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:56.646322 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2cbd5-0e82-4183-9986-74a30d0769ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:56.647117 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2cbd5-0e82-4183-9986-74a30d0769ee admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:56.647403 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2cbd5-0e82-4183-9986-74a30d0769ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:56.647723 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2cbd5-0e82-4183-9986-74a30d0769ee admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:56.665787 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2cbd5-0e82-4183-9986-74a30d0769ee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:25:56.666762 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-1ef2cbd5-0e82-4183-9986-74a30d0769ee admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:25:56.668031 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 15/27] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:25:56 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:25:56.669357 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6b55f-2820-4417-abfa-20799f3252f7 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:56.669643 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6b55f-2820-4417-abfa-20799f3252f7 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:56.670097 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6b55f-2820-4417-abfa-20799f3252f7 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:56.671782 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 16/28] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:25:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:25:56.679721 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6b55f-2820-4417-abfa-20799f3252f7 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:56.713314 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6b55f-2820-4417-abfa-20799f3252f7 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:56.717967 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abf4a4-943c-4eab-b239-8f3fa4d24878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:56.718615 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abf4a4-943c-4eab-b239-8f3fa4d24878 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:56.718958 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abf4a4-943c-4eab-b239-8f3fa4d24878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:56.719182 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abf4a4-943c-4eab-b239-8f3fa4d24878 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:56.719979 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abf4a4-943c-4eab-b239-8f3fa4d24878 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:25:56.720290 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abf4a4-943c-4eab-b239-8f3fa4d24878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:56.722072 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abf4a4-943c-4eab-b239-8f3fa4d24878 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:56.742948 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 17/29] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:25:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:25:56.744976 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bee87c-b8f9-49ec-bc87-faa5a82c2538 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:56.745266 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bee87c-b8f9-49ec-bc87-faa5a82c2538 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:56.745550 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bee87c-b8f9-49ec-bc87-faa5a82c2538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:56.780765 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-a8bee87c-b8f9-49ec-bc87-faa5a82c2538 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:25:56.782264 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-a8bee87c-b8f9-49ec-bc87-faa5a82c2538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:25:56.797340 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 13/30] 10.222.0.30 () {60 vars in 1162 bytes} [Fri Oct 15 03:25:56 2021] POST /identity/v3/projects => generated 301 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:25:56.798089 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 18/31] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:25:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:25:56.798329 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c88f1-66f4-437f-9b17-98790b3b74d9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:56.839758 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bee87c-b8f9-49ec-bc87-faa5a82c2538 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:56.854364 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bee87c-b8f9-49ec-bc87-faa5a82c2538 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:56.900020 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c88f1-66f4-437f-9b17-98790b3b74d9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:56.906110 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb761c-fe6a-4b9a-95d9-7f953d678a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:56.907185 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb761c-fe6a-4b9a-95d9-7f953d678a96 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:56.907587 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb761c-fe6a-4b9a-95d9-7f953d678a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:56.908035 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb761c-fe6a-4b9a-95d9-7f953d678a96 admin admin] PATH_INFO: `/v3/users/54e89668dd2f4bda9877cf539179b3ec` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:56.912970 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb761c-fe6a-4b9a-95d9-7f953d678a96 admin admin] RBAC: Authorizing `identity:get_user(user_id=54e89668dd2f4bda9877cf539179b3ec)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:56.912970 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb761c-fe6a-4b9a-95d9-7f953d678a96 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:56.915613 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 14/32] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:25:56 2021] GET /identity/v3/users/54e89668dd2f4bda9877cf539179b3ec => generated 247 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:25:56.925462 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb761c-fe6a-4b9a-95d9-7f953d678a96 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:56.942487 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb761c-fe6a-4b9a-95d9-7f953d678a96 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:56.953179 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9620ad-1974-49ef-aeee-c735ad0c67fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:56.954081 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9620ad-1974-49ef-aeee-c735ad0c67fc admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:56.955709 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9620ad-1974-49ef-aeee-c735ad0c67fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:56.955709 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9620ad-1974-49ef-aeee-c735ad0c67fc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:56.963207 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9620ad-1974-49ef-aeee-c735ad0c67fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:56.963207 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9620ad-1974-49ef-aeee-c735ad0c67fc admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:56.963207 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 15/33] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:25:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:25:56.969687 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9620ad-1974-49ef-aeee-c735ad0c67fc admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:56.985948 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9620ad-1974-49ef-aeee-c735ad0c67fc admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:56.997951 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ce86a-b7fc-4b79-94f6-89b3ccd65989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:56.998891 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ce86a-b7fc-4b79-94f6-89b3ccd65989 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:56.999238 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ce86a-b7fc-4b79-94f6-89b3ccd65989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:56.999529 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ce86a-b7fc-4b79-94f6-89b3ccd65989 admin admin] PATH_INFO: `/v3/domains/default/users/54e89668dd2f4bda9877cf539179b3ec/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:57.004057 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ce86a-b7fc-4b79-94f6-89b3ccd65989 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=54e89668dd2f4bda9877cf539179b3ec, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:57.004474 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424b061-1e44-4a53-8613-ba58eb464f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:57.005178 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424b061-1e44-4a53-8613-ba58eb464f8a admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:57.005466 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424b061-1e44-4a53-8613-ba58eb464f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:57.005558 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING py.warnings [None req-223ce86a-b7fc-4b79-94f6-89b3ccd65989 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:25:57.005558 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: warnings.warn(msg) Oct 15 03:25:57.005558 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: Oct 15 03:25:57.005821 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424b061-1e44-4a53-8613-ba58eb464f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:57.006539 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424b061-1e44-4a53-8613-ba58eb464f8a admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:57.007565 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING py.warnings [None req-e424b061-1e44-4a53-8613-ba58eb464f8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:25:57.007565 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: warnings.warn(msg) Oct 15 03:25:57.007565 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: Oct 15 03:25:57.007782 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ce86a-b7fc-4b79-94f6-89b3ccd65989 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:57.008536 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424b061-1e44-4a53-8613-ba58eb464f8a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:57.042033 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 16/34] 10.222.0.30 () {58 vars in 1382 bytes} [Fri Oct 15 03:25:56 2021] PUT /identity/v3/domains/default/users/54e89668dd2f4bda9877cf539179b3ec/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:25:57.164643 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095083a-219c-4224-aaec-247e0e57b7e7 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:57.165575 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095083a-219c-4224-aaec-247e0e57b7e7 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:57.165840 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095083a-219c-4224-aaec-247e0e57b7e7 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:57.172357 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 17/35] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:25:57 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:25:57.178658 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16acbe-a2d2-4add-a4cf-af90a0ac202e None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:57.178962 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16acbe-a2d2-4add-a4cf-af90a0ac202e None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:57.179254 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16acbe-a2d2-4add-a4cf-af90a0ac202e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:57.187699 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 19/36] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:25:56 2021] POST /identity/v3/roles => generated 219 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:25:57.216998 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-7b16acbe-a2d2-4add-a4cf-af90a0ac202e None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:25:57.218721 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7b16acbe-a2d2-4add-a4cf-af90a0ac202e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:25:57.313442 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 18/37] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:25:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:25:57.355910 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424b061-1e44-4a53-8613-ba58eb464f8a admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:57.373337 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424b061-1e44-4a53-8613-ba58eb464f8a admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:57.379270 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae07ae-4c9b-4ab3-ad21-70146c15a310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:57.380026 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae07ae-4c9b-4ab3-ad21-70146c15a310 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:57.380319 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae07ae-4c9b-4ab3-ad21-70146c15a310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:57.380602 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae07ae-4c9b-4ab3-ad21-70146c15a310 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:57.381394 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae07ae-4c9b-4ab3-ad21-70146c15a310 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:57.383287 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae07ae-4c9b-4ab3-ad21-70146c15a310 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:57.408608 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 20/38] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:25:57 2021] POST /identity/v3/roles => generated 225 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:25:57.752511 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab943906-2006-4b4d-bfa4-27bf0840ede3 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:57.752802 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab943906-2006-4b4d-bfa4-27bf0840ede3 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:57.753249 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab943906-2006-4b4d-bfa4-27bf0840ede3 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:57.755195 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 19/39] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:25:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:25:57.760847 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb249be-ce97-49d6-a821-6d0de02093d5 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:57.761142 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb249be-ce97-49d6-a821-6d0de02093d5 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:57.761424 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb249be-ce97-49d6-a821-6d0de02093d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:57.779752 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-5fb249be-ce97-49d6-a821-6d0de02093d5 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:25:57.781282 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-5fb249be-ce97-49d6-a821-6d0de02093d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:25:57.789013 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 21/40] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:25:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:25:57.812699 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab943906-2006-4b4d-bfa4-27bf0840ede3 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:57.821594 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07131560-ad12-4a9a-bf26-9340be14a662 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:57.821889 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07131560-ad12-4a9a-bf26-9340be14a662 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:57.822167 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07131560-ad12-4a9a-bf26-9340be14a662 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:57.823967 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 22/41] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:25:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:25:57.825837 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab943906-2006-4b4d-bfa4-27bf0840ede3 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:57.829484 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745db14-02de-4a17-ab58-cea7682fa3f3 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:57.829772 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745db14-02de-4a17-ab58-cea7682fa3f3 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:57.830049 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745db14-02de-4a17-ab58-cea7682fa3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:57.830224 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fa88c-5d81-44ee-aeba-a54a1cf7a2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:57.830876 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fa88c-5d81-44ee-aeba-a54a1cf7a2f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:57.831163 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fa88c-5d81-44ee-aeba-a54a1cf7a2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:57.831441 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fa88c-5d81-44ee-aeba-a54a1cf7a2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:57.832253 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fa88c-5d81-44ee-aeba-a54a1cf7a2f7 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:57.833274 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING py.warnings [None req-0a9fa88c-5d81-44ee-aeba-a54a1cf7a2f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:25:57.833274 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: warnings.warn(msg) Oct 15 03:25:57.833274 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: Oct 15 03:25:57.834159 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fa88c-5d81-44ee-aeba-a54a1cf7a2f7 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:57.847752 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-3745db14-02de-4a17-ab58-cea7682fa3f3 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:25:57.848797 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 20/42] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:25:57 2021] POST /identity/v3/roles => generated 223 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:25:57.849262 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-3745db14-02de-4a17-ab58-cea7682fa3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:25:57.857740 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 23/43] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:25:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:25:57.881837 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fa88c-5d81-44ee-aeba-a54a1cf7a2f7 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:57.892070 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fa88c-5d81-44ee-aeba-a54a1cf7a2f7 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:57.896509 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5285d1-5b08-4dae-b730-4f5ea5402e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:57.897302 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5285d1-5b08-4dae-b730-4f5ea5402e53 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:57.897588 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5285d1-5b08-4dae-b730-4f5ea5402e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:57.897865 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5285d1-5b08-4dae-b730-4f5ea5402e53 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:57.899129 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5285d1-5b08-4dae-b730-4f5ea5402e53 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:57.901447 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5285d1-5b08-4dae-b730-4f5ea5402e53 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:57.903350 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 21/44] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:25:57 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:25:57.909765 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745db14-02de-4a17-ab58-cea7682fa3f3 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:57.919643 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745db14-02de-4a17-ab58-cea7682fa3f3 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:57.924230 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4374749-1795-4413-89fc-f6e667e173da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:57.924909 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4374749-1795-4413-89fc-f6e667e173da admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:57.925193 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4374749-1795-4413-89fc-f6e667e173da admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:57.925505 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4374749-1795-4413-89fc-f6e667e173da admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:57.926245 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4374749-1795-4413-89fc-f6e667e173da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:57.927270 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING py.warnings [None req-c4374749-1795-4413-89fc-f6e667e173da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:25:57.927270 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: warnings.warn(msg) Oct 15 03:25:57.927270 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: Oct 15 03:25:57.928549 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4374749-1795-4413-89fc-f6e667e173da admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:57.959791 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 24/45] 10.222.0.30 () {60 vars in 1162 bytes} [Fri Oct 15 03:25:57 2021] POST /identity/v3/projects => generated 312 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:25:59.542487 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0a836-6a84-41f4-81b9-aba8ef8229c9 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:59.542988 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0a836-6a84-41f4-81b9-aba8ef8229c9 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:59.542988 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0a836-6a84-41f4-81b9-aba8ef8229c9 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:59.544772 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 22/46] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:25:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:25:59.550505 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62dc72-e036-4d43-b1c7-99326b8b1f3c None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:59.550889 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62dc72-e036-4d43-b1c7-99326b8b1f3c None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:59.551155 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62dc72-e036-4d43-b1c7-99326b8b1f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:59.568390 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-1c62dc72-e036-4d43-b1c7-99326b8b1f3c None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:25:59.569578 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-1c62dc72-e036-4d43-b1c7-99326b8b1f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:25:59.628708 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 25/47] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:25:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:25:59.653570 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0a836-6a84-41f4-81b9-aba8ef8229c9 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:59.665678 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0a836-6a84-41f4-81b9-aba8ef8229c9 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:59.669936 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b1b9b-72c4-44bf-9d6c-d995e649ea99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:59.670768 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b1b9b-72c4-44bf-9d6c-d995e649ea99 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:59.671120 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b1b9b-72c4-44bf-9d6c-d995e649ea99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:59.671488 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b1b9b-72c4-44bf-9d6c-d995e649ea99 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:59.681607 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b1b9b-72c4-44bf-9d6c-d995e649ea99 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:25:59.688519 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-b89b1b9b-72c4-44bf-9d6c-d995e649ea99 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:25:59.689707 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 23/48] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:25:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:25:59.697133 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62dc72-e036-4d43-b1c7-99326b8b1f3c None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:59.706042 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62dc72-e036-4d43-b1c7-99326b8b1f3c None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:59.710398 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7986d2d-31cf-4a03-a5a3-5c28e81db974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:59.711052 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7986d2d-31cf-4a03-a5a3-5c28e81db974 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:59.711337 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7986d2d-31cf-4a03-a5a3-5c28e81db974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:59.711618 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7986d2d-31cf-4a03-a5a3-5c28e81db974 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:59.712966 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7986d2d-31cf-4a03-a5a3-5c28e81db974 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:25:59.713278 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7986d2d-31cf-4a03-a5a3-5c28e81db974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:59.714917 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7986d2d-31cf-4a03-a5a3-5c28e81db974 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:59.725091 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 26/49] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:25:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:25:59.731129 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b1b9b-72c4-44bf-9d6c-d995e649ea99 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:59.741163 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b1b9b-72c4-44bf-9d6c-d995e649ea99 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:59.745529 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81bad6-06c2-4976-9e4f-ee15b3852107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:59.746362 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81bad6-06c2-4976-9e4f-ee15b3852107 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:59.746682 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81bad6-06c2-4976-9e4f-ee15b3852107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:59.746963 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81bad6-06c2-4976-9e4f-ee15b3852107 admin admin] PATH_INFO: `/v3/users/54e89668dd2f4bda9877cf539179b3ec` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:59.748188 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81bad6-06c2-4976-9e4f-ee15b3852107 admin admin] RBAC: Authorizing `identity:get_user(user_id=54e89668dd2f4bda9877cf539179b3ec)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:59.750036 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81bad6-06c2-4976-9e4f-ee15b3852107 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:59.751595 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 24/50] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:25:59 2021] GET /identity/v3/users/54e89668dd2f4bda9877cf539179b3ec => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:25:59.757570 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7986d2d-31cf-4a03-a5a3-5c28e81db974 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:59.767411 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7986d2d-31cf-4a03-a5a3-5c28e81db974 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:59.771746 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac9612-f30e-48ab-9f9a-8aee9ef4d3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:59.772513 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac9612-f30e-48ab-9f9a-8aee9ef4d3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:59.772795 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac9612-f30e-48ab-9f9a-8aee9ef4d3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:59.773070 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac9612-f30e-48ab-9f9a-8aee9ef4d3c4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:59.774281 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac9612-f30e-48ab-9f9a-8aee9ef4d3c4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:59.776489 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac9612-f30e-48ab-9f9a-8aee9ef4d3c4 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:59.778031 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 27/51] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:25:59 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:25:59.783985 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81bad6-06c2-4976-9e4f-ee15b3852107 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:25:59.793348 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81bad6-06c2-4976-9e4f-ee15b3852107 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:25:59.797584 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687170a-d074-4abb-8990-798fc8aac940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:25:59.798213 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687170a-d074-4abb-8990-798fc8aac940 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:25:59.798497 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687170a-d074-4abb-8990-798fc8aac940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:25:59.798773 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687170a-d074-4abb-8990-798fc8aac940 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:25:59.799603 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687170a-d074-4abb-8990-798fc8aac940 admin admin] RBAC: Adding query filter params (role.id=15ba70b0cba04962a6d0b80b50c07004, scope.domain.id=default, user.id=54e89668dd2f4bda9877cf539179b3ec) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:25:59.799948 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687170a-d074-4abb-8990-798fc8aac940 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:25:59.801809 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687170a-d074-4abb-8990-798fc8aac940 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:25:59.808354 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 25/52] 10.222.0.30 () {56 vars in 1343 bytes} [Fri Oct 15 03:25:59 2021] GET /identity/v3/role_assignments?user.id=54e89668dd2f4bda9877cf539179b3ec&scope.domain.id=default&role.id=15ba70b0cba04962a6d0b80b50c07004 => generated 530 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:00.241435 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935fa14-2df5-436a-abf0-69a852ed882d None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:00.241731 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935fa14-2df5-436a-abf0-69a852ed882d None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:00.242013 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935fa14-2df5-436a-abf0-69a852ed882d None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:00.244534 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 28/53] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:00.250272 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878961b-2c90-448b-b350-3260ceadbbaa None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:00.250570 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878961b-2c90-448b-b350-3260ceadbbaa None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:00.250853 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878961b-2c90-448b-b350-3260ceadbbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:00.268066 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-0878961b-2c90-448b-b350-3260ceadbbaa None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:00.269245 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-0878961b-2c90-448b-b350-3260ceadbbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:00.276662 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 26/54] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:00.300370 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935fa14-2df5-436a-abf0-69a852ed882d None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:00.312810 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935fa14-2df5-436a-abf0-69a852ed882d None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:00.317055 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f7872-42a3-4578-8d81-089b4c2d123f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:00.317814 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f7872-42a3-4578-8d81-089b4c2d123f admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:00.318105 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f7872-42a3-4578-8d81-089b4c2d123f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:00.318389 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f7872-42a3-4578-8d81-089b4c2d123f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:00.319572 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f7872-42a3-4578-8d81-089b4c2d123f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:00.321332 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f7872-42a3-4578-8d81-089b4c2d123f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:00.322878 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 29/55] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:00 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:00.328529 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878961b-2c90-448b-b350-3260ceadbbaa None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:00.337078 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878961b-2c90-448b-b350-3260ceadbbaa None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:00.341352 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6280de-70af-40a0-b541-79786571a735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:00.341975 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6280de-70af-40a0-b541-79786571a735 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:00.342257 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6280de-70af-40a0-b541-79786571a735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:00.342531 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6280de-70af-40a0-b541-79786571a735 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:00.343251 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6280de-70af-40a0-b541-79786571a735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:00.345200 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6280de-70af-40a0-b541-79786571a735 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:00.370032 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 27/56] 10.222.0.30 () {60 vars in 1161 bytes} [Fri Oct 15 03:26:00 2021] POST /identity/v3/projects => generated 298 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:26:02.600297 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11fc76-b8dd-47fa-89f3-afb1e331b5d9 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:02.600797 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11fc76-b8dd-47fa-89f3-afb1e331b5d9 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:02.600797 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11fc76-b8dd-47fa-89f3-afb1e331b5d9 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:02.602562 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 30/57] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:02.608833 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec6f0c-cfef-4a94-ba54-578fe1d08f89 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:02.609195 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec6f0c-cfef-4a94-ba54-578fe1d08f89 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:02.609386 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec6f0c-cfef-4a94-ba54-578fe1d08f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:02.627341 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-e0ec6f0c-cfef-4a94-ba54-578fe1d08f89 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:02.628618 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e0ec6f0c-cfef-4a94-ba54-578fe1d08f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:02.682231 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 28/58] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:02.707465 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11fc76-b8dd-47fa-89f3-afb1e331b5d9 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:02.719260 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11fc76-b8dd-47fa-89f3-afb1e331b5d9 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:02.723535 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3c366-12a3-42f2-8382-189a84329bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:02.724618 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3c366-12a3-42f2-8382-189a84329bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:02.724904 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3c366-12a3-42f2-8382-189a84329bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:02.725182 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3c366-12a3-42f2-8382-189a84329bf9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:02.726350 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3c366-12a3-42f2-8382-189a84329bf9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:02.728590 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3c366-12a3-42f2-8382-189a84329bf9 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:02.730201 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 31/59] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:02 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:02.736061 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec6f0c-cfef-4a94-ba54-578fe1d08f89 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:02.745314 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec6f0c-cfef-4a94-ba54-578fe1d08f89 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:02.749732 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84005f79-c003-4af2-9649-9b1696166956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:02.750377 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84005f79-c003-4af2-9649-9b1696166956 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:02.750668 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84005f79-c003-4af2-9649-9b1696166956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:02.750945 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84005f79-c003-4af2-9649-9b1696166956 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:02.751654 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84005f79-c003-4af2-9649-9b1696166956 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:02.752685 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING py.warnings [None req-84005f79-c003-4af2-9649-9b1696166956 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:26:02.752685 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: warnings.warn(msg) Oct 15 03:26:02.752685 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: Oct 15 03:26:02.753925 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84005f79-c003-4af2-9649-9b1696166956 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:02.778558 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 29/60] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Oct 15 03:26:02 2021] POST /identity/v3/users => generated 275 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:26:06.032120 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310bf55-1119-4cc9-abd7-e21fc5cbaff4 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.032990 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310bf55-1119-4cc9-abd7-e21fc5cbaff4 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.033411 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310bf55-1119-4cc9-abd7-e21fc5cbaff4 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.035343 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 32/61] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:06.047207 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61effc05-8be8-40fb-8a0e-9ca8d03fb956 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.048059 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61effc05-8be8-40fb-8a0e-9ca8d03fb956 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.048502 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61effc05-8be8-40fb-8a0e-9ca8d03fb956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.076711 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-61effc05-8be8-40fb-8a0e-9ca8d03fb956 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:06.078267 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-61effc05-8be8-40fb-8a0e-9ca8d03fb956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:06.086463 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 30/62] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:06.129138 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310bf55-1119-4cc9-abd7-e21fc5cbaff4 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:06.145399 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310bf55-1119-4cc9-abd7-e21fc5cbaff4 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:06.150633 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85434419-64ac-4390-a1dc-8ec7cdfea0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:06.151564 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85434419-64ac-4390-a1dc-8ec7cdfea0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.152005 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85434419-64ac-4390-a1dc-8ec7cdfea0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.152419 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85434419-64ac-4390-a1dc-8ec7cdfea0b3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.166243 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85434419-64ac-4390-a1dc-8ec7cdfea0b3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:06.173377 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-85434419-64ac-4390-a1dc-8ec7cdfea0b3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 03:26:06.174756 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 33/63] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:06 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:06.181222 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61effc05-8be8-40fb-8a0e-9ca8d03fb956 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:06.190992 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61effc05-8be8-40fb-8a0e-9ca8d03fb956 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:06.200886 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e1bae-ed36-4cf5-9848-03ef3566cac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:06.201863 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e1bae-ed36-4cf5-9848-03ef3566cac9 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.202288 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e1bae-ed36-4cf5-9848-03ef3566cac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.202711 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e1bae-ed36-4cf5-9848-03ef3566cac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.203645 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e1bae-ed36-4cf5-9848-03ef3566cac9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:06.204184 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e1bae-ed36-4cf5-9848-03ef3566cac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:06.205369 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING py.warnings [None req-209e1bae-ed36-4cf5-9848-03ef3566cac9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:26:06.205369 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: warnings.warn(msg) Oct 15 03:26:06.205369 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: Oct 15 03:26:06.206614 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e1bae-ed36-4cf5-9848-03ef3566cac9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:06.225353 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 31/64] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Oct 15 03:26:06 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:06.231905 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85434419-64ac-4390-a1dc-8ec7cdfea0b3 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:06.249817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85434419-64ac-4390-a1dc-8ec7cdfea0b3 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:06.258712 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7376dc-2dda-4f3b-9639-e10015f8dab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:06.260167 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7376dc-2dda-4f3b-9639-e10015f8dab6 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.260450 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7376dc-2dda-4f3b-9639-e10015f8dab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.260722 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7376dc-2dda-4f3b-9639-e10015f8dab6 admin admin] PATH_INFO: `/v3/users/0189ce49a9fd434894ac7b5f5b829fa6` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.282422 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7376dc-2dda-4f3b-9639-e10015f8dab6 admin admin] RBAC: Authorizing `identity:get_user(user_id=0189ce49a9fd434894ac7b5f5b829fa6)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:06.284567 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7376dc-2dda-4f3b-9639-e10015f8dab6 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:06.286277 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 34/65] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:26:06 2021] GET /identity/v3/users/0189ce49a9fd434894ac7b5f5b829fa6 => generated 275 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:06.293157 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e1bae-ed36-4cf5-9848-03ef3566cac9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:06.307522 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e1bae-ed36-4cf5-9848-03ef3566cac9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:06.316608 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb5662-dd62-43e3-a04f-e77f63735e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:06.317272 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb5662-dd62-43e3-a04f-e77f63735e0f admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.317557 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb5662-dd62-43e3-a04f-e77f63735e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.317834 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb5662-dd62-43e3-a04f-e77f63735e0f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.331843 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb5662-dd62-43e3-a04f-e77f63735e0f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:06.333673 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb5662-dd62-43e3-a04f-e77f63735e0f admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:06.350016 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 32/66] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:06.356880 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7376dc-2dda-4f3b-9639-e10015f8dab6 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:06.364167 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea27334-6292-4b6d-a513-e0e9a47eb3e0 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.364450 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea27334-6292-4b6d-a513-e0e9a47eb3e0 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.364730 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea27334-6292-4b6d-a513-e0e9a47eb3e0 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.366581 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 33/67] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:06 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:06.367495 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7376dc-2dda-4f3b-9639-e10015f8dab6 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:06.373167 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553004e-f246-4539-8fc2-3853dda5bba7 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.373511 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553004e-f246-4539-8fc2-3853dda5bba7 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.373791 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553004e-f246-4539-8fc2-3853dda5bba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.382589 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac6a3a-34e9-4e3c-a5f0-9492f2ae40e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:06.383438 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac6a3a-34e9-4e3c-a5f0-9492f2ae40e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.383737 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac6a3a-34e9-4e3c-a5f0-9492f2ae40e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.384598 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac6a3a-34e9-4e3c-a5f0-9492f2ae40e5 admin admin] PATH_INFO: `/v3/projects/098453151f33456db2f118ed4fac105c` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.386520 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac6a3a-34e9-4e3c-a5f0-9492f2ae40e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=098453151f33456db2f118ed4fac105c)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:06.388627 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac6a3a-34e9-4e3c-a5f0-9492f2ae40e5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:06.396100 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 35/68] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:06 2021] GET /identity/v3/projects/098453151f33456db2f118ed4fac105c => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:06.405948 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac6a3a-34e9-4e3c-a5f0-9492f2ae40e5 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:06.411546 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-3553004e-f246-4539-8fc2-3853dda5bba7 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:06.412755 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-3553004e-f246-4539-8fc2-3853dda5bba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:06.419372 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac6a3a-34e9-4e3c-a5f0-9492f2ae40e5 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:06.427567 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 34/69] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:26:06.436373 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74e058-5b98-4ccf-90b8-effd00f7738c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:06.437043 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74e058-5b98-4ccf-90b8-effd00f7738c admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.437331 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74e058-5b98-4ccf-90b8-effd00f7738c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.437603 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74e058-5b98-4ccf-90b8-effd00f7738c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.438458 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74e058-5b98-4ccf-90b8-effd00f7738c admin admin] RBAC: Adding query filter params (role.id=ee5acd2d5378499bb27dc24366041b42, scope.project.id=098453151f33456db2f118ed4fac105c, user.id=0189ce49a9fd434894ac7b5f5b829fa6) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:06.438767 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74e058-5b98-4ccf-90b8-effd00f7738c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:06.439795 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING py.warnings [None req-3d74e058-5b98-4ccf-90b8-effd00f7738c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:26:06.439795 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: warnings.warn(msg) Oct 15 03:26:06.439795 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: Oct 15 03:26:06.440969 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74e058-5b98-4ccf-90b8-effd00f7738c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:06.448853 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 36/70] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:06 2021] GET /identity/v3/role_assignments?user.id=0189ce49a9fd434894ac7b5f5b829fa6&scope.project.id=098453151f33456db2f118ed4fac105c&role.id=ee5acd2d5378499bb27dc24366041b42 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:06.454673 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553004e-f246-4539-8fc2-3853dda5bba7 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:06.469323 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553004e-f246-4539-8fc2-3853dda5bba7 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:06.485650 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75c7b1-09d0-470f-bea6-874ccc9934a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:06.486473 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75c7b1-09d0-470f-bea6-874ccc9934a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.486763 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75c7b1-09d0-470f-bea6-874ccc9934a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.487039 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75c7b1-09d0-470f-bea6-874ccc9934a1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.508257 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75c7b1-09d0-470f-bea6-874ccc9934a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:06.515408 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-ae75c7b1-09d0-470f-bea6-874ccc9934a1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:26:06.516930 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 35/71] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:26:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:06.523987 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74e058-5b98-4ccf-90b8-effd00f7738c admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:06.534329 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71dbd22-44f8-4b71-83e2-af8893b1a3b2 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.534615 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71dbd22-44f8-4b71-83e2-af8893b1a3b2 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.534810 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71dbd22-44f8-4b71-83e2-af8893b1a3b2 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.536677 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 36/72] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:26:06.540999 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74e058-5b98-4ccf-90b8-effd00f7738c admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:06.547588 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ec14c-6b31-4fb6-871b-82191d05c03f None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.547937 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ec14c-6b31-4fb6-871b-82191d05c03f None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.548178 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ec14c-6b31-4fb6-871b-82191d05c03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.558496 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651053ac-d039-4e94-bd53-f3fd2d01d4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:06.559185 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651053ac-d039-4e94-bd53-f3fd2d01d4fe admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.559466 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651053ac-d039-4e94-bd53-f3fd2d01d4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.559764 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651053ac-d039-4e94-bd53-f3fd2d01d4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.560569 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651053ac-d039-4e94-bd53-f3fd2d01d4fe admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:06.560876 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651053ac-d039-4e94-bd53-f3fd2d01d4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:06.562602 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651053ac-d039-4e94-bd53-f3fd2d01d4fe admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:06.582830 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-7b9ec14c-6b31-4fb6-871b-82191d05c03f None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:06.584141 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7b9ec14c-6b31-4fb6-871b-82191d05c03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:06.588956 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 37/73] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:06.596278 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651053ac-d039-4e94-bd53-f3fd2d01d4fe admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:06.609634 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 37/74] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 15 03:26:06.617302 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651053ac-d039-4e94-bd53-f3fd2d01d4fe admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:06.626501 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc2752-f60e-420f-8222-c7fd60c3e08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:06.627375 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc2752-f60e-420f-8222-c7fd60c3e08d admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.627655 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc2752-f60e-420f-8222-c7fd60c3e08d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.627952 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc2752-f60e-420f-8222-c7fd60c3e08d admin admin] PATH_INFO: `/v3/users/54e89668dd2f4bda9877cf539179b3ec` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.629204 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc2752-f60e-420f-8222-c7fd60c3e08d admin admin] RBAC: Authorizing `identity:get_user(user_id=54e89668dd2f4bda9877cf539179b3ec)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:06.631048 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc2752-f60e-420f-8222-c7fd60c3e08d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:06.633137 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 38/75] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:26:06 2021] GET /identity/v3/users/54e89668dd2f4bda9877cf539179b3ec => generated 247 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:06.640203 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ec14c-6b31-4fb6-871b-82191d05c03f None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:06.647065 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc2752-f60e-420f-8222-c7fd60c3e08d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:06.655905 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ec14c-6b31-4fb6-871b-82191d05c03f None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:06.661898 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617b14d-afa3-49a7-977c-02a5c71efd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:06.662571 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617b14d-afa3-49a7-977c-02a5c71efd4f admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.662866 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617b14d-afa3-49a7-977c-02a5c71efd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.663144 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617b14d-afa3-49a7-977c-02a5c71efd4f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.664048 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc2752-f60e-420f-8222-c7fd60c3e08d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:06.669239 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f873ae-a65b-41e4-8cbb-54ea1945420c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:06.670042 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f873ae-a65b-41e4-8cbb-54ea1945420c admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.670328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f873ae-a65b-41e4-8cbb-54ea1945420c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.670604 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f873ae-a65b-41e4-8cbb-54ea1945420c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.678683 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617b14d-afa3-49a7-977c-02a5c71efd4f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:06.680542 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617b14d-afa3-49a7-977c-02a5c71efd4f admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:06.682174 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f873ae-a65b-41e4-8cbb-54ea1945420c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:06.690448 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-f1f873ae-a65b-41e4-8cbb-54ea1945420c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 03:26:06.691862 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 39/76] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Oct 15 03:26:06 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:06.692873 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 38/77] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:06.699066 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f873ae-a65b-41e4-8cbb-54ea1945420c admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:06.699288 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617b14d-afa3-49a7-977c-02a5c71efd4f admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:06.708847 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617b14d-afa3-49a7-977c-02a5c71efd4f admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:06.713363 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f873ae-a65b-41e4-8cbb-54ea1945420c admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:06.718301 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797bf19c-2b33-420b-b1ba-18785d55c2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:06.719178 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bf19c-2b33-420b-b1ba-18785d55c2bc admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.719463 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bf19c-2b33-420b-b1ba-18785d55c2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.719769 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bf19c-2b33-420b-b1ba-18785d55c2bc admin admin] PATH_INFO: `/v3/projects/098453151f33456db2f118ed4fac105c` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.721380 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797bf19c-2b33-420b-b1ba-18785d55c2bc admin admin] RBAC: Authorizing `identity:get_project(project_id=098453151f33456db2f118ed4fac105c)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:06.722776 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7142b6-81c8-4deb-a9a2-da4bb694b185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:06.723668 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797bf19c-2b33-420b-b1ba-18785d55c2bc admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:06.724281 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7142b6-81c8-4deb-a9a2-da4bb694b185 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.724815 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7142b6-81c8-4deb-a9a2-da4bb694b185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.725306 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7142b6-81c8-4deb-a9a2-da4bb694b185 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.726118 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 39/78] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:06 2021] GET /identity/v3/projects/098453151f33456db2f118ed4fac105c => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:06.726571 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7142b6-81c8-4deb-a9a2-da4bb694b185 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:06.727128 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7142b6-81c8-4deb-a9a2-da4bb694b185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:06.729750 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7142b6-81c8-4deb-a9a2-da4bb694b185 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:06.732810 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750b632-f104-407d-84f6-82c29ae2d99a None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.733101 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750b632-f104-407d-84f6-82c29ae2d99a None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.733381 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750b632-f104-407d-84f6-82c29ae2d99a None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.735235 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 40/79] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:26:06.737405 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750b632-f104-407d-84f6-82c29ae2d99a None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:06.740747 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 40/80] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:06 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:06.742926 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1bd43-f8bb-452e-b1d7-bb8720c8a736 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.743477 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1bd43-f8bb-452e-b1d7-bb8720c8a736 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.744017 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1bd43-f8bb-452e-b1d7-bb8720c8a736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.751794 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750b632-f104-407d-84f6-82c29ae2d99a None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:06.756242 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48d583-f492-43f7-8bcc-d04c0de76f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:06.756889 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48d583-f492-43f7-8bcc-d04c0de76f6c admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.757180 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48d583-f492-43f7-8bcc-d04c0de76f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.757462 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48d583-f492-43f7-8bcc-d04c0de76f6c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.758310 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48d583-f492-43f7-8bcc-d04c0de76f6c admin admin] RBAC: Adding query filter params (role.id=15ba70b0cba04962a6d0b80b50c07004, scope.project.id=098453151f33456db2f118ed4fac105c, user.id=54e89668dd2f4bda9877cf539179b3ec) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:06.758621 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48d583-f492-43f7-8bcc-d04c0de76f6c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:06.760571 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48d583-f492-43f7-8bcc-d04c0de76f6c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:06.765869 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-d8a1bd43-f8bb-452e-b1d7-bb8720c8a736 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:06.766322 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 41/81] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:06 2021] GET /identity/v3/role_assignments?user.id=54e89668dd2f4bda9877cf539179b3ec&scope.project.id=098453151f33456db2f118ed4fac105c&role.id=15ba70b0cba04962a6d0b80b50c07004 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:06.767111 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48d583-f492-43f7-8bcc-d04c0de76f6c admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:06.767944 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-d8a1bd43-f8bb-452e-b1d7-bb8720c8a736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:06.776955 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 41/82] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:06.793703 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48d583-f492-43f7-8bcc-d04c0de76f6c admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:06.803712 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1bd43-f8bb-452e-b1d7-bb8720c8a736 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:06.805764 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6f246-94eb-422f-ba31-826d27ab206f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:06.807190 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6f246-94eb-422f-ba31-826d27ab206f admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.807473 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6f246-94eb-422f-ba31-826d27ab206f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.807773 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6f246-94eb-422f-ba31-826d27ab206f admin admin] PATH_INFO: `/v3/users/0189ce49a9fd434894ac7b5f5b829fa6` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.812632 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6f246-94eb-422f-ba31-826d27ab206f admin admin] RBAC: Authorizing `identity:get_user(user_id=0189ce49a9fd434894ac7b5f5b829fa6)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:06.814869 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6f246-94eb-422f-ba31-826d27ab206f admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:06.815835 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1bd43-f8bb-452e-b1d7-bb8720c8a736 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:06.816634 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 42/83] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:26:06 2021] GET /identity/v3/users/0189ce49a9fd434894ac7b5f5b829fa6 => generated 275 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:06.821290 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324cbcc-42f9-492a-a838-e92708c1e793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:06.823133 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324cbcc-42f9-492a-a838-e92708c1e793 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.823550 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6f246-94eb-422f-ba31-826d27ab206f admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:06.823873 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324cbcc-42f9-492a-a838-e92708c1e793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.824438 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324cbcc-42f9-492a-a838-e92708c1e793 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.840995 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324cbcc-42f9-492a-a838-e92708c1e793 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:06.843645 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6f246-94eb-422f-ba31-826d27ab206f admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:06.853945 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f8299-90d1-430b-ad1d-9fdc33bde11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:06.854966 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f8299-90d1-430b-ad1d-9fdc33bde11d admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.856358 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-f324cbcc-42f9-492a-a838-e92708c1e793 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 03:26:06.856929 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f8299-90d1-430b-ad1d-9fdc33bde11d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.857408 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f8299-90d1-430b-ad1d-9fdc33bde11d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.859440 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 42/84] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:06 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:06.866668 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324cbcc-42f9-492a-a838-e92708c1e793 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:06.877131 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f8299-90d1-430b-ad1d-9fdc33bde11d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:06.879507 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f8299-90d1-430b-ad1d-9fdc33bde11d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:06.880681 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324cbcc-42f9-492a-a838-e92708c1e793 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:06.886480 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784b1ec-7330-4c11-8b09-00c4de48fc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:06.887262 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784b1ec-7330-4c11-8b09-00c4de48fc81 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.887549 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784b1ec-7330-4c11-8b09-00c4de48fc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.887871 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784b1ec-7330-4c11-8b09-00c4de48fc81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.888721 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784b1ec-7330-4c11-8b09-00c4de48fc81 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:06.889093 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784b1ec-7330-4c11-8b09-00c4de48fc81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:06.890749 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784b1ec-7330-4c11-8b09-00c4de48fc81 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:06.893889 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 43/85] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:26:06.895616 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba7bea-08bc-4c89-a7f3-b3fa6b8c138a None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.896124 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba7bea-08bc-4c89-a7f3-b3fa6b8c138a None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.896663 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba7bea-08bc-4c89-a7f3-b3fa6b8c138a None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.898690 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 44/86] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:06.902423 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba7bea-08bc-4c89-a7f3-b3fa6b8c138a None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:06.909335 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 43/87] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Oct 15 03:26:06 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:06.912142 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1d965-4753-4057-86c8-63c1c8601be5 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.914455 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1d965-4753-4057-86c8-63c1c8601be5 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.915032 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1d965-4753-4057-86c8-63c1c8601be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.927844 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba7bea-08bc-4c89-a7f3-b3fa6b8c138a None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:06.932869 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e507b-2bf3-439e-98d4-48854313158c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:06.934027 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e507b-2bf3-439e-98d4-48854313158c admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.934530 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e507b-2bf3-439e-98d4-48854313158c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.935091 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e507b-2bf3-439e-98d4-48854313158c admin admin] PATH_INFO: `/v3/projects/098453151f33456db2f118ed4fac105c` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.935192 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-55e1d965-4753-4057-86c8-63c1c8601be5 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:06.936488 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-55e1d965-4753-4057-86c8-63c1c8601be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:06.936932 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e507b-2bf3-439e-98d4-48854313158c admin admin] RBAC: Authorizing `identity:get_project(project_id=098453151f33456db2f118ed4fac105c)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:06.939512 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e507b-2bf3-439e-98d4-48854313158c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:06.942151 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 45/88] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:06 2021] GET /identity/v3/projects/098453151f33456db2f118ed4fac105c => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:06.943124 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e507b-2bf3-439e-98d4-48854313158c admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:06.950755 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 44/89] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:06.956819 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1d965-4753-4057-86c8-63c1c8601be5 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:06.959146 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e507b-2bf3-439e-98d4-48854313158c admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:06.976180 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b8375-b527-43f0-b532-46c9423e8321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:06.977502 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b8375-b527-43f0-b532-46c9423e8321 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.977668 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1d965-4753-4057-86c8-63c1c8601be5 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:06.978692 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b8375-b527-43f0-b532-46c9423e8321 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.979404 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b8375-b527-43f0-b532-46c9423e8321 admin admin] PATH_INFO: `/v3/users/0189ce49a9fd434894ac7b5f5b829fa6` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.981758 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b8375-b527-43f0-b532-46c9423e8321 admin admin] RBAC: Authorizing `identity:get_user(user_id=0189ce49a9fd434894ac7b5f5b829fa6)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:06.983979 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b8375-b527-43f0-b532-46c9423e8321 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:06.985678 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 46/90] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:26:06 2021] GET /identity/v3/users/0189ce49a9fd434894ac7b5f5b829fa6 => generated 275 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:06.986448 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b8375-b527-43f0-b532-46c9423e8321 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:06.987143 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c640b-7675-4535-9c06-8f789bf92436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:06.988129 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c640b-7675-4535-9c06-8f789bf92436 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:06.988663 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c640b-7675-4535-9c06-8f789bf92436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:06.989137 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c640b-7675-4535-9c06-8f789bf92436 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:06.990251 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c640b-7675-4535-9c06-8f789bf92436 admin admin] RBAC: Adding query filter params (role.id=3f958dcb5c7c413a9d9edd4ed05d20a2, scope.project.id=098453151f33456db2f118ed4fac105c, user.id=0189ce49a9fd434894ac7b5f5b829fa6) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:06.990782 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c640b-7675-4535-9c06-8f789bf92436 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:06.993580 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c640b-7675-4535-9c06-8f789bf92436 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:07.000464 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 45/91] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:06 2021] GET /identity/v3/role_assignments?user.id=0189ce49a9fd434894ac7b5f5b829fa6&scope.project.id=098453151f33456db2f118ed4fac105c&role.id=3f958dcb5c7c413a9d9edd4ed05d20a2 => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:07.001910 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b8375-b527-43f0-b532-46c9423e8321 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:07.002423 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c640b-7675-4535-9c06-8f789bf92436 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:07.018810 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467acaea-d94c-4174-836b-4c131c01a417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:07.021244 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c640b-7675-4535-9c06-8f789bf92436 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:07.022841 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467acaea-d94c-4174-836b-4c131c01a417 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:07.023127 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467acaea-d94c-4174-836b-4c131c01a417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:07.023406 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467acaea-d94c-4174-836b-4c131c01a417 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:07.026815 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467acaea-d94c-4174-836b-4c131c01a417 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:07.028096 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467acaea-d94c-4174-836b-4c131c01a417 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:07.029826 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 47/92] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:06 2021] GET /identity/v3/domains/default => generated 199 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:07.030663 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604abac-9f85-406c-b1bb-d8db5017b3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:07.031669 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604abac-9f85-406c-b1bb-d8db5017b3ea admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:07.032170 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604abac-9f85-406c-b1bb-d8db5017b3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:07.033115 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604abac-9f85-406c-b1bb-d8db5017b3ea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:07.041258 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467acaea-d94c-4174-836b-4c131c01a417 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:07.055158 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604abac-9f85-406c-b1bb-d8db5017b3ea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:07.058046 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604abac-9f85-406c-b1bb-d8db5017b3ea admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:07.068549 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 46/93] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:07 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:07.071791 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467acaea-d94c-4174-836b-4c131c01a417 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:07.074856 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604abac-9f85-406c-b1bb-d8db5017b3ea admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:07.082772 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7731531-eb05-410c-af07-5f8d625a5dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:07.083785 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7731531-eb05-410c-af07-5f8d625a5dad admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:07.084256 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7731531-eb05-410c-af07-5f8d625a5dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:07.084674 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7731531-eb05-410c-af07-5f8d625a5dad admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:07.085615 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7731531-eb05-410c-af07-5f8d625a5dad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:07.089251 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7731531-eb05-410c-af07-5f8d625a5dad admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:07.094944 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604abac-9f85-406c-b1bb-d8db5017b3ea admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:07.108570 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc87239-f44f-4cd6-b81d-68d24f1b3c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:07.109688 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc87239-f44f-4cd6-b81d-68d24f1b3c5d admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:07.110160 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc87239-f44f-4cd6-b81d-68d24f1b3c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:07.110571 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc87239-f44f-4cd6-b81d-68d24f1b3c5d admin admin] PATH_INFO: `/v3/projects/8920535d049b4db8ad55269dd481924a` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:07.114291 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc87239-f44f-4cd6-b81d-68d24f1b3c5d admin admin] RBAC: Authorizing `identity:get_project(project_id=8920535d049b4db8ad55269dd481924a)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:07.116665 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc87239-f44f-4cd6-b81d-68d24f1b3c5d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:07.121164 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 47/94] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:07 2021] GET /identity/v3/projects/8920535d049b4db8ad55269dd481924a => generated 312 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:07.128009 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc87239-f44f-4cd6-b81d-68d24f1b3c5d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:07.145035 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc87239-f44f-4cd6-b81d-68d24f1b3c5d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:07.146874 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 48/95] 10.222.0.30 () {60 vars in 1162 bytes} [Fri Oct 15 03:26:07 2021] POST /identity/v3/projects => generated 302 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:26:07.219793 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813d47f-6d54-4372-8d76-df41cf19253d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:07.220836 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813d47f-6d54-4372-8d76-df41cf19253d admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:07.221286 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813d47f-6d54-4372-8d76-df41cf19253d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:07.221746 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813d47f-6d54-4372-8d76-df41cf19253d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:07.222868 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813d47f-6d54-4372-8d76-df41cf19253d admin admin] RBAC: Adding query filter params (role.id=ee5acd2d5378499bb27dc24366041b42, scope.project.id=8920535d049b4db8ad55269dd481924a, user.id=0189ce49a9fd434894ac7b5f5b829fa6) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:07.223321 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813d47f-6d54-4372-8d76-df41cf19253d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:07.225771 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813d47f-6d54-4372-8d76-df41cf19253d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:07.237490 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 48/96] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:07 2021] GET /identity/v3/role_assignments?user.id=0189ce49a9fd434894ac7b5f5b829fa6&scope.project.id=8920535d049b4db8ad55269dd481924a&role.id=ee5acd2d5378499bb27dc24366041b42 => generated 259 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:09.207379 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a84234-46c3-4305-a002-10c8ed04dc4f None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:09.208416 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a84234-46c3-4305-a002-10c8ed04dc4f None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:09.208897 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a84234-46c3-4305-a002-10c8ed04dc4f None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:09.210954 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 49/97] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:09.217674 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7a77c-a9a4-463c-92b7-84e015068874 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:09.218478 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7a77c-a9a4-463c-92b7-84e015068874 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:09.218947 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7a77c-a9a4-463c-92b7-84e015068874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:09.245161 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-17c7a77c-a9a4-463c-92b7-84e015068874 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:09.246348 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-17c7a77c-a9a4-463c-92b7-84e015068874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:09.258774 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 49/98] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:09.290798 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a84234-46c3-4305-a002-10c8ed04dc4f None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:09.304227 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a84234-46c3-4305-a002-10c8ed04dc4f None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:09.310102 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a8acf-a0ac-4697-8f69-0fcaf913860a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:09.310878 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a8acf-a0ac-4697-8f69-0fcaf913860a admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:09.311153 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a8acf-a0ac-4697-8f69-0fcaf913860a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:09.311422 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a8acf-a0ac-4697-8f69-0fcaf913860a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:09.333005 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a8acf-a0ac-4697-8f69-0fcaf913860a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:09.340863 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-8f3a8acf-a0ac-4697-8f69-0fcaf913860a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 03:26:09.342152 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 50/99] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:09 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:09.348751 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7a77c-a9a4-463c-92b7-84e015068874 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:09.361025 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7a77c-a9a4-463c-92b7-84e015068874 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:09.372326 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1e017-5a70-4e0e-b500-8a2a04f515af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:09.373008 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1e017-5a70-4e0e-b500-8a2a04f515af admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:09.373290 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1e017-5a70-4e0e-b500-8a2a04f515af admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:09.373567 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1e017-5a70-4e0e-b500-8a2a04f515af admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:09.374337 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1e017-5a70-4e0e-b500-8a2a04f515af admin admin] RBAC: Adding query filter params (name=member) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:09.374641 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1e017-5a70-4e0e-b500-8a2a04f515af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:09.376282 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1e017-5a70-4e0e-b500-8a2a04f515af admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:09.394176 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 50/100] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Oct 15 03:26:09 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:09.400574 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a8acf-a0ac-4697-8f69-0fcaf913860a admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:09.417162 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a8acf-a0ac-4697-8f69-0fcaf913860a admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:09.424480 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8789c3a-1e2b-48f2-8db5-2f9c089e07dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:09.425352 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8789c3a-1e2b-48f2-8db5-2f9c089e07dc admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:09.425638 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8789c3a-1e2b-48f2-8db5-2f9c089e07dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:09.425917 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8789c3a-1e2b-48f2-8db5-2f9c089e07dc admin admin] PATH_INFO: `/v3/users/0189ce49a9fd434894ac7b5f5b829fa6` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:09.432672 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8789c3a-1e2b-48f2-8db5-2f9c089e07dc admin admin] RBAC: Authorizing `identity:get_user(user_id=0189ce49a9fd434894ac7b5f5b829fa6)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:09.434887 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8789c3a-1e2b-48f2-8db5-2f9c089e07dc admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:09.436562 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 51/101] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:26:09 2021] GET /identity/v3/users/0189ce49a9fd434894ac7b5f5b829fa6 => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:09.442699 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1e017-5a70-4e0e-b500-8a2a04f515af admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:09.456659 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1e017-5a70-4e0e-b500-8a2a04f515af admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:09.464874 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3d2f3-799b-488d-ad18-50c8b4aabfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:09.465664 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3d2f3-799b-488d-ad18-50c8b4aabfba admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:09.465950 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3d2f3-799b-488d-ad18-50c8b4aabfba admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:09.466224 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3d2f3-799b-488d-ad18-50c8b4aabfba admin admin] PATH_INFO: `/v3/projects/098453151f33456db2f118ed4fac105c` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:09.467443 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3d2f3-799b-488d-ad18-50c8b4aabfba admin admin] RBAC: Authorizing `identity:get_project(project_id=098453151f33456db2f118ed4fac105c)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:09.469544 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3d2f3-799b-488d-ad18-50c8b4aabfba admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:09.471491 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 51/102] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:09 2021] GET /identity/v3/projects/098453151f33456db2f118ed4fac105c => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:09.478127 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8789c3a-1e2b-48f2-8db5-2f9c089e07dc admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:09.493480 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8789c3a-1e2b-48f2-8db5-2f9c089e07dc admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:09.503563 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40982a7b-7fff-4fb6-bd33-4bee04ef3de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:09.504491 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40982a7b-7fff-4fb6-bd33-4bee04ef3de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:09.504781 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40982a7b-7fff-4fb6-bd33-4bee04ef3de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:09.505060 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40982a7b-7fff-4fb6-bd33-4bee04ef3de7 admin admin] PATH_INFO: `/v3/projects/098453151f33456db2f118ed4fac105c/users/0189ce49a9fd434894ac7b5f5b829fa6/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:09.508572 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40982a7b-7fff-4fb6-bd33-4bee04ef3de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098453151f33456db2f118ed4fac105c, user_id=0189ce49a9fd434894ac7b5f5b829fa6, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:09.511784 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40982a7b-7fff-4fb6-bd33-4bee04ef3de7 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:09.527366 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 52/103] 10.222.0.30 () {58 vars in 1460 bytes} [Fri Oct 15 03:26:09 2021] PUT /identity/v3/projects/098453151f33456db2f118ed4fac105c/users/0189ce49a9fd434894ac7b5f5b829fa6/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:26:09.544711 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308e027-faf6-41dc-ac43-3143fb391eca None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:09.545570 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308e027-faf6-41dc-ac43-3143fb391eca None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:09.546144 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308e027-faf6-41dc-ac43-3143fb391eca None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:09.548533 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 52/104] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:09.555500 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c8dc8-d4d6-4db0-b710-4deca28513a3 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:09.556683 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c8dc8-d4d6-4db0-b710-4deca28513a3 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:09.557168 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c8dc8-d4d6-4db0-b710-4deca28513a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:09.576048 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-fe8c8dc8-d4d6-4db0-b710-4deca28513a3 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:09.577642 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-fe8c8dc8-d4d6-4db0-b710-4deca28513a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:09.658078 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 53/105] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:09.707076 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308e027-faf6-41dc-ac43-3143fb391eca None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:09.729028 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308e027-faf6-41dc-ac43-3143fb391eca None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:09.739301 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f0aa5-18b4-425d-9ae6-59295b763d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:09.740148 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f0aa5-18b4-425d-9ae6-59295b763d9f admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:09.740435 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f0aa5-18b4-425d-9ae6-59295b763d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:09.740716 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f0aa5-18b4-425d-9ae6-59295b763d9f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:09.756765 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f0aa5-18b4-425d-9ae6-59295b763d9f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:09.763730 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-b98f0aa5-18b4-425d-9ae6-59295b763d9f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:26:09.764983 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 53/106] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:26:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:09.771489 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c8dc8-d4d6-4db0-b710-4deca28513a3 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:09.787377 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c8dc8-d4d6-4db0-b710-4deca28513a3 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:09.795249 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244e85a-0b78-4f23-b360-1a2bffc285ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:09.797841 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244e85a-0b78-4f23-b360-1a2bffc285ef admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:09.797841 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244e85a-0b78-4f23-b360-1a2bffc285ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:09.797841 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244e85a-0b78-4f23-b360-1a2bffc285ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:09.798351 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244e85a-0b78-4f23-b360-1a2bffc285ef admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:09.798661 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244e85a-0b78-4f23-b360-1a2bffc285ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:09.800425 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244e85a-0b78-4f23-b360-1a2bffc285ef admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:09.816049 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 54/107] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:09.824118 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f0aa5-18b4-425d-9ae6-59295b763d9f admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:09.831381 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f12a7-7704-465f-afa3-53108d03778f None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:09.831728 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f12a7-7704-465f-afa3-53108d03778f None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:09.832015 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f12a7-7704-465f-afa3-53108d03778f None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:09.833910 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 55/108] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:26:09.839031 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f0aa5-18b4-425d-9ae6-59295b763d9f admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:09.840226 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfba08-f457-4b4b-9eb1-5916e8c2d037 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:09.840531 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfba08-f457-4b4b-9eb1-5916e8c2d037 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:09.840786 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfba08-f457-4b4b-9eb1-5916e8c2d037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:09.850746 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510450a-da21-4777-98ab-234417482d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:09.851632 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510450a-da21-4777-98ab-234417482d13 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:09.851946 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510450a-da21-4777-98ab-234417482d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:09.852223 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510450a-da21-4777-98ab-234417482d13 admin admin] PATH_INFO: `/v3/users/54e89668dd2f4bda9877cf539179b3ec` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:09.853494 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510450a-da21-4777-98ab-234417482d13 admin admin] RBAC: Authorizing `identity:get_user(user_id=54e89668dd2f4bda9877cf539179b3ec)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:09.855342 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510450a-da21-4777-98ab-234417482d13 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:09.861260 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 54/109] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:26:09 2021] GET /identity/v3/users/54e89668dd2f4bda9877cf539179b3ec => generated 247 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:09.867867 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510450a-da21-4777-98ab-234417482d13 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:09.868143 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-c5bfba08-f457-4b4b-9eb1-5916e8c2d037 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:09.870217 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c5bfba08-f457-4b4b-9eb1-5916e8c2d037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:09.878612 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 56/110] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:26:09.883756 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510450a-da21-4777-98ab-234417482d13 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:09.885089 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f3b63-bd76-46a5-bcc8-c1f474465be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:09.886003 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f3b63-bd76-46a5-bcc8-c1f474465be7 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:09.886359 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f3b63-bd76-46a5-bcc8-c1f474465be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:09.886712 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f3b63-bd76-46a5-bcc8-c1f474465be7 admin admin] PATH_INFO: `/v3/projects/098453151f33456db2f118ed4fac105c` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:09.888010 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f3b63-bd76-46a5-bcc8-c1f474465be7 admin admin] RBAC: Authorizing `identity:get_project(project_id=098453151f33456db2f118ed4fac105c)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:09.890191 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f3b63-bd76-46a5-bcc8-c1f474465be7 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:09.891985 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 55/111] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:09 2021] GET /identity/v3/projects/098453151f33456db2f118ed4fac105c => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:09.898334 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfba08-f457-4b4b-9eb1-5916e8c2d037 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:09.906045 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f3b63-bd76-46a5-bcc8-c1f474465be7 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:09.908622 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfba08-f457-4b4b-9eb1-5916e8c2d037 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:09.914344 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dc9c6-d266-46f5-8384-e1ca469f3555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:09.916084 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dc9c6-d266-46f5-8384-e1ca469f3555 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:09.916383 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dc9c6-d266-46f5-8384-e1ca469f3555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:09.916668 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dc9c6-d266-46f5-8384-e1ca469f3555 admin admin] PATH_INFO: `/v3/projects/098453151f33456db2f118ed4fac105c/users/54e89668dd2f4bda9877cf539179b3ec/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:09.918271 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f3b63-bd76-46a5-bcc8-c1f474465be7 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:09.924590 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba23d5-b2a2-4117-b260-1865ae55173c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:09.924819 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba23d5-b2a2-4117-b260-1865ae55173c admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:09.925127 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba23d5-b2a2-4117-b260-1865ae55173c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:09.925227 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba23d5-b2a2-4117-b260-1865ae55173c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:09.925991 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dc9c6-d266-46f5-8384-e1ca469f3555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098453151f33456db2f118ed4fac105c, user_id=54e89668dd2f4bda9877cf539179b3ec, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:09.928850 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dc9c6-d266-46f5-8384-e1ca469f3555 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:09.941377 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba23d5-b2a2-4117-b260-1865ae55173c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:09.951294 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-feba23d5-b2a2-4117-b260-1865ae55173c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 03:26:09.952763 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 56/112] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Oct 15 03:26:09 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:09.955556 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 57/113] 10.222.0.30 () {58 vars in 1460 bytes} [Fri Oct 15 03:26:09 2021] PUT /identity/v3/projects/098453151f33456db2f118ed4fac105c/users/54e89668dd2f4bda9877cf539179b3ec/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:26:09.959434 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba23d5-b2a2-4117-b260-1865ae55173c admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:09.970346 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba23d5-b2a2-4117-b260-1865ae55173c admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:10.055858 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b5f8b-b5f4-4200-9ddd-1aa08c9438a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:10.057044 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b5f8b-b5f4-4200-9ddd-1aa08c9438a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:10.057327 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b5f8b-b5f4-4200-9ddd-1aa08c9438a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:10.057601 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b5f8b-b5f4-4200-9ddd-1aa08c9438a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:10.058433 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b5f8b-b5f4-4200-9ddd-1aa08c9438a2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:10.058741 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b5f8b-b5f4-4200-9ddd-1aa08c9438a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:10.060607 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b5f8b-b5f4-4200-9ddd-1aa08c9438a2 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:10.069680 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 57/114] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:09 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:10.085680 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dc9c6-d266-46f5-8384-e1ca469f3555 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:10.096058 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dc9c6-d266-46f5-8384-e1ca469f3555 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:10.100929 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7438ff8-3f7c-4e80-8f32-eb3b62f25a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:10.101845 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7438ff8-3f7c-4e80-8f32-eb3b62f25a76 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:10.102135 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7438ff8-3f7c-4e80-8f32-eb3b62f25a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:10.102462 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7438ff8-3f7c-4e80-8f32-eb3b62f25a76 admin admin] PATH_INFO: `/v3/users/0189ce49a9fd434894ac7b5f5b829fa6` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:10.104468 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7438ff8-3f7c-4e80-8f32-eb3b62f25a76 admin admin] RBAC: Authorizing `identity:get_user(user_id=0189ce49a9fd434894ac7b5f5b829fa6)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:10.106838 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7438ff8-3f7c-4e80-8f32-eb3b62f25a76 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:10.108669 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 58/115] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:26:10 2021] GET /identity/v3/users/0189ce49a9fd434894ac7b5f5b829fa6 => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:10.114888 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b5f8b-b5f4-4200-9ddd-1aa08c9438a2 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:10.126294 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b5f8b-b5f4-4200-9ddd-1aa08c9438a2 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:10.127697 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a6646-87c4-4d7e-9a3e-c9e7ef233312 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:10.128005 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a6646-87c4-4d7e-9a3e-c9e7ef233312 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:10.128284 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a6646-87c4-4d7e-9a3e-c9e7ef233312 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:10.130307 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 59/116] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:10.131467 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c6846-9869-46e8-80d6-8a2655ec3ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:10.132451 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c6846-9869-46e8-80d6-8a2655ec3ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:10.132783 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c6846-9869-46e8-80d6-8a2655ec3ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:10.133056 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c6846-9869-46e8-80d6-8a2655ec3ee7 admin admin] PATH_INFO: `/v3/projects/098453151f33456db2f118ed4fac105c` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:10.134433 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c6846-9869-46e8-80d6-8a2655ec3ee7 admin admin] RBAC: Authorizing `identity:get_project(project_id=098453151f33456db2f118ed4fac105c)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:10.136361 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee3848-0168-442d-ad56-ea1dd590e47f None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:10.136650 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee3848-0168-442d-ad56-ea1dd590e47f None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:10.136934 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee3848-0168-442d-ad56-ea1dd590e47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:10.137030 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c6846-9869-46e8-80d6-8a2655ec3ee7 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:10.138883 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 58/117] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:10 2021] GET /identity/v3/projects/098453151f33456db2f118ed4fac105c => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:10.160121 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c6846-9869-46e8-80d6-8a2655ec3ee7 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:10.173757 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c6846-9869-46e8-80d6-8a2655ec3ee7 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:10.175484 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-e6ee3848-0168-442d-ad56-ea1dd590e47f None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:10.177689 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e6ee3848-0168-442d-ad56-ea1dd590e47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:10.184322 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ceef1-52c5-4ca4-ba76-069445fa5bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:10.185734 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ceef1-52c5-4ca4-ba76-069445fa5bd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:10.186025 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ceef1-52c5-4ca4-ba76-069445fa5bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:10.186305 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ceef1-52c5-4ca4-ba76-069445fa5bd8 admin admin] PATH_INFO: `/v3/projects/098453151f33456db2f118ed4fac105c/users/0189ce49a9fd434894ac7b5f5b829fa6/roles/3f958dcb5c7c413a9d9edd4ed05d20a2` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:10.191265 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ceef1-52c5-4ca4-ba76-069445fa5bd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098453151f33456db2f118ed4fac105c, user_id=0189ce49a9fd434894ac7b5f5b829fa6, role_id=3f958dcb5c7c413a9d9edd4ed05d20a2)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:10.193302 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING py.warnings [None req-e99ceef1-52c5-4ca4-ba76-069445fa5bd8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:26:10.193302 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: warnings.warn(msg) Oct 15 03:26:10.193302 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: Oct 15 03:26:10.196264 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 60/118] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:26:10.197892 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ceef1-52c5-4ca4-ba76-069445fa5bd8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:10.220812 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee3848-0168-442d-ad56-ea1dd590e47f None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:10.226040 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 59/119] 10.222.0.30 () {58 vars in 1460 bytes} [Fri Oct 15 03:26:10 2021] PUT /identity/v3/projects/098453151f33456db2f118ed4fac105c/users/0189ce49a9fd434894ac7b5f5b829fa6/roles/3f958dcb5c7c413a9d9edd4ed05d20a2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:26:10.234590 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee3848-0168-442d-ad56-ea1dd590e47f None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:10.303311 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8c77e-8596-4a21-a756-6d34a35fa8be None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:10.303600 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8c77e-8596-4a21-a756-6d34a35fa8be None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:10.303921 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8c77e-8596-4a21-a756-6d34a35fa8be None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:10.306676 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 60/120] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:10.312209 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b7739-4f7b-436a-b49a-21a02cbdb066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:10.312961 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdca3a5-8a16-4612-9aae-b5e352b14cb8 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:10.313065 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b7739-4f7b-436a-b49a-21a02cbdb066 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:10.313253 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdca3a5-8a16-4612-9aae-b5e352b14cb8 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:10.313346 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b7739-4f7b-436a-b49a-21a02cbdb066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:10.313529 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdca3a5-8a16-4612-9aae-b5e352b14cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:10.313628 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b7739-4f7b-436a-b49a-21a02cbdb066 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:10.328576 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b7739-4f7b-436a-b49a-21a02cbdb066 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:10.336508 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-b84b7739-4f7b-436a-b49a-21a02cbdb066 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 03:26:10.338268 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 61/121] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:10 2021] GET /identity/v3/roles/member => generated 84 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:10.339221 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-8fdca3a5-8a16-4612-9aae-b5e352b14cb8 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:10.343833 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-8fdca3a5-8a16-4612-9aae-b5e352b14cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:10.345460 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b7739-4f7b-436a-b49a-21a02cbdb066 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:10.352258 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 61/122] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:10.360104 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b7739-4f7b-436a-b49a-21a02cbdb066 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:10.365280 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccf21c-87ad-4607-9e63-110222b4d9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:10.366225 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccf21c-87ad-4607-9e63-110222b4d9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:10.366755 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccf21c-87ad-4607-9e63-110222b4d9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:10.367232 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccf21c-87ad-4607-9e63-110222b4d9d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:10.368857 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccf21c-87ad-4607-9e63-110222b4d9d6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:10.369425 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccf21c-87ad-4607-9e63-110222b4d9d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:10.371417 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccf21c-87ad-4607-9e63-110222b4d9d6 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:10.382585 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdca3a5-8a16-4612-9aae-b5e352b14cb8 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:10.384611 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 62/123] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Oct 15 03:26:10 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:10.392833 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccf21c-87ad-4607-9e63-110222b4d9d6 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:10.393543 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdca3a5-8a16-4612-9aae-b5e352b14cb8 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:10.398253 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62093a7a-35ed-4db9-8697-6b2cfd900e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:10.399111 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62093a7a-35ed-4db9-8697-6b2cfd900e45 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:10.399762 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62093a7a-35ed-4db9-8697-6b2cfd900e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:10.400093 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62093a7a-35ed-4db9-8697-6b2cfd900e45 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:10.402035 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62093a7a-35ed-4db9-8697-6b2cfd900e45 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:10.404240 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62093a7a-35ed-4db9-8697-6b2cfd900e45 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:10.405830 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccf21c-87ad-4607-9e63-110222b4d9d6 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:10.406052 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 62/124] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:10 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:10.411320 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe6baf-8ffd-49bf-ac50-8993ab2cb3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:10.412249 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62093a7a-35ed-4db9-8697-6b2cfd900e45 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:10.412981 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe6baf-8ffd-49bf-ac50-8993ab2cb3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:10.413470 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe6baf-8ffd-49bf-ac50-8993ab2cb3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:10.413949 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe6baf-8ffd-49bf-ac50-8993ab2cb3a7 admin admin] PATH_INFO: `/v3/users/0189ce49a9fd434894ac7b5f5b829fa6` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:10.415507 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe6baf-8ffd-49bf-ac50-8993ab2cb3a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=0189ce49a9fd434894ac7b5f5b829fa6)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:10.417984 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe6baf-8ffd-49bf-ac50-8993ab2cb3a7 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:10.420081 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 63/125] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:26:10 2021] GET /identity/v3/users/0189ce49a9fd434894ac7b5f5b829fa6 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:10.423130 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62093a7a-35ed-4db9-8697-6b2cfd900e45 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:10.427838 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe6baf-8ffd-49bf-ac50-8993ab2cb3a7 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:10.436386 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461434f-1260-46f6-8d87-dcf2b69ff054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:10.437336 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461434f-1260-46f6-8d87-dcf2b69ff054 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:10.437810 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461434f-1260-46f6-8d87-dcf2b69ff054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:10.438228 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461434f-1260-46f6-8d87-dcf2b69ff054 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:10.439190 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461434f-1260-46f6-8d87-dcf2b69ff054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:10.441052 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING py.warnings [None req-9461434f-1260-46f6-8d87-dcf2b69ff054 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:26:10.441052 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: warnings.warn(msg) Oct 15 03:26:10.441052 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: Oct 15 03:26:10.445909 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461434f-1260-46f6-8d87-dcf2b69ff054 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:10.454291 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe6baf-8ffd-49bf-ac50-8993ab2cb3a7 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:10.466647 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82407311-4b14-4b39-9e86-1254a74223c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:10.467836 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82407311-4b14-4b39-9e86-1254a74223c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:10.468316 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82407311-4b14-4b39-9e86-1254a74223c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:10.468734 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82407311-4b14-4b39-9e86-1254a74223c3 admin admin] PATH_INFO: `/v3/projects/8920535d049b4db8ad55269dd481924a` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:10.471593 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82407311-4b14-4b39-9e86-1254a74223c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=8920535d049b4db8ad55269dd481924a)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:10.474788 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82407311-4b14-4b39-9e86-1254a74223c3 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:10.479876 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 64/126] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:10 2021] GET /identity/v3/projects/8920535d049b4db8ad55269dd481924a => generated 312 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:10.486722 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82407311-4b14-4b39-9e86-1254a74223c3 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:10.498648 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82407311-4b14-4b39-9e86-1254a74223c3 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:10.501124 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 63/127] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Oct 15 03:26:10 2021] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:26:10.506369 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab576482-ad65-4266-8feb-44528f00ca5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:10.507730 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab576482-ad65-4266-8feb-44528f00ca5c admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:10.508202 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab576482-ad65-4266-8feb-44528f00ca5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:10.508683 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab576482-ad65-4266-8feb-44528f00ca5c admin admin] PATH_INFO: `/v3/projects/8920535d049b4db8ad55269dd481924a/users/0189ce49a9fd434894ac7b5f5b829fa6/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:10.511978 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab576482-ad65-4266-8feb-44528f00ca5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8920535d049b4db8ad55269dd481924a, user_id=0189ce49a9fd434894ac7b5f5b829fa6, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:10.515394 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab576482-ad65-4266-8feb-44528f00ca5c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:10.535194 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 65/128] 10.222.0.30 () {58 vars in 1460 bytes} [Fri Oct 15 03:26:10 2021] PUT /identity/v3/projects/8920535d049b4db8ad55269dd481924a/users/0189ce49a9fd434894ac7b5f5b829fa6/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:26:12.359341 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d9884-9a7d-46a2-adec-eb1a839e8087 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:12.359914 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d9884-9a7d-46a2-adec-eb1a839e8087 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:12.359914 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d9884-9a7d-46a2-adec-eb1a839e8087 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:12.361816 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 64/129] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:12.367892 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a074d-3bb9-44aa-b483-573e44709083 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:12.368872 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a074d-3bb9-44aa-b483-573e44709083 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:12.369065 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a074d-3bb9-44aa-b483-573e44709083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:12.392731 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-154a074d-3bb9-44aa-b483-573e44709083 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:12.393931 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-154a074d-3bb9-44aa-b483-573e44709083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:12.466319 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 66/130] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:26:12.503839 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d9884-9a7d-46a2-adec-eb1a839e8087 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:12.521689 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d9884-9a7d-46a2-adec-eb1a839e8087 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:12.527016 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfce870-d507-4ecf-8510-0c2576e83f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:12.527837 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfce870-d507-4ecf-8510-0c2576e83f98 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:12.528123 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfce870-d507-4ecf-8510-0c2576e83f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:12.528399 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfce870-d507-4ecf-8510-0c2576e83f98 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:12.542349 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfce870-d507-4ecf-8510-0c2576e83f98 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:12.549175 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-ebfce870-d507-4ecf-8510-0c2576e83f98 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 03:26:12.550387 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 65/131] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:12 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:12.557356 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a074d-3bb9-44aa-b483-573e44709083 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:12.566329 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a074d-3bb9-44aa-b483-573e44709083 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:12.576044 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f4ef7-426a-4284-b854-4ab7118a2445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:12.576719 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f4ef7-426a-4284-b854-4ab7118a2445 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:12.577004 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f4ef7-426a-4284-b854-4ab7118a2445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:12.577284 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f4ef7-426a-4284-b854-4ab7118a2445 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:12.578052 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f4ef7-426a-4284-b854-4ab7118a2445 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:12.578364 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f4ef7-426a-4284-b854-4ab7118a2445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:12.580037 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f4ef7-426a-4284-b854-4ab7118a2445 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:12.591286 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 67/132] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Oct 15 03:26:12 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:12.597739 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfce870-d507-4ecf-8510-0c2576e83f98 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:12.609309 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfce870-d507-4ecf-8510-0c2576e83f98 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:12.617198 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0b2ad-c2c3-4272-99ad-5f3968aa8de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:12.618056 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0b2ad-c2c3-4272-99ad-5f3968aa8de5 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:12.618934 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0b2ad-c2c3-4272-99ad-5f3968aa8de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:12.619210 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0b2ad-c2c3-4272-99ad-5f3968aa8de5 admin admin] PATH_INFO: `/v3/users/0189ce49a9fd434894ac7b5f5b829fa6` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:12.620463 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0b2ad-c2c3-4272-99ad-5f3968aa8de5 admin admin] RBAC: Authorizing `identity:get_user(user_id=0189ce49a9fd434894ac7b5f5b829fa6)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:12.622635 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0b2ad-c2c3-4272-99ad-5f3968aa8de5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:12.624339 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 66/133] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:26:12 2021] GET /identity/v3/users/0189ce49a9fd434894ac7b5f5b829fa6 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:12.630509 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f4ef7-426a-4284-b854-4ab7118a2445 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:12.644628 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f4ef7-426a-4284-b854-4ab7118a2445 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:12.649169 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa3dd3-d6a6-4a9d-9b19-61323b201bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:12.650387 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa3dd3-d6a6-4a9d-9b19-61323b201bca admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:12.650672 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa3dd3-d6a6-4a9d-9b19-61323b201bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:12.650945 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa3dd3-d6a6-4a9d-9b19-61323b201bca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:12.663651 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa3dd3-d6a6-4a9d-9b19-61323b201bca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:12.666092 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa3dd3-d6a6-4a9d-9b19-61323b201bca admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:12.681516 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 68/134] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:12 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:12.687868 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0b2ad-c2c3-4272-99ad-5f3968aa8de5 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:12.698067 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0b2ad-c2c3-4272-99ad-5f3968aa8de5 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:12.702834 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54340506-8d85-46a0-b27c-e12ffa4f6e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:12.703729 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54340506-8d85-46a0-b27c-e12ffa4f6e93 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:12.703987 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54340506-8d85-46a0-b27c-e12ffa4f6e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:12.704264 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54340506-8d85-46a0-b27c-e12ffa4f6e93 admin admin] PATH_INFO: `/v3/projects/098453151f33456db2f118ed4fac105c` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:12.708455 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54340506-8d85-46a0-b27c-e12ffa4f6e93 admin admin] RBAC: Authorizing `identity:get_project(project_id=098453151f33456db2f118ed4fac105c)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:12.711056 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54340506-8d85-46a0-b27c-e12ffa4f6e93 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:12.712956 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 67/135] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:12 2021] GET /identity/v3/projects/098453151f33456db2f118ed4fac105c => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:12.719602 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa3dd3-d6a6-4a9d-9b19-61323b201bca admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:12.729876 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa3dd3-d6a6-4a9d-9b19-61323b201bca admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:12.737766 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc000c55-c759-4c9d-b2df-fc30fb63ed45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:12.738429 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc000c55-c759-4c9d-b2df-fc30fb63ed45 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:12.738780 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc000c55-c759-4c9d-b2df-fc30fb63ed45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:12.739061 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc000c55-c759-4c9d-b2df-fc30fb63ed45 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:12.739991 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc000c55-c759-4c9d-b2df-fc30fb63ed45 admin admin] RBAC: Adding query filter params (role.id=ee5acd2d5378499bb27dc24366041b42, scope.project.id=098453151f33456db2f118ed4fac105c, user.id=0189ce49a9fd434894ac7b5f5b829fa6) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:12.740308 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc000c55-c759-4c9d-b2df-fc30fb63ed45 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:12.742263 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc000c55-c759-4c9d-b2df-fc30fb63ed45 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:12.752847 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 69/136] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:12 2021] GET /identity/v3/role_assignments?user.id=0189ce49a9fd434894ac7b5f5b829fa6&scope.project.id=098453151f33456db2f118ed4fac105c&role.id=ee5acd2d5378499bb27dc24366041b42 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:13.120563 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b150f5-e093-4dbc-a332-14b405bbbf41 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:13.120891 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b150f5-e093-4dbc-a332-14b405bbbf41 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:13.121144 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b150f5-e093-4dbc-a332-14b405bbbf41 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:13.122929 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 68/137] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:13.131340 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f77a22-35f2-4aa6-87d7-3e6595d966ef None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:13.131735 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f77a22-35f2-4aa6-87d7-3e6595d966ef None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:13.131942 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f77a22-35f2-4aa6-87d7-3e6595d966ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:13.154982 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-e6f77a22-35f2-4aa6-87d7-3e6595d966ef None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:13.156240 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e6f77a22-35f2-4aa6-87d7-3e6595d966ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:13.168802 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 70/138] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:13.210918 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b150f5-e093-4dbc-a332-14b405bbbf41 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:13.228453 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b150f5-e093-4dbc-a332-14b405bbbf41 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:13.233083 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34454916-0812-4a15-9caf-c701bb79dbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:13.233882 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34454916-0812-4a15-9caf-c701bb79dbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:13.234231 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34454916-0812-4a15-9caf-c701bb79dbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:13.234514 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34454916-0812-4a15-9caf-c701bb79dbb5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:13.247103 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34454916-0812-4a15-9caf-c701bb79dbb5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:13.254493 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-34454916-0812-4a15-9caf-c701bb79dbb5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:26:13.255749 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 69/139] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:26:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:13.262831 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f77a22-35f2-4aa6-87d7-3e6595d966ef None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:13.272114 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f77a22-35f2-4aa6-87d7-3e6595d966ef None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:13.277382 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571876f0-5f6a-434c-928c-8c7a2c8ee208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:13.278060 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571876f0-5f6a-434c-928c-8c7a2c8ee208 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:13.278352 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571876f0-5f6a-434c-928c-8c7a2c8ee208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:13.278636 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571876f0-5f6a-434c-928c-8c7a2c8ee208 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:13.279407 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571876f0-5f6a-434c-928c-8c7a2c8ee208 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:13.279736 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571876f0-5f6a-434c-928c-8c7a2c8ee208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:13.281401 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571876f0-5f6a-434c-928c-8c7a2c8ee208 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:13.291072 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 71/140] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:13.297490 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34454916-0812-4a15-9caf-c701bb79dbb5 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:13.308209 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34454916-0812-4a15-9caf-c701bb79dbb5 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:13.312839 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d520da-f46f-4595-b696-0a50ed50b76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:13.313706 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d520da-f46f-4595-b696-0a50ed50b76e admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:13.314043 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d520da-f46f-4595-b696-0a50ed50b76e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:13.314332 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d520da-f46f-4595-b696-0a50ed50b76e admin admin] PATH_INFO: `/v3/users/54e89668dd2f4bda9877cf539179b3ec` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:13.315550 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d520da-f46f-4595-b696-0a50ed50b76e admin admin] RBAC: Authorizing `identity:get_user(user_id=54e89668dd2f4bda9877cf539179b3ec)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:13.317684 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d520da-f46f-4595-b696-0a50ed50b76e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:13.319372 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 70/141] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:26:13 2021] GET /identity/v3/users/54e89668dd2f4bda9877cf539179b3ec => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:13.325019 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961085ca-6ec8-473d-bbbe-480e42f10ebe None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:13.325314 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961085ca-6ec8-473d-bbbe-480e42f10ebe None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:13.325596 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961085ca-6ec8-473d-bbbe-480e42f10ebe None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:13.327387 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 72/142] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:13.328792 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f0666-5412-4508-b422-b5100b605db9 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:13.329080 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f0666-5412-4508-b422-b5100b605db9 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:13.329361 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f0666-5412-4508-b422-b5100b605db9 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:13.331382 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 71/143] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:13.334316 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d16342-a373-4fed-9f1c-aa62e62f4e02 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:13.334606 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d16342-a373-4fed-9f1c-aa62e62f4e02 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:13.334894 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d16342-a373-4fed-9f1c-aa62e62f4e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:13.340832 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84760b20-1a64-4eaa-9eff-8844ca90c058 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:13.341125 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84760b20-1a64-4eaa-9eff-8844ca90c058 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:13.341407 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84760b20-1a64-4eaa-9eff-8844ca90c058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:13.359592 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-d5d16342-a373-4fed-9f1c-aa62e62f4e02 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:13.360814 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d5d16342-a373-4fed-9f1c-aa62e62f4e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:13.369251 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-84760b20-1a64-4eaa-9eff-8844ca90c058 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:13.370453 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-84760b20-1a64-4eaa-9eff-8844ca90c058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:13.375094 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 73/144] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:13.379937 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d16342-a373-4fed-9f1c-aa62e62f4e02 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:13.382188 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 72/145] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:13.394138 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d16342-a373-4fed-9f1c-aa62e62f4e02 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:13.403381 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19385499-aa15-41ca-8a94-c1dcc93aedd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:13.404085 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19385499-aa15-41ca-8a94-c1dcc93aedd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:13.404375 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19385499-aa15-41ca-8a94-c1dcc93aedd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:13.404654 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19385499-aa15-41ca-8a94-c1dcc93aedd5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:13.419440 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19385499-aa15-41ca-8a94-c1dcc93aedd5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:13.421281 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19385499-aa15-41ca-8a94-c1dcc93aedd5 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:13.422124 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84760b20-1a64-4eaa-9eff-8844ca90c058 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:13.438173 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 74/146] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:13.438620 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84760b20-1a64-4eaa-9eff-8844ca90c058 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:13.439024 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19385499-aa15-41ca-8a94-c1dcc93aedd5 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:13.451568 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f92fc-84bd-43dc-82d6-535c83ed7504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:13.452726 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f92fc-84bd-43dc-82d6-535c83ed7504 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:13.452884 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19385499-aa15-41ca-8a94-c1dcc93aedd5 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:13.453336 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f92fc-84bd-43dc-82d6-535c83ed7504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:13.453791 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f92fc-84bd-43dc-82d6-535c83ed7504 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:13.467710 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20120a-ca79-41ac-a549-3803d1d3085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:13.467910 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20120a-ca79-41ac-a549-3803d1d3085f admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:13.469120 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20120a-ca79-41ac-a549-3803d1d3085f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:13.469120 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20120a-ca79-41ac-a549-3803d1d3085f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:13.480654 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f92fc-84bd-43dc-82d6-535c83ed7504 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:13.487815 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-8e3f92fc-84bd-43dc-82d6-535c83ed7504 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 03:26:13.489045 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 73/147] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Oct 15 03:26:13 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:13.489828 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f92fc-84bd-43dc-82d6-535c83ed7504 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:13.494585 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20120a-ca79-41ac-a549-3803d1d3085f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:13.501668 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-9e20120a-ca79-41ac-a549-3803d1d3085f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 03:26:13.502881 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 75/148] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:13 2021] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:13.503656 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20120a-ca79-41ac-a549-3803d1d3085f admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:13.514235 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f92fc-84bd-43dc-82d6-535c83ed7504 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:13.519210 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20120a-ca79-41ac-a549-3803d1d3085f admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:13.524191 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41664078-282d-4d7a-aad0-d5e54770d1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:13.525101 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41664078-282d-4d7a-aad0-d5e54770d1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:13.525381 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41664078-282d-4d7a-aad0-d5e54770d1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:13.525649 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41664078-282d-4d7a-aad0-d5e54770d1f2 admin admin] PATH_INFO: `/v3/projects/098453151f33456db2f118ed4fac105c` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:13.527213 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41664078-282d-4d7a-aad0-d5e54770d1f2 admin admin] RBAC: Authorizing `identity:get_project(project_id=098453151f33456db2f118ed4fac105c)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:13.529346 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41664078-282d-4d7a-aad0-d5e54770d1f2 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:13.531024 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 74/149] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:13 2021] GET /identity/v3/projects/098453151f33456db2f118ed4fac105c => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:13.531804 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41664078-282d-4d7a-aad0-d5e54770d1f2 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:13.533561 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fc9e0-81d8-40fd-9f22-d38febe78461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:13.534222 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fc9e0-81d8-40fd-9f22-d38febe78461 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:13.534500 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fc9e0-81d8-40fd-9f22-d38febe78461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:13.534764 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fc9e0-81d8-40fd-9f22-d38febe78461 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:13.535526 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fc9e0-81d8-40fd-9f22-d38febe78461 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:13.535854 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fc9e0-81d8-40fd-9f22-d38febe78461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:13.537457 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fc9e0-81d8-40fd-9f22-d38febe78461 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:13.554650 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41664078-282d-4d7a-aad0-d5e54770d1f2 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:13.555517 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 76/150] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:13 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:13.556914 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fc9e0-81d8-40fd-9f22-d38febe78461 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:13.569821 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb813682-1a38-4ca4-a003-68f418f90e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:13.570475 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb813682-1a38-4ca4-a003-68f418f90e3f admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:13.570759 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb813682-1a38-4ca4-a003-68f418f90e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:13.571035 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb813682-1a38-4ca4-a003-68f418f90e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:13.572583 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb813682-1a38-4ca4-a003-68f418f90e3f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:13.572888 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb813682-1a38-4ca4-a003-68f418f90e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:13.574518 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb813682-1a38-4ca4-a003-68f418f90e3f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:13.578890 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fc9e0-81d8-40fd-9f22-d38febe78461 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:13.593079 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 75/151] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Oct 15 03:26:13 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:13.593914 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb813682-1a38-4ca4-a003-68f418f90e3f admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:13.595756 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c97aec-99a8-4cb1-a69e-5c5d7f35cef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:13.596416 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c97aec-99a8-4cb1-a69e-5c5d7f35cef9 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:13.596697 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c97aec-99a8-4cb1-a69e-5c5d7f35cef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:13.596973 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c97aec-99a8-4cb1-a69e-5c5d7f35cef9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:13.597813 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c97aec-99a8-4cb1-a69e-5c5d7f35cef9 admin admin] RBAC: Adding query filter params (role.id=15ba70b0cba04962a6d0b80b50c07004, scope.project.id=098453151f33456db2f118ed4fac105c, user.id=54e89668dd2f4bda9877cf539179b3ec) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:13.598187 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c97aec-99a8-4cb1-a69e-5c5d7f35cef9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:13.600346 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c97aec-99a8-4cb1-a69e-5c5d7f35cef9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:13.617334 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 77/152] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:13 2021] GET /identity/v3/role_assignments?user.id=54e89668dd2f4bda9877cf539179b3ec&scope.project.id=098453151f33456db2f118ed4fac105c&role.id=15ba70b0cba04962a6d0b80b50c07004 => generated 608 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:13.618695 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c97aec-99a8-4cb1-a69e-5c5d7f35cef9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:13.626925 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb813682-1a38-4ca4-a003-68f418f90e3f admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:13.637404 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c97aec-99a8-4cb1-a69e-5c5d7f35cef9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:13.639550 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe64e16-fa60-4304-862a-c7ffeb92610d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:13.640456 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe64e16-fa60-4304-862a-c7ffeb92610d admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:13.640733 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe64e16-fa60-4304-862a-c7ffeb92610d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:13.641002 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe64e16-fa60-4304-862a-c7ffeb92610d admin admin] PATH_INFO: `/v3/users/0189ce49a9fd434894ac7b5f5b829fa6` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:13.642551 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe64e16-fa60-4304-862a-c7ffeb92610d admin admin] RBAC: Authorizing `identity:get_user(user_id=0189ce49a9fd434894ac7b5f5b829fa6)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:13.644902 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe64e16-fa60-4304-862a-c7ffeb92610d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:13.646584 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 76/153] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:26:13 2021] GET /identity/v3/users/0189ce49a9fd434894ac7b5f5b829fa6 => generated 275 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:13.653730 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe64e16-fa60-4304-862a-c7ffeb92610d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:13.660897 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110acb45-e2e1-4e06-917c-79c2058299dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:13.661776 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110acb45-e2e1-4e06-917c-79c2058299dc admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:13.662062 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110acb45-e2e1-4e06-917c-79c2058299dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:13.662333 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110acb45-e2e1-4e06-917c-79c2058299dc admin admin] PATH_INFO: `/v3/users/0189ce49a9fd434894ac7b5f5b829fa6` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:13.664658 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110acb45-e2e1-4e06-917c-79c2058299dc admin admin] RBAC: Authorizing `identity:get_user(user_id=0189ce49a9fd434894ac7b5f5b829fa6)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:13.667428 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110acb45-e2e1-4e06-917c-79c2058299dc admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:13.674799 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 78/154] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:26:13 2021] GET /identity/v3/users/0189ce49a9fd434894ac7b5f5b829fa6 => generated 275 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:13.677392 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe64e16-fa60-4304-862a-c7ffeb92610d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:13.684993 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7100356-a88b-4af9-b428-449a32b09173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:13.685651 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7100356-a88b-4af9-b428-449a32b09173 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:13.685932 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7100356-a88b-4af9-b428-449a32b09173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:13.686209 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7100356-a88b-4af9-b428-449a32b09173 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:13.694301 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110acb45-e2e1-4e06-917c-79c2058299dc admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:13.711060 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110acb45-e2e1-4e06-917c-79c2058299dc admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:13.713251 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7100356-a88b-4af9-b428-449a32b09173 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:13.715056 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7100356-a88b-4af9-b428-449a32b09173 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:13.723256 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b28af-b63a-4df0-9995-96373f731ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:13.728088 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b28af-b63a-4df0-9995-96373f731ffb admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:13.728398 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b28af-b63a-4df0-9995-96373f731ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:13.728685 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b28af-b63a-4df0-9995-96373f731ffb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:13.740536 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 77/155] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:13.745655 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b28af-b63a-4df0-9995-96373f731ffb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:13.747473 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b28af-b63a-4df0-9995-96373f731ffb admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:13.752587 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7100356-a88b-4af9-b428-449a32b09173 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:13.764365 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 79/156] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:26:13.767164 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7100356-a88b-4af9-b428-449a32b09173 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:13.770716 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b28af-b63a-4df0-9995-96373f731ffb admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:13.772605 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206edacf-7999-475d-96cb-1486e721443e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:13.773696 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206edacf-7999-475d-96cb-1486e721443e admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:13.774195 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206edacf-7999-475d-96cb-1486e721443e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:13.775491 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206edacf-7999-475d-96cb-1486e721443e admin admin] PATH_INFO: `/v3/projects/098453151f33456db2f118ed4fac105c` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:13.780730 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206edacf-7999-475d-96cb-1486e721443e admin admin] RBAC: Authorizing `identity:get_project(project_id=098453151f33456db2f118ed4fac105c)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:13.783542 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206edacf-7999-475d-96cb-1486e721443e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:13.785547 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b28af-b63a-4df0-9995-96373f731ffb admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:13.786013 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 78/157] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:13 2021] GET /identity/v3/projects/098453151f33456db2f118ed4fac105c => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:13.792935 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206edacf-7999-475d-96cb-1486e721443e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:13.801698 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1c2ba-4ca6-4398-8ae4-d83521893ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:13.802568 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1c2ba-4ca6-4398-8ae4-d83521893ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:13.802847 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1c2ba-4ca6-4398-8ae4-d83521893ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:13.803119 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1c2ba-4ca6-4398-8ae4-d83521893ca7 admin admin] PATH_INFO: `/v3/projects/8920535d049b4db8ad55269dd481924a` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:13.804900 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206edacf-7999-475d-96cb-1486e721443e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:13.811766 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1c2ba-4ca6-4398-8ae4-d83521893ca7 admin admin] RBAC: Authorizing `identity:get_project(project_id=8920535d049b4db8ad55269dd481924a)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:13.811766 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1c2ba-4ca6-4398-8ae4-d83521893ca7 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:13.812911 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 80/158] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:13 2021] GET /identity/v3/projects/8920535d049b4db8ad55269dd481924a => generated 312 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:13.815429 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e6b6b-46a7-4166-811c-f8127b111808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:13.816375 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e6b6b-46a7-4166-811c-f8127b111808 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:13.816859 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e6b6b-46a7-4166-811c-f8127b111808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:13.817424 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e6b6b-46a7-4166-811c-f8127b111808 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:13.818572 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e6b6b-46a7-4166-811c-f8127b111808 admin admin] RBAC: Adding query filter params (role.id=3f958dcb5c7c413a9d9edd4ed05d20a2, scope.project.id=098453151f33456db2f118ed4fac105c, user.id=0189ce49a9fd434894ac7b5f5b829fa6) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:13.819127 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e6b6b-46a7-4166-811c-f8127b111808 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:13.819392 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1c2ba-4ca6-4398-8ae4-d83521893ca7 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:13.822528 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e6b6b-46a7-4166-811c-f8127b111808 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:13.831005 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 79/159] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:13 2021] GET /identity/v3/role_assignments?user.id=0189ce49a9fd434894ac7b5f5b829fa6&scope.project.id=098453151f33456db2f118ed4fac105c&role.id=3f958dcb5c7c413a9d9edd4ed05d20a2 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:13.846449 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1c2ba-4ca6-4398-8ae4-d83521893ca7 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:13.864512 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef79ae-7543-4958-8194-f7ff8023b853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:13.865202 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef79ae-7543-4958-8194-f7ff8023b853 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:13.865478 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef79ae-7543-4958-8194-f7ff8023b853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:13.865755 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef79ae-7543-4958-8194-f7ff8023b853 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:13.866612 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef79ae-7543-4958-8194-f7ff8023b853 admin admin] RBAC: Adding query filter params (role.id=ee5acd2d5378499bb27dc24366041b42, scope.project.id=8920535d049b4db8ad55269dd481924a, user.id=0189ce49a9fd434894ac7b5f5b829fa6) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:13.866927 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef79ae-7543-4958-8194-f7ff8023b853 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:13.868932 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef79ae-7543-4958-8194-f7ff8023b853 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:13.875847 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 81/160] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:13 2021] GET /identity/v3/role_assignments?user.id=0189ce49a9fd434894ac7b5f5b829fa6&scope.project.id=8920535d049b4db8ad55269dd481924a&role.id=ee5acd2d5378499bb27dc24366041b42 => generated 608 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:15.199878 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f6bfc-b230-4f61-8f93-6cc1e693a0dc None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.200990 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f6bfc-b230-4f61-8f93-6cc1e693a0dc None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.201493 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f6bfc-b230-4f61-8f93-6cc1e693a0dc None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.203611 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 80/161] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:15.210243 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c189ff-2ac6-47a0-93f0-a12627955a97 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.210746 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c189ff-2ac6-47a0-93f0-a12627955a97 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.210848 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c189ff-2ac6-47a0-93f0-a12627955a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.230078 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-63c189ff-2ac6-47a0-93f0-a12627955a97 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:15.231262 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-63c189ff-2ac6-47a0-93f0-a12627955a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:15.239032 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 82/162] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:15.265038 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f6bfc-b230-4f61-8f93-6cc1e693a0dc None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:15.277270 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f6bfc-b230-4f61-8f93-6cc1e693a0dc None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:15.281978 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf46bd-fc1c-498c-aa60-0876213fc5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:15.282757 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf46bd-fc1c-498c-aa60-0876213fc5dd admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.283031 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf46bd-fc1c-498c-aa60-0876213fc5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.283301 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf46bd-fc1c-498c-aa60-0876213fc5dd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.294472 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf46bd-fc1c-498c-aa60-0876213fc5dd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:15.301272 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-59bf46bd-fc1c-498c-aa60-0876213fc5dd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 03:26:15.302762 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 81/163] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:15 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:15.309745 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c189ff-2ac6-47a0-93f0-a12627955a97 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:15.318682 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c189ff-2ac6-47a0-93f0-a12627955a97 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:15.323166 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a622392-dde2-42b5-b1df-93d459b967df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:15.324110 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a622392-dde2-42b5-b1df-93d459b967df admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.324391 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a622392-dde2-42b5-b1df-93d459b967df admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.324661 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a622392-dde2-42b5-b1df-93d459b967df admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.325417 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a622392-dde2-42b5-b1df-93d459b967df admin admin] RBAC: Adding query filter params (name=member) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:15.325716 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a622392-dde2-42b5-b1df-93d459b967df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:15.327325 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a622392-dde2-42b5-b1df-93d459b967df admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:15.334128 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715d177-53a6-42b3-883a-d853b2dd93c9 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.334450 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715d177-53a6-42b3-883a-d853b2dd93c9 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.334668 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715d177-53a6-42b3-883a-d853b2dd93c9 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.336466 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 82/164] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:26:15.336741 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 83/165] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Oct 15 03:26:15 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:15.342519 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fe07a-72e2-4151-9729-7fc332379753 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.342802 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fe07a-72e2-4151-9729-7fc332379753 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.343079 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fe07a-72e2-4151-9729-7fc332379753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.344679 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a622392-dde2-42b5-b1df-93d459b967df admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:15.359425 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a622392-dde2-42b5-b1df-93d459b967df admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:15.362549 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-907fe07a-72e2-4151-9729-7fc332379753 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:15.364127 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-907fe07a-72e2-4151-9729-7fc332379753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:15.365995 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da83e49-954c-45cf-bb41-59610dee743e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:15.367541 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da83e49-954c-45cf-bb41-59610dee743e admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.367858 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da83e49-954c-45cf-bb41-59610dee743e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.368796 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da83e49-954c-45cf-bb41-59610dee743e admin admin] PATH_INFO: `/v3/users/18c8349d65bc47af85c514f69b5678ad` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.374408 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 83/166] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:15.386549 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da83e49-954c-45cf-bb41-59610dee743e admin admin] RBAC: Authorizing `identity:get_user(user_id=18c8349d65bc47af85c514f69b5678ad)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:15.388761 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da83e49-954c-45cf-bb41-59610dee743e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:15.390625 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 84/167] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:26:15 2021] GET /identity/v3/users/18c8349d65bc47af85c514f69b5678ad => generated 283 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:15.396552 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fe07a-72e2-4151-9729-7fc332379753 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:15.400775 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da83e49-954c-45cf-bb41-59610dee743e admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:15.406289 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fe07a-72e2-4151-9729-7fc332379753 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:15.411723 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3d49f-f2cc-453a-9bd8-a580874adc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:15.412003 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da83e49-954c-45cf-bb41-59610dee743e admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:15.412373 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3d49f-f2cc-453a-9bd8-a580874adc3e admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.412655 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3d49f-f2cc-453a-9bd8-a580874adc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.412987 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3d49f-f2cc-453a-9bd8-a580874adc3e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.417512 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb28b4-7786-4ce2-b2cd-496aed34387b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:15.418440 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb28b4-7786-4ce2-b2cd-496aed34387b admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.419049 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb28b4-7786-4ce2-b2cd-496aed34387b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.419489 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb28b4-7786-4ce2-b2cd-496aed34387b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.422620 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3d49f-f2cc-453a-9bd8-a580874adc3e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:15.424526 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3d49f-f2cc-453a-9bd8-a580874adc3e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:15.431464 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb28b4-7786-4ce2-b2cd-496aed34387b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:15.435422 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 84/168] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:15 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:15.438970 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-0ebb28b4-7786-4ce2-b2cd-496aed34387b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:26:15.440502 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 85/169] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:26:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:15.445624 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3d49f-f2cc-453a-9bd8-a580874adc3e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:15.447232 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb28b4-7786-4ce2-b2cd-496aed34387b admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:15.451547 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3d49f-f2cc-453a-9bd8-a580874adc3e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:15.456570 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb28b4-7786-4ce2-b2cd-496aed34387b admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:15.457386 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f56c10-1cb0-4e63-83c2-cb33e569d7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:15.458480 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f56c10-1cb0-4e63-83c2-cb33e569d7de admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.458900 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f56c10-1cb0-4e63-83c2-cb33e569d7de admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.459323 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f56c10-1cb0-4e63-83c2-cb33e569d7de admin admin] PATH_INFO: `/v3/projects/984f06ad9e80456fb94208662a6d8477` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.460881 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f56c10-1cb0-4e63-83c2-cb33e569d7de admin admin] RBAC: Authorizing `identity:get_project(project_id=984f06ad9e80456fb94208662a6d8477)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:15.460993 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750efce0-f60b-4a97-a0c3-338bcab9e5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:15.461614 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750efce0-f60b-4a97-a0c3-338bcab9e5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.461955 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750efce0-f60b-4a97-a0c3-338bcab9e5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.462791 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750efce0-f60b-4a97-a0c3-338bcab9e5a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.463545 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750efce0-f60b-4a97-a0c3-338bcab9e5a8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:15.463928 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750efce0-f60b-4a97-a0c3-338bcab9e5a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:15.464573 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f56c10-1cb0-4e63-83c2-cb33e569d7de admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:15.465674 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750efce0-f60b-4a97-a0c3-338bcab9e5a8 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:15.466557 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 85/170] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:15 2021] GET /identity/v3/projects/984f06ad9e80456fb94208662a6d8477 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:15.473603 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f56c10-1cb0-4e63-83c2-cb33e569d7de admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:15.481210 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 86/171] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:15.485077 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f56c10-1cb0-4e63-83c2-cb33e569d7de admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:15.487279 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750efce0-f60b-4a97-a0c3-338bcab9e5a8 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:15.490299 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec20a33-9891-4b11-9a5d-3f550a5c7723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:15.491117 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec20a33-9891-4b11-9a5d-3f550a5c7723 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.491540 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec20a33-9891-4b11-9a5d-3f550a5c7723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.491992 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec20a33-9891-4b11-9a5d-3f550a5c7723 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.493715 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec20a33-9891-4b11-9a5d-3f550a5c7723 admin admin] RBAC: Adding query filter params (role.id=ee5acd2d5378499bb27dc24366041b42, scope.project.id=984f06ad9e80456fb94208662a6d8477, user.id=18c8349d65bc47af85c514f69b5678ad) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:15.494727 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec20a33-9891-4b11-9a5d-3f550a5c7723 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:15.497054 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec20a33-9891-4b11-9a5d-3f550a5c7723 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:15.497702 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750efce0-f60b-4a97-a0c3-338bcab9e5a8 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:15.502169 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d96d2c-9356-4498-a50e-103985f42ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:15.503053 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d96d2c-9356-4498-a50e-103985f42ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.503374 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d96d2c-9356-4498-a50e-103985f42ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.503654 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d96d2c-9356-4498-a50e-103985f42ec7 admin admin] PATH_INFO: `/v3/users/54e89668dd2f4bda9877cf539179b3ec` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.504215 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 86/172] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:15 2021] GET /identity/v3/role_assignments?user.id=18c8349d65bc47af85c514f69b5678ad&scope.project.id=984f06ad9e80456fb94208662a6d8477&role.id=ee5acd2d5378499bb27dc24366041b42 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:15.511760 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d96d2c-9356-4498-a50e-103985f42ec7 admin admin] RBAC: Authorizing `identity:get_user(user_id=54e89668dd2f4bda9877cf539179b3ec)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:15.511760 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d96d2c-9356-4498-a50e-103985f42ec7 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:15.511760 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 87/173] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:26:15 2021] GET /identity/v3/users/54e89668dd2f4bda9877cf539179b3ec => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:15.515359 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec20a33-9891-4b11-9a5d-3f550a5c7723 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:15.534495 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec20a33-9891-4b11-9a5d-3f550a5c7723 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:15.539134 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadbfec-b301-4ee0-9855-8365446aaa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:15.539896 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadbfec-b301-4ee0-9855-8365446aaa92 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.540837 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadbfec-b301-4ee0-9855-8365446aaa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.541112 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadbfec-b301-4ee0-9855-8365446aaa92 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.550439 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadbfec-b301-4ee0-9855-8365446aaa92 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:15.552340 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadbfec-b301-4ee0-9855-8365446aaa92 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:15.563129 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 87/174] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:15 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:15.569595 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d96d2c-9356-4498-a50e-103985f42ec7 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:15.580507 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d96d2c-9356-4498-a50e-103985f42ec7 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:15.585094 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce4ad8-37e4-4880-b28c-068f079718a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:15.586027 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce4ad8-37e4-4880-b28c-068f079718a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.586355 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce4ad8-37e4-4880-b28c-068f079718a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.586634 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce4ad8-37e4-4880-b28c-068f079718a5 admin admin] PATH_INFO: `/v3/projects/984f06ad9e80456fb94208662a6d8477` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.588631 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce4ad8-37e4-4880-b28c-068f079718a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=984f06ad9e80456fb94208662a6d8477)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:15.593736 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce4ad8-37e4-4880-b28c-068f079718a5 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:15.597121 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 88/175] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:15 2021] GET /identity/v3/projects/984f06ad9e80456fb94208662a6d8477 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:15.604721 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadbfec-b301-4ee0-9855-8365446aaa92 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:15.614605 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadbfec-b301-4ee0-9855-8365446aaa92 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:15.619968 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ac772-269c-4e00-be43-02ac31dfbdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:15.620827 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ac772-269c-4e00-be43-02ac31dfbdb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.621114 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ac772-269c-4e00-be43-02ac31dfbdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.621383 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ac772-269c-4e00-be43-02ac31dfbdb1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.622323 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ac772-269c-4e00-be43-02ac31dfbdb1 admin admin] RBAC: Adding query filter params (role.id=15ba70b0cba04962a6d0b80b50c07004, scope.project.id=984f06ad9e80456fb94208662a6d8477, user.id=54e89668dd2f4bda9877cf539179b3ec) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:15.622684 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ac772-269c-4e00-be43-02ac31dfbdb1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:15.624764 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ac772-269c-4e00-be43-02ac31dfbdb1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:15.631994 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 88/176] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:15 2021] GET /identity/v3/role_assignments?user.id=54e89668dd2f4bda9877cf539179b3ec&scope.project.id=984f06ad9e80456fb94208662a6d8477&role.id=15ba70b0cba04962a6d0b80b50c07004 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:15.778204 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a193795-7f74-4ac3-a0c9-b6a7d3463f29 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.778487 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a193795-7f74-4ac3-a0c9-b6a7d3463f29 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.778768 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a193795-7f74-4ac3-a0c9-b6a7d3463f29 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.780609 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 89/177] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:15.787070 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb435798-b9e8-4e7b-9741-6da1533f9660 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.787352 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb435798-b9e8-4e7b-9741-6da1533f9660 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.787634 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb435798-b9e8-4e7b-9741-6da1533f9660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.809681 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-eb435798-b9e8-4e7b-9741-6da1533f9660 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:15.811266 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-eb435798-b9e8-4e7b-9741-6da1533f9660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:15.822210 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc874102-f0eb-455b-8765-83abcbb401b1 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.822530 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc874102-f0eb-455b-8765-83abcbb401b1 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.822764 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc874102-f0eb-455b-8765-83abcbb401b1 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.824787 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 90/179] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:15.824898 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 89/179] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:15.830972 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0711a-04f4-4b98-b6b3-9d998d062bee None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.831248 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0711a-04f4-4b98-b6b3-9d998d062bee None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.831526 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0711a-04f4-4b98-b6b3-9d998d062bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.850384 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-56c0711a-04f4-4b98-b6b3-9d998d062bee None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:15.851307 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb435798-b9e8-4e7b-9741-6da1533f9660 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:15.852939 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-56c0711a-04f4-4b98-b6b3-9d998d062bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:15.862675 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 91/180] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:15.862840 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb435798-b9e8-4e7b-9741-6da1533f9660 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:15.869177 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1df5d4-d696-486f-9724-264169a04522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:15.869984 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1df5d4-d696-486f-9724-264169a04522 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.870268 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1df5d4-d696-486f-9724-264169a04522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.870546 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1df5d4-d696-486f-9724-264169a04522 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.887372 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0711a-04f4-4b98-b6b3-9d998d062bee None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:15.888607 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1df5d4-d696-486f-9724-264169a04522 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:15.895905 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-5b1df5d4-d696-486f-9724-264169a04522 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 03:26:15.896282 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0711a-04f4-4b98-b6b3-9d998d062bee None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:15.897261 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 90/181] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Oct 15 03:26:15 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:15.904081 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1df5d4-d696-486f-9724-264169a04522 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:15.905575 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775dea1-9ce2-40b3-a557-354e20afe5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:15.906464 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775dea1-9ce2-40b3-a557-354e20afe5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.906752 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775dea1-9ce2-40b3-a557-354e20afe5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.907033 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775dea1-9ce2-40b3-a557-354e20afe5a5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.908335 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775dea1-9ce2-40b3-a557-354e20afe5a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:15.910118 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775dea1-9ce2-40b3-a557-354e20afe5a5 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:15.911843 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 92/182] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:15 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:15.913863 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1df5d4-d696-486f-9724-264169a04522 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:15.919312 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775dea1-9ce2-40b3-a557-354e20afe5a5 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:15.923386 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e10b23-03e1-4c25-9194-462f39548a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:15.924104 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e10b23-03e1-4c25-9194-462f39548a7c admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.924373 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e10b23-03e1-4c25-9194-462f39548a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.924650 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e10b23-03e1-4c25-9194-462f39548a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.925428 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e10b23-03e1-4c25-9194-462f39548a7c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:15.925733 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e10b23-03e1-4c25-9194-462f39548a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:15.927357 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e10b23-03e1-4c25-9194-462f39548a7c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:15.933950 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775dea1-9ce2-40b3-a557-354e20afe5a5 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:15.937814 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 91/183] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:15 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:15.939926 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc779c-b750-45cf-8c63-3645144f6079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:15.940917 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc779c-b750-45cf-8c63-3645144f6079 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.941409 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc779c-b750-45cf-8c63-3645144f6079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.941943 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc779c-b750-45cf-8c63-3645144f6079 admin admin] PATH_INFO: `/v3/groups` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.943075 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc779c-b750-45cf-8c63-3645144f6079 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:15.943957 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e10b23-03e1-4c25-9194-462f39548a7c admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:15.944725 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING py.warnings [None req-33dc779c-b750-45cf-8c63-3645144f6079 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:26:15.944725 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: warnings.warn(msg) Oct 15 03:26:15.944725 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: Oct 15 03:26:15.946950 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc779c-b750-45cf-8c63-3645144f6079 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:15.953929 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e10b23-03e1-4c25-9194-462f39548a7c admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:15.958952 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df103be-59de-4adc-90fd-d8d4744928e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:15.959858 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df103be-59de-4adc-90fd-d8d4744928e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.960101 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df103be-59de-4adc-90fd-d8d4744928e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.960380 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df103be-59de-4adc-90fd-d8d4744928e6 admin admin] PATH_INFO: `/v3/users/18c8349d65bc47af85c514f69b5678ad` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:15.962490 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df103be-59de-4adc-90fd-d8d4744928e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=18c8349d65bc47af85c514f69b5678ad)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:15.964457 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df103be-59de-4adc-90fd-d8d4744928e6 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:15.966065 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 92/184] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:26:15 2021] GET /identity/v3/users/18c8349d65bc47af85c514f69b5678ad => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:15.971829 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 93/185] 10.222.0.30 () {60 vars in 1155 bytes} [Fri Oct 15 03:26:15 2021] POST /identity/v3/groups => generated 229 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:26:15.974120 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df103be-59de-4adc-90fd-d8d4744928e6 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:15.984484 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df103be-59de-4adc-90fd-d8d4744928e6 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:15.989303 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a07e11-a03d-4f6a-9f1b-9b1411bec8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:15.990012 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a07e11-a03d-4f6a-9f1b-9b1411bec8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:15.990437 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a07e11-a03d-4f6a-9f1b-9b1411bec8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:15.990730 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a07e11-a03d-4f6a-9f1b-9b1411bec8f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:16.000616 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a07e11-a03d-4f6a-9f1b-9b1411bec8f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:16.002679 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a07e11-a03d-4f6a-9f1b-9b1411bec8f9 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:16.017917 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 93/186] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:15 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:26:16.026309 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc779c-b750-45cf-8c63-3645144f6079 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:16.040153 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc779c-b750-45cf-8c63-3645144f6079 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:16.044912 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd85ce1-fbe7-4c53-9c0a-5ea16273a17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:16.045788 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd85ce1-fbe7-4c53-9c0a-5ea16273a17d admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:16.046077 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd85ce1-fbe7-4c53-9c0a-5ea16273a17d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:16.046351 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd85ce1-fbe7-4c53-9c0a-5ea16273a17d admin admin] PATH_INFO: `/v3/projects/984f06ad9e80456fb94208662a6d8477` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:16.047780 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd85ce1-fbe7-4c53-9c0a-5ea16273a17d admin admin] RBAC: Authorizing `identity:get_project(project_id=984f06ad9e80456fb94208662a6d8477)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:16.050046 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd85ce1-fbe7-4c53-9c0a-5ea16273a17d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:16.051979 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 94/187] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:16 2021] GET /identity/v3/projects/984f06ad9e80456fb94208662a6d8477 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:16.058877 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a07e11-a03d-4f6a-9f1b-9b1411bec8f9 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:16.068442 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a07e11-a03d-4f6a-9f1b-9b1411bec8f9 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:16.073642 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead2ce8-b83b-4305-aad8-7123fdc20e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:16.074358 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead2ce8-b83b-4305-aad8-7123fdc20e7a admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:16.074644 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead2ce8-b83b-4305-aad8-7123fdc20e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:16.074951 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead2ce8-b83b-4305-aad8-7123fdc20e7a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:16.075922 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead2ce8-b83b-4305-aad8-7123fdc20e7a admin admin] RBAC: Adding query filter params (role.id=3f958dcb5c7c413a9d9edd4ed05d20a2, scope.project.id=984f06ad9e80456fb94208662a6d8477, user.id=18c8349d65bc47af85c514f69b5678ad) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:16.076236 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead2ce8-b83b-4305-aad8-7123fdc20e7a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:16.078327 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead2ce8-b83b-4305-aad8-7123fdc20e7a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:16.084892 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 94/188] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:16 2021] GET /identity/v3/role_assignments?user.id=18c8349d65bc47af85c514f69b5678ad&scope.project.id=984f06ad9e80456fb94208662a6d8477&role.id=3f958dcb5c7c413a9d9edd4ed05d20a2 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:17.812140 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cf0fa-e1e6-4fd2-879d-96f79b365d3a None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:17.812668 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cf0fa-e1e6-4fd2-879d-96f79b365d3a None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:17.812668 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cf0fa-e1e6-4fd2-879d-96f79b365d3a None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:17.814826 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 95/189] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:17.821988 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb64117-7f87-48fb-a5e0-91908ba675dc None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:17.822489 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb64117-7f87-48fb-a5e0-91908ba675dc None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:17.822561 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb64117-7f87-48fb-a5e0-91908ba675dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:17.840435 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-aeb64117-7f87-48fb-a5e0-91908ba675dc None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:17.841600 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-aeb64117-7f87-48fb-a5e0-91908ba675dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:17.849516 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 95/190] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:17.874032 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cf0fa-e1e6-4fd2-879d-96f79b365d3a None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:17.886939 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cf0fa-e1e6-4fd2-879d-96f79b365d3a None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:17.891291 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b42e04-30b2-4fec-9536-6668c422fe02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:17.892112 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b42e04-30b2-4fec-9536-6668c422fe02 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:17.892394 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b42e04-30b2-4fec-9536-6668c422fe02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:17.892663 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b42e04-30b2-4fec-9536-6668c422fe02 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:17.903302 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b42e04-30b2-4fec-9536-6668c422fe02 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:17.910167 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-e7b42e04-30b2-4fec-9536-6668c422fe02 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 03:26:17.911373 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 96/191] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:17 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:17.917850 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb64117-7f87-48fb-a5e0-91908ba675dc None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:17.926831 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb64117-7f87-48fb-a5e0-91908ba675dc None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:17.931810 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45670723-e437-4978-9dbc-6fc108c38476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:17.932465 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45670723-e437-4978-9dbc-6fc108c38476 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:17.932747 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45670723-e437-4978-9dbc-6fc108c38476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:17.933016 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45670723-e437-4978-9dbc-6fc108c38476 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:17.933781 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45670723-e437-4978-9dbc-6fc108c38476 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:17.934080 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45670723-e437-4978-9dbc-6fc108c38476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:17.935693 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45670723-e437-4978-9dbc-6fc108c38476 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:17.942949 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1519c-3ef7-4051-9af2-23c8d43d81f0 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:17.943231 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1519c-3ef7-4051-9af2-23c8d43d81f0 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:17.943507 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1519c-3ef7-4051-9af2-23c8d43d81f0 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:17.945578 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 97/192] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:26:17.947035 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 96/193] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Oct 15 03:26:17 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:17.953280 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb98bcc-2d24-4bcd-8b65-bfea207fbf88 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:17.953569 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb98bcc-2d24-4bcd-8b65-bfea207fbf88 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:17.953844 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb98bcc-2d24-4bcd-8b65-bfea207fbf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:17.956594 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45670723-e437-4978-9dbc-6fc108c38476 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:17.968595 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45670723-e437-4978-9dbc-6fc108c38476 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:17.974117 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abd5f7-39f8-4b8e-bc13-74c346632e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:17.974601 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-6bb98bcc-2d24-4bcd-8b65-bfea207fbf88 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:17.974979 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abd5f7-39f8-4b8e-bc13-74c346632e82 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:17.975267 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abd5f7-39f8-4b8e-bc13-74c346632e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:17.975543 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abd5f7-39f8-4b8e-bc13-74c346632e82 admin admin] PATH_INFO: `/v3/users/18c8349d65bc47af85c514f69b5678ad` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:17.975820 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-6bb98bcc-2d24-4bcd-8b65-bfea207fbf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:17.976786 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3abd5f7-39f8-4b8e-bc13-74c346632e82 admin admin] RBAC: Authorizing `identity:get_user(user_id=18c8349d65bc47af85c514f69b5678ad)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:17.979504 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3abd5f7-39f8-4b8e-bc13-74c346632e82 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:17.981298 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 97/194] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:26:17 2021] GET /identity/v3/users/18c8349d65bc47af85c514f69b5678ad => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:17.984515 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 98/195] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:26:17.988594 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abd5f7-39f8-4b8e-bc13-74c346632e82 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:17.998345 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abd5f7-39f8-4b8e-bc13-74c346632e82 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:18.002995 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6231ff-0143-4a61-8566-e01b93c9cd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:18.004097 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6231ff-0143-4a61-8566-e01b93c9cd41 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:18.004601 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6231ff-0143-4a61-8566-e01b93c9cd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:18.005066 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6231ff-0143-4a61-8566-e01b93c9cd41 admin admin] PATH_INFO: `/v3/projects/984f06ad9e80456fb94208662a6d8477` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:18.006451 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6231ff-0143-4a61-8566-e01b93c9cd41 admin admin] RBAC: Authorizing `identity:get_project(project_id=984f06ad9e80456fb94208662a6d8477)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:18.007750 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb98bcc-2d24-4bcd-8b65-bfea207fbf88 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:18.009809 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6231ff-0143-4a61-8566-e01b93c9cd41 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:18.011612 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 98/196] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:17 2021] GET /identity/v3/projects/984f06ad9e80456fb94208662a6d8477 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:18.017805 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb98bcc-2d24-4bcd-8b65-bfea207fbf88 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:18.019083 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6231ff-0143-4a61-8566-e01b93c9cd41 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:18.023586 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f916d-9de5-4d33-a5a8-9ac5f363e61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:18.024926 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f916d-9de5-4d33-a5a8-9ac5f363e61d admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:18.025204 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f916d-9de5-4d33-a5a8-9ac5f363e61d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:18.025469 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f916d-9de5-4d33-a5a8-9ac5f363e61d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:18.031264 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6231ff-0143-4a61-8566-e01b93c9cd41 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:18.036054 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463b441-b40d-4fe9-8e5b-769006772f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:18.036197 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f916d-9de5-4d33-a5a8-9ac5f363e61d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:18.037249 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463b441-b40d-4fe9-8e5b-769006772f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:18.037725 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463b441-b40d-4fe9-8e5b-769006772f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:18.038195 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463b441-b40d-4fe9-8e5b-769006772f02 admin admin] PATH_INFO: `/v3/projects/984f06ad9e80456fb94208662a6d8477/users/18c8349d65bc47af85c514f69b5678ad/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:18.040937 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463b441-b40d-4fe9-8e5b-769006772f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=984f06ad9e80456fb94208662a6d8477, user_id=18c8349d65bc47af85c514f69b5678ad, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:18.043580 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-644f916d-9de5-4d33-a5a8-9ac5f363e61d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:26:18.044092 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463b441-b40d-4fe9-8e5b-769006772f02 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:18.045105 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 99/197] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:26:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:18.051876 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f916d-9de5-4d33-a5a8-9ac5f363e61d admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:18.059595 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 99/198] 10.222.0.30 () {58 vars in 1460 bytes} [Fri Oct 15 03:26:18 2021] PUT /identity/v3/projects/984f06ad9e80456fb94208662a6d8477/users/18c8349d65bc47af85c514f69b5678ad/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:26:18.063872 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f916d-9de5-4d33-a5a8-9ac5f363e61d admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:18.128695 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7c493-12e6-40ab-9bab-2a55a1869dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:18.129631 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7c493-12e6-40ab-9bab-2a55a1869dab admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:18.130083 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7c493-12e6-40ab-9bab-2a55a1869dab admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:18.130494 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7c493-12e6-40ab-9bab-2a55a1869dab admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:18.131519 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7c493-12e6-40ab-9bab-2a55a1869dab admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:18.131992 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7c493-12e6-40ab-9bab-2a55a1869dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:18.133816 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7c493-12e6-40ab-9bab-2a55a1869dab admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:18.146023 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 100/199] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:18.152857 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463b441-b40d-4fe9-8e5b-769006772f02 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:18.165877 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463b441-b40d-4fe9-8e5b-769006772f02 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:18.171035 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800f7df-f9ef-44db-af47-bb8379a29f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:18.172302 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800f7df-f9ef-44db-af47-bb8379a29f88 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:18.172784 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800f7df-f9ef-44db-af47-bb8379a29f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:18.173263 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800f7df-f9ef-44db-af47-bb8379a29f88 admin admin] PATH_INFO: `/v3/users/54e89668dd2f4bda9877cf539179b3ec` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:18.174749 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800f7df-f9ef-44db-af47-bb8379a29f88 admin admin] RBAC: Authorizing `identity:get_user(user_id=54e89668dd2f4bda9877cf539179b3ec)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:18.176821 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800f7df-f9ef-44db-af47-bb8379a29f88 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:18.179077 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 100/200] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:26:18 2021] GET /identity/v3/users/54e89668dd2f4bda9877cf539179b3ec => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:18.185796 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7c493-12e6-40ab-9bab-2a55a1869dab admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:18.196795 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7c493-12e6-40ab-9bab-2a55a1869dab admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:18.201495 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fbfaa-5283-408a-a413-9ef23aebf6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:18.202373 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fbfaa-5283-408a-a413-9ef23aebf6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:18.202655 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fbfaa-5283-408a-a413-9ef23aebf6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:18.202930 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fbfaa-5283-408a-a413-9ef23aebf6a5 admin admin] PATH_INFO: `/v3/projects/984f06ad9e80456fb94208662a6d8477` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:18.204187 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175fbfaa-5283-408a-a413-9ef23aebf6a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=984f06ad9e80456fb94208662a6d8477)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:18.206306 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175fbfaa-5283-408a-a413-9ef23aebf6a5 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:18.208352 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 101/201] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:18 2021] GET /identity/v3/projects/984f06ad9e80456fb94208662a6d8477 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:18.215503 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800f7df-f9ef-44db-af47-bb8379a29f88 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:18.226450 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800f7df-f9ef-44db-af47-bb8379a29f88 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:18.237612 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa83849-8581-4675-9530-4a5e1469d787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:18.244729 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa83849-8581-4675-9530-4a5e1469d787 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:18.245247 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa83849-8581-4675-9530-4a5e1469d787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:18.245734 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa83849-8581-4675-9530-4a5e1469d787 admin admin] PATH_INFO: `/v3/projects/984f06ad9e80456fb94208662a6d8477/users/54e89668dd2f4bda9877cf539179b3ec/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:18.248341 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa83849-8581-4675-9530-4a5e1469d787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=984f06ad9e80456fb94208662a6d8477, user_id=54e89668dd2f4bda9877cf539179b3ec, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:18.251709 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa83849-8581-4675-9530-4a5e1469d787 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:18.275868 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 101/202] 10.222.0.30 () {58 vars in 1460 bytes} [Fri Oct 15 03:26:18 2021] PUT /identity/v3/projects/984f06ad9e80456fb94208662a6d8477/users/54e89668dd2f4bda9877cf539179b3ec/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:26:18.376848 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d73111-5a34-4039-a834-9a53d37ddbb6 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:18.377136 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d73111-5a34-4039-a834-9a53d37ddbb6 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:18.377324 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d73111-5a34-4039-a834-9a53d37ddbb6 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:18.379128 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 102/203] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:18.385454 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847ff34-1371-4803-90fc-b49a5f529786 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:18.385747 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847ff34-1371-4803-90fc-b49a5f529786 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:18.386031 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847ff34-1371-4803-90fc-b49a5f529786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:18.412776 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-a847ff34-1371-4803-90fc-b49a5f529786 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:18.414004 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-a847ff34-1371-4803-90fc-b49a5f529786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:18.418255 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06e9eb-b655-4fae-99fe-99390135349f None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:18.418546 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06e9eb-b655-4fae-99fe-99390135349f None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:18.418823 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06e9eb-b655-4fae-99fe-99390135349f None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:18.420833 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 103/204] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:18.426683 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35eb4a-aa22-4b0b-9c8a-1ed1967e4ea0 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:18.426970 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35eb4a-aa22-4b0b-9c8a-1ed1967e4ea0 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:18.427248 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35eb4a-aa22-4b0b-9c8a-1ed1967e4ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:18.449539 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-af35eb4a-aa22-4b0b-9c8a-1ed1967e4ea0 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:18.451607 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-af35eb4a-aa22-4b0b-9c8a-1ed1967e4ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:18.485069 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 102/205] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:18.509570 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847ff34-1371-4803-90fc-b49a5f529786 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:18.518862 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847ff34-1371-4803-90fc-b49a5f529786 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:18.524912 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df433e-20fa-4052-8694-cfc8fb198151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:18.525793 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df433e-20fa-4052-8694-cfc8fb198151 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:18.526074 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df433e-20fa-4052-8694-cfc8fb198151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:18.526348 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df433e-20fa-4052-8694-cfc8fb198151 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:18.527372 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 104/206] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:26:18.538602 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df433e-20fa-4052-8694-cfc8fb198151 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:18.545949 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-a8df433e-20fa-4052-8694-cfc8fb198151 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 03:26:18.547529 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 103/207] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Oct 15 03:26:18 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:18.553152 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35eb4a-aa22-4b0b-9c8a-1ed1967e4ea0 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:18.553639 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df433e-20fa-4052-8694-cfc8fb198151 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:18.564558 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35eb4a-aa22-4b0b-9c8a-1ed1967e4ea0 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:18.568538 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df433e-20fa-4052-8694-cfc8fb198151 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:18.569902 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65638c1-0af5-4139-8deb-a611b33e3b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:18.570935 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65638c1-0af5-4139-8deb-a611b33e3b44 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:18.572010 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65638c1-0af5-4139-8deb-a611b33e3b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:18.572452 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65638c1-0af5-4139-8deb-a611b33e3b44 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:18.573944 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65638c1-0af5-4139-8deb-a611b33e3b44 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:18.574062 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00119f84-f216-4ce8-98ac-b510d6c5f99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:18.574861 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00119f84-f216-4ce8-98ac-b510d6c5f99f admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:18.575249 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00119f84-f216-4ce8-98ac-b510d6c5f99f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:18.575596 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00119f84-f216-4ce8-98ac-b510d6c5f99f admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:18.576526 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00119f84-f216-4ce8-98ac-b510d6c5f99f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:18.576704 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65638c1-0af5-4139-8deb-a611b33e3b44 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:18.576946 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00119f84-f216-4ce8-98ac-b510d6c5f99f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:18.578630 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 105/208] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:18.578781 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00119f84-f216-4ce8-98ac-b510d6c5f99f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:18.585534 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65638c1-0af5-4139-8deb-a611b33e3b44 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:18.592870 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 104/209] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:18 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:18.598164 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65638c1-0af5-4139-8deb-a611b33e3b44 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:18.599090 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00119f84-f216-4ce8-98ac-b510d6c5f99f admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:18.603309 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7e2b7-e2b6-4d83-90f2-ba61feaf701a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:18.604251 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7e2b7-e2b6-4d83-90f2-ba61feaf701a admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:18.604746 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7e2b7-e2b6-4d83-90f2-ba61feaf701a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:18.605209 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7e2b7-e2b6-4d83-90f2-ba61feaf701a admin admin] PATH_INFO: `/v3/groups` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:18.606094 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7e2b7-e2b6-4d83-90f2-ba61feaf701a admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:18.608204 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7e2b7-e2b6-4d83-90f2-ba61feaf701a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:18.608982 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00119f84-f216-4ce8-98ac-b510d6c5f99f admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:18.615074 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89721e51-3e91-4759-a399-fcb2d851d8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:18.616760 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89721e51-3e91-4759-a399-fcb2d851d8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:18.616760 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89721e51-3e91-4759-a399-fcb2d851d8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:18.616760 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89721e51-3e91-4759-a399-fcb2d851d8c1 admin admin] PATH_INFO: `/v3/users/18c8349d65bc47af85c514f69b5678ad` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:18.618742 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89721e51-3e91-4759-a399-fcb2d851d8c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=18c8349d65bc47af85c514f69b5678ad)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:18.620805 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89721e51-3e91-4759-a399-fcb2d851d8c1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:18.622704 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 105/210] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:26:18 2021] GET /identity/v3/users/18c8349d65bc47af85c514f69b5678ad => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:18.626942 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 106/211] 10.222.0.30 () {60 vars in 1155 bytes} [Fri Oct 15 03:26:18 2021] POST /identity/v3/groups => generated 226 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:26:18.633145 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89721e51-3e91-4759-a399-fcb2d851d8c1 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:18.646714 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89721e51-3e91-4759-a399-fcb2d851d8c1 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:18.652053 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca3543-5888-426b-a7b9-e54b7e5a4a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:18.652973 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca3543-5888-426b-a7b9-e54b7e5a4a84 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:18.653262 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca3543-5888-426b-a7b9-e54b7e5a4a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:18.653539 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca3543-5888-426b-a7b9-e54b7e5a4a84 admin admin] PATH_INFO: `/v3/projects/984f06ad9e80456fb94208662a6d8477` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:18.654938 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca3543-5888-426b-a7b9-e54b7e5a4a84 admin admin] RBAC: Authorizing `identity:get_project(project_id=984f06ad9e80456fb94208662a6d8477)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:18.657274 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca3543-5888-426b-a7b9-e54b7e5a4a84 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:18.659519 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 106/212] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:18 2021] GET /identity/v3/projects/984f06ad9e80456fb94208662a6d8477 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:18.666267 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7e2b7-e2b6-4d83-90f2-ba61feaf701a admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:18.676952 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7e2b7-e2b6-4d83-90f2-ba61feaf701a admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:18.682355 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a111f-ab2f-4242-ac8a-e5f3bb8505f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:18.683524 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a111f-ab2f-4242-ac8a-e5f3bb8505f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:18.684018 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a111f-ab2f-4242-ac8a-e5f3bb8505f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:18.684478 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a111f-ab2f-4242-ac8a-e5f3bb8505f4 admin admin] PATH_INFO: `/v3/projects/984f06ad9e80456fb94208662a6d8477/users/18c8349d65bc47af85c514f69b5678ad/roles/3f958dcb5c7c413a9d9edd4ed05d20a2` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:18.686947 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a111f-ab2f-4242-ac8a-e5f3bb8505f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=984f06ad9e80456fb94208662a6d8477, user_id=18c8349d65bc47af85c514f69b5678ad, role_id=3f958dcb5c7c413a9d9edd4ed05d20a2)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:18.689921 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a111f-ab2f-4242-ac8a-e5f3bb8505f4 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:18.707898 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 107/213] 10.222.0.30 () {58 vars in 1460 bytes} [Fri Oct 15 03:26:18 2021] PUT /identity/v3/projects/984f06ad9e80456fb94208662a6d8477/users/18c8349d65bc47af85c514f69b5678ad/roles/3f958dcb5c7c413a9d9edd4ed05d20a2 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:26:20.572738 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1324b-b0b8-4657-a6bb-3b701ece20b1 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:20.573233 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1324b-b0b8-4657-a6bb-3b701ece20b1 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:20.573233 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1324b-b0b8-4657-a6bb-3b701ece20b1 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:20.575241 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 107/214] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:20.581424 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b00bfd-e5f3-45ba-9ae0-e47355d9b616 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:20.581851 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b00bfd-e5f3-45ba-9ae0-e47355d9b616 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:20.582052 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b00bfd-e5f3-45ba-9ae0-e47355d9b616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:20.605396 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-73b00bfd-e5f3-45ba-9ae0-e47355d9b616 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:20.606594 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-73b00bfd-e5f3-45ba-9ae0-e47355d9b616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:20.681625 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 108/215] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:26:20.722459 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1324b-b0b8-4657-a6bb-3b701ece20b1 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:20.736831 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1324b-b0b8-4657-a6bb-3b701ece20b1 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:20.747806 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345ba1f-238e-4313-86ca-bfb075f6de0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:20.748605 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345ba1f-238e-4313-86ca-bfb075f6de0d admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:20.748886 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345ba1f-238e-4313-86ca-bfb075f6de0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:20.749158 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345ba1f-238e-4313-86ca-bfb075f6de0d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:20.769644 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345ba1f-238e-4313-86ca-bfb075f6de0d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:20.784046 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-a345ba1f-238e-4313-86ca-bfb075f6de0d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 03:26:20.785345 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 108/216] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:20 2021] GET /identity/v3/roles/member => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:20.791806 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b00bfd-e5f3-45ba-9ae0-e47355d9b616 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:20.801106 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b00bfd-e5f3-45ba-9ae0-e47355d9b616 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:20.811760 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218c0d7-4c21-4d5d-be95-17d10978abff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:20.812433 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218c0d7-4c21-4d5d-be95-17d10978abff admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:20.812715 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218c0d7-4c21-4d5d-be95-17d10978abff admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:20.812990 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218c0d7-4c21-4d5d-be95-17d10978abff admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:20.813763 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218c0d7-4c21-4d5d-be95-17d10978abff admin admin] RBAC: Adding query filter params (name=member) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:20.814074 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218c0d7-4c21-4d5d-be95-17d10978abff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:20.815735 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218c0d7-4c21-4d5d-be95-17d10978abff admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:20.826296 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 109/217] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Oct 15 03:26:20 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:20.829387 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08997567-d2af-47e3-a05b-77e060190a5c None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:20.829677 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08997567-d2af-47e3-a05b-77e060190a5c None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:20.829954 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08997567-d2af-47e3-a05b-77e060190a5c None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:20.831971 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 109/218] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:20.838452 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941915f-2f5b-4a36-a9a1-0a6cdbd0fad7 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:20.838737 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941915f-2f5b-4a36-a9a1-0a6cdbd0fad7 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:20.839014 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941915f-2f5b-4a36-a9a1-0a6cdbd0fad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:20.840563 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218c0d7-4c21-4d5d-be95-17d10978abff admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:20.863407 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218c0d7-4c21-4d5d-be95-17d10978abff admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:20.868913 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-f941915f-2f5b-4a36-a9a1-0a6cdbd0fad7 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:20.870096 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-f941915f-2f5b-4a36-a9a1-0a6cdbd0fad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:20.874505 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb98e5c-2c4a-407c-9d50-1004b97b7da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:20.875375 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb98e5c-2c4a-407c-9d50-1004b97b7da6 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:20.875656 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb98e5c-2c4a-407c-9d50-1004b97b7da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:20.878598 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb98e5c-2c4a-407c-9d50-1004b97b7da6 admin admin] PATH_INFO: `/v3/users/18c8349d65bc47af85c514f69b5678ad` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:20.879719 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb98e5c-2c4a-407c-9d50-1004b97b7da6 admin admin] RBAC: Authorizing `identity:get_user(user_id=18c8349d65bc47af85c514f69b5678ad)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:20.882150 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb98e5c-2c4a-407c-9d50-1004b97b7da6 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:20.882838 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 110/219] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:20.884384 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 110/220] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:26:20 2021] GET /identity/v3/users/18c8349d65bc47af85c514f69b5678ad => generated 283 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:20.889819 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941915f-2f5b-4a36-a9a1-0a6cdbd0fad7 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:20.903161 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941915f-2f5b-4a36-a9a1-0a6cdbd0fad7 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:20.911285 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d500b1c-ca86-4132-8614-0facd34fc2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:20.912223 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d500b1c-ca86-4132-8614-0facd34fc2dd admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:20.912697 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d500b1c-ca86-4132-8614-0facd34fc2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:20.913159 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d500b1c-ca86-4132-8614-0facd34fc2dd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:20.925766 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb98e5c-2c4a-407c-9d50-1004b97b7da6 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:20.932079 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d500b1c-ca86-4132-8614-0facd34fc2dd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:20.934346 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d500b1c-ca86-4132-8614-0facd34fc2dd admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:20.943523 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb98e5c-2c4a-407c-9d50-1004b97b7da6 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:20.946870 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 111/221] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:20 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:20.953294 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b5b49-b8b3-45ea-8ddb-04b762bf7431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:20.954143 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b5b49-b8b3-45ea-8ddb-04b762bf7431 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:20.954431 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b5b49-b8b3-45ea-8ddb-04b762bf7431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:20.954752 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b5b49-b8b3-45ea-8ddb-04b762bf7431 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:20.960778 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d500b1c-ca86-4132-8614-0facd34fc2dd admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:20.973151 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d500b1c-ca86-4132-8614-0facd34fc2dd admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:20.975664 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b5b49-b8b3-45ea-8ddb-04b762bf7431 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:20.985189 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-5d7b5b49-b8b3-45ea-8ddb-04b762bf7431 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:26:20.986814 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ebaec-a37c-4d05-a7fc-40fcd2fbae4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:20.987914 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ebaec-a37c-4d05-a7fc-40fcd2fbae4b admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:20.988400 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ebaec-a37c-4d05-a7fc-40fcd2fbae4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:20.988860 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ebaec-a37c-4d05-a7fc-40fcd2fbae4b admin admin] PATH_INFO: `/v3/projects/984f06ad9e80456fb94208662a6d8477` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:20.990248 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ebaec-a37c-4d05-a7fc-40fcd2fbae4b admin admin] RBAC: Authorizing `identity:get_project(project_id=984f06ad9e80456fb94208662a6d8477)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:20.992510 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ebaec-a37c-4d05-a7fc-40fcd2fbae4b admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:20.994486 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 111/222] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:26:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:20.996534 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 112/223] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:20 2021] GET /identity/v3/projects/984f06ad9e80456fb94208662a6d8477 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:21.000953 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b5b49-b8b3-45ea-8ddb-04b762bf7431 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:21.002902 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ebaec-a37c-4d05-a7fc-40fcd2fbae4b admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:21.019834 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b5b49-b8b3-45ea-8ddb-04b762bf7431 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:21.022370 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ebaec-a37c-4d05-a7fc-40fcd2fbae4b admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:21.027469 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ef0c8-1296-4c2f-9b2c-d985890cac17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:21.027817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04732224-4216-42cd-a2d2-81ec84636dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:21.028301 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ef0c8-1296-4c2f-9b2c-d985890cac17 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:21.028587 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ef0c8-1296-4c2f-9b2c-d985890cac17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:21.028865 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ef0c8-1296-4c2f-9b2c-d985890cac17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:21.029285 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04732224-4216-42cd-a2d2-81ec84636dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:21.029687 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ef0c8-1296-4c2f-9b2c-d985890cac17 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:21.029998 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ef0c8-1296-4c2f-9b2c-d985890cac17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:21.030226 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04732224-4216-42cd-a2d2-81ec84636dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:21.030677 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04732224-4216-42cd-a2d2-81ec84636dc9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:21.031713 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04732224-4216-42cd-a2d2-81ec84636dc9 admin admin] RBAC: Adding query filter params (role.id=ee5acd2d5378499bb27dc24366041b42, scope.project.id=984f06ad9e80456fb94208662a6d8477, user.id=18c8349d65bc47af85c514f69b5678ad) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:21.032226 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04732224-4216-42cd-a2d2-81ec84636dc9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:21.034272 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04732224-4216-42cd-a2d2-81ec84636dc9 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:21.036004 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ef0c8-1296-4c2f-9b2c-d985890cac17 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:21.042248 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 113/224] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:21 2021] GET /identity/v3/role_assignments?user.id=18c8349d65bc47af85c514f69b5678ad&scope.project.id=984f06ad9e80456fb94208662a6d8477&role.id=ee5acd2d5378499bb27dc24366041b42 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:21.048858 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 112/225] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:21.054995 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04732224-4216-42cd-a2d2-81ec84636dc9 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:21.073630 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04732224-4216-42cd-a2d2-81ec84636dc9 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:21.084352 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d7758-dbd2-4818-8059-679461f444cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:21.085556 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d7758-dbd2-4818-8059-679461f444cd admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:21.086025 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d7758-dbd2-4818-8059-679461f444cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:21.086502 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d7758-dbd2-4818-8059-679461f444cd admin admin] PATH_INFO: `/v3/users/54e89668dd2f4bda9877cf539179b3ec` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:21.087959 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d7758-dbd2-4818-8059-679461f444cd admin admin] RBAC: Authorizing `identity:get_user(user_id=54e89668dd2f4bda9877cf539179b3ec)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:21.089974 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d7758-dbd2-4818-8059-679461f444cd admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:21.095561 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 114/226] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:26:21 2021] GET /identity/v3/users/54e89668dd2f4bda9877cf539179b3ec => generated 247 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:21.102257 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ef0c8-1296-4c2f-9b2c-d985890cac17 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:21.120225 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ef0c8-1296-4c2f-9b2c-d985890cac17 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:21.130639 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c418e1-a31b-438e-8283-91f45e2facde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:21.131376 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c418e1-a31b-438e-8283-91f45e2facde admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:21.131845 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c418e1-a31b-438e-8283-91f45e2facde admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:21.132238 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c418e1-a31b-438e-8283-91f45e2facde admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:21.145965 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c418e1-a31b-438e-8283-91f45e2facde admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:21.147842 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c418e1-a31b-438e-8283-91f45e2facde admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:21.160736 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 113/227] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:21 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:21.167230 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d7758-dbd2-4818-8059-679461f444cd admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:21.179577 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d7758-dbd2-4818-8059-679461f444cd admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:21.185718 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537d596-2b2f-4166-b607-786f6486ae52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:21.186799 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537d596-2b2f-4166-b607-786f6486ae52 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:21.187271 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537d596-2b2f-4166-b607-786f6486ae52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:21.187766 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537d596-2b2f-4166-b607-786f6486ae52 admin admin] PATH_INFO: `/v3/projects/984f06ad9e80456fb94208662a6d8477` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:21.189166 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537d596-2b2f-4166-b607-786f6486ae52 admin admin] RBAC: Authorizing `identity:get_project(project_id=984f06ad9e80456fb94208662a6d8477)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:21.191425 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537d596-2b2f-4166-b607-786f6486ae52 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:21.193311 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 115/228] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:21 2021] GET /identity/v3/projects/984f06ad9e80456fb94208662a6d8477 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:21.200570 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c418e1-a31b-438e-8283-91f45e2facde admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:21.212672 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c418e1-a31b-438e-8283-91f45e2facde admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:21.218606 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f412d-dfc0-4e5c-8f13-dfed32b60b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:21.219322 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f412d-dfc0-4e5c-8f13-dfed32b60b56 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:21.219612 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f412d-dfc0-4e5c-8f13-dfed32b60b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:21.219914 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f412d-dfc0-4e5c-8f13-dfed32b60b56 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:21.221013 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f412d-dfc0-4e5c-8f13-dfed32b60b56 admin admin] RBAC: Adding query filter params (role.id=15ba70b0cba04962a6d0b80b50c07004, scope.project.id=984f06ad9e80456fb94208662a6d8477, user.id=54e89668dd2f4bda9877cf539179b3ec) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:21.221333 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f412d-dfc0-4e5c-8f13-dfed32b60b56 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:21.223379 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f412d-dfc0-4e5c-8f13-dfed32b60b56 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:21.234999 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 114/229] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:21 2021] GET /identity/v3/role_assignments?user.id=54e89668dd2f4bda9877cf539179b3ec&scope.project.id=984f06ad9e80456fb94208662a6d8477&role.id=15ba70b0cba04962a6d0b80b50c07004 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:21.849717 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbde963-3922-4ea4-b1ba-6b9a05d680b2 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:21.850215 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbde963-3922-4ea4-b1ba-6b9a05d680b2 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:21.850316 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbde963-3922-4ea4-b1ba-6b9a05d680b2 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:21.852357 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 116/230] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:21.878025 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d46cc-0478-43b2-b4fa-367d7caf0e47 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:21.878512 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d46cc-0478-43b2-b4fa-367d7caf0e47 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:21.878582 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d46cc-0478-43b2-b4fa-367d7caf0e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:21.904069 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-c95d46cc-0478-43b2-b4fa-367d7caf0e47 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:21.905264 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c95d46cc-0478-43b2-b4fa-367d7caf0e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:21.916663 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 115/231] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:21.955196 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbde963-3922-4ea4-b1ba-6b9a05d680b2 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:21.973451 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbde963-3922-4ea4-b1ba-6b9a05d680b2 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:21.978595 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b59db-dcb9-46c6-9887-2ff0b67f0b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:21.979382 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b59db-dcb9-46c6-9887-2ff0b67f0b71 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:21.979659 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b59db-dcb9-46c6-9887-2ff0b67f0b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:21.979973 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b59db-dcb9-46c6-9887-2ff0b67f0b71 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:21.995871 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b59db-dcb9-46c6-9887-2ff0b67f0b71 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:22.003064 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-425b59db-dcb9-46c6-9887-2ff0b67f0b71 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 03:26:22.005296 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 117/232] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Oct 15 03:26:21 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:22.011454 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d46cc-0478-43b2-b4fa-367d7caf0e47 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:22.024831 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d46cc-0478-43b2-b4fa-367d7caf0e47 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:22.031848 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ebfbc-8e8a-4239-9f9c-229140ff0b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:22.032523 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ebfbc-8e8a-4239-9f9c-229140ff0b0c admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:22.032804 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ebfbc-8e8a-4239-9f9c-229140ff0b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:22.033291 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ebfbc-8e8a-4239-9f9c-229140ff0b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:22.034040 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ebfbc-8e8a-4239-9f9c-229140ff0b0c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:22.034399 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ebfbc-8e8a-4239-9f9c-229140ff0b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:22.036101 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ebfbc-8e8a-4239-9f9c-229140ff0b0c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:22.054200 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 116/233] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:22 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:22.060995 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b59db-dcb9-46c6-9887-2ff0b67f0b71 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:22.077319 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b59db-dcb9-46c6-9887-2ff0b67f0b71 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:22.088741 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fb820-1f52-4cf0-81ff-9e45ba7e4c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:22.089621 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fb820-1f52-4cf0-81ff-9e45ba7e4c5f admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:22.089899 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fb820-1f52-4cf0-81ff-9e45ba7e4c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:22.090169 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fb820-1f52-4cf0-81ff-9e45ba7e4c5f admin admin] PATH_INFO: `/v3/users/18c8349d65bc47af85c514f69b5678ad` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:22.092394 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fb820-1f52-4cf0-81ff-9e45ba7e4c5f admin admin] RBAC: Authorizing `identity:get_user(user_id=18c8349d65bc47af85c514f69b5678ad)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:22.094580 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fb820-1f52-4cf0-81ff-9e45ba7e4c5f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:22.096698 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 118/234] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:26:22 2021] GET /identity/v3/users/18c8349d65bc47af85c514f69b5678ad => generated 283 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:22.103227 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ebfbc-8e8a-4239-9f9c-229140ff0b0c admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:22.115267 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ebfbc-8e8a-4239-9f9c-229140ff0b0c admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:22.123822 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704e772-4846-464d-b4e6-de8232a58390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:22.124583 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704e772-4846-464d-b4e6-de8232a58390 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:22.124867 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704e772-4846-464d-b4e6-de8232a58390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:22.125146 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704e772-4846-464d-b4e6-de8232a58390 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:22.141740 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704e772-4846-464d-b4e6-de8232a58390 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:22.143704 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704e772-4846-464d-b4e6-de8232a58390 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:22.155497 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 117/235] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:22.161954 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fb820-1f52-4cf0-81ff-9e45ba7e4c5f admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:22.176743 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fb820-1f52-4cf0-81ff-9e45ba7e4c5f admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:22.183156 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef6c9c-259c-4e86-8269-bebb2a761eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:22.184018 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef6c9c-259c-4e86-8269-bebb2a761eed admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:22.184297 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef6c9c-259c-4e86-8269-bebb2a761eed admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:22.184567 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef6c9c-259c-4e86-8269-bebb2a761eed admin admin] PATH_INFO: `/v3/projects/984f06ad9e80456fb94208662a6d8477` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:22.188400 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef6c9c-259c-4e86-8269-bebb2a761eed admin admin] RBAC: Authorizing `identity:get_project(project_id=984f06ad9e80456fb94208662a6d8477)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:22.190472 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef6c9c-259c-4e86-8269-bebb2a761eed admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:22.192200 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 119/236] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:22 2021] GET /identity/v3/projects/984f06ad9e80456fb94208662a6d8477 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:22.199401 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704e772-4846-464d-b4e6-de8232a58390 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:22.213386 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704e772-4846-464d-b4e6-de8232a58390 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:22.219669 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a128c-5bd6-4a0d-81e6-b5314f35da30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:22.220429 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a128c-5bd6-4a0d-81e6-b5314f35da30 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:22.220898 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a128c-5bd6-4a0d-81e6-b5314f35da30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:22.221181 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a128c-5bd6-4a0d-81e6-b5314f35da30 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:22.222027 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a128c-5bd6-4a0d-81e6-b5314f35da30 admin admin] RBAC: Adding query filter params (role.id=3f958dcb5c7c413a9d9edd4ed05d20a2, scope.project.id=984f06ad9e80456fb94208662a6d8477, user.id=18c8349d65bc47af85c514f69b5678ad) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:22.222338 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a128c-5bd6-4a0d-81e6-b5314f35da30 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:22.224604 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a128c-5bd6-4a0d-81e6-b5314f35da30 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:22.236758 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 118/237] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:22 2021] GET /identity/v3/role_assignments?user.id=18c8349d65bc47af85c514f69b5678ad&scope.project.id=984f06ad9e80456fb94208662a6d8477&role.id=3f958dcb5c7c413a9d9edd4ed05d20a2 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:22.371360 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b4180-4c2e-41f7-9dd0-7e2d6046827d None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:22.371718 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b4180-4c2e-41f7-9dd0-7e2d6046827d None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:22.371950 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b4180-4c2e-41f7-9dd0-7e2d6046827d None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:22.374108 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 120/238] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:22.380305 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932708f-856e-41f6-8822-05e1dd8bc299 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:22.380590 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932708f-856e-41f6-8822-05e1dd8bc299 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:22.380852 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932708f-856e-41f6-8822-05e1dd8bc299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:22.408716 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-d932708f-856e-41f6-8822-05e1dd8bc299 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:22.410016 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d932708f-856e-41f6-8822-05e1dd8bc299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:22.418861 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 119/239] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:22.460407 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b4180-4c2e-41f7-9dd0-7e2d6046827d None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:22.475872 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b4180-4c2e-41f7-9dd0-7e2d6046827d None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:22.481033 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848119a-2ee0-452c-a388-05a3588720bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:22.481877 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848119a-2ee0-452c-a388-05a3588720bb admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:22.482158 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848119a-2ee0-452c-a388-05a3588720bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:22.482431 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848119a-2ee0-452c-a388-05a3588720bb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:22.501577 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848119a-2ee0-452c-a388-05a3588720bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:22.509335 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-0848119a-2ee0-452c-a388-05a3588720bb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 03:26:22.510756 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 121/240] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:22 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:22.517332 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932708f-856e-41f6-8822-05e1dd8bc299 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:22.526885 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932708f-856e-41f6-8822-05e1dd8bc299 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:22.533390 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e847189-8169-4faa-9e31-b6de3b14da05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:22.534266 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e847189-8169-4faa-9e31-b6de3b14da05 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:22.534554 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e847189-8169-4faa-9e31-b6de3b14da05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:22.534830 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e847189-8169-4faa-9e31-b6de3b14da05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:22.535618 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e847189-8169-4faa-9e31-b6de3b14da05 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:22.535955 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e847189-8169-4faa-9e31-b6de3b14da05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:22.537758 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e847189-8169-4faa-9e31-b6de3b14da05 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:22.549293 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 120/241] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Oct 15 03:26:22 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:22.557429 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848119a-2ee0-452c-a388-05a3588720bb admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:22.568041 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848119a-2ee0-452c-a388-05a3588720bb admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:22.575862 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fb770-0148-4da3-b2bd-9d12e5052575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:22.576582 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fb770-0148-4da3-b2bd-9d12e5052575 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:22.576864 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fb770-0148-4da3-b2bd-9d12e5052575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:22.577140 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fb770-0148-4da3-b2bd-9d12e5052575 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:22.587080 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9fb770-0148-4da3-b2bd-9d12e5052575 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:22.588967 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9fb770-0148-4da3-b2bd-9d12e5052575 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:22.599249 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 122/242] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:22.605772 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e847189-8169-4faa-9e31-b6de3b14da05 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:22.616537 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e847189-8169-4faa-9e31-b6de3b14da05 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:22.623389 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4224e2d-496c-440a-8493-aeed1d49dff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:22.624309 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4224e2d-496c-440a-8493-aeed1d49dff3 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:22.624596 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4224e2d-496c-440a-8493-aeed1d49dff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:22.624927 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4224e2d-496c-440a-8493-aeed1d49dff3 admin admin] PATH_INFO: `/v3/projects/098453151f33456db2f118ed4fac105c` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:22.626302 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4224e2d-496c-440a-8493-aeed1d49dff3 admin admin] RBAC: Authorizing `identity:get_project(project_id=098453151f33456db2f118ed4fac105c)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:22.628560 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4224e2d-496c-440a-8493-aeed1d49dff3 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:22.630713 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 121/243] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:22 2021] GET /identity/v3/projects/098453151f33456db2f118ed4fac105c => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:22.637848 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fb770-0148-4da3-b2bd-9d12e5052575 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:22.647464 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fb770-0148-4da3-b2bd-9d12e5052575 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:22.655448 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b9ed2-1825-4bcd-b817-006c82309969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:22.656431 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b9ed2-1825-4bcd-b817-006c82309969 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:22.656715 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b9ed2-1825-4bcd-b817-006c82309969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:22.656991 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b9ed2-1825-4bcd-b817-006c82309969 admin admin] PATH_INFO: `/v3/groups/d78b7e95b910411b9b9ebebb8ca315ad` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:22.664793 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b9ed2-1825-4bcd-b817-006c82309969 admin admin] RBAC: Authorizing `identity:get_group(group_id=d78b7e95b910411b9b9ebebb8ca315ad)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:22.666462 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING py.warnings [None req-f96b9ed2-1825-4bcd-b817-006c82309969 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:26:22.666462 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: warnings.warn(msg) Oct 15 03:26:22.666462 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: Oct 15 03:26:22.667667 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b9ed2-1825-4bcd-b817-006c82309969 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:22.669570 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 123/244] 10.222.0.30 () {56 vars in 1201 bytes} [Fri Oct 15 03:26:22 2021] GET /identity/v3/groups/d78b7e95b910411b9b9ebebb8ca315ad => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:22.675923 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4224e2d-496c-440a-8493-aeed1d49dff3 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:22.688312 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4224e2d-496c-440a-8493-aeed1d49dff3 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:22.694564 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d6e7a-1978-457f-8e35-2221ca7e8dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:22.695247 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d6e7a-1978-457f-8e35-2221ca7e8dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:22.695546 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d6e7a-1978-457f-8e35-2221ca7e8dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:22.695927 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d6e7a-1978-457f-8e35-2221ca7e8dd8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:22.697464 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d6e7a-1978-457f-8e35-2221ca7e8dd8 admin admin] RBAC: Adding query filter params (group.id=d78b7e95b910411b9b9ebebb8ca315ad, role.id=ee5acd2d5378499bb27dc24366041b42, scope.project.id=098453151f33456db2f118ed4fac105c) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:22.697777 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d6e7a-1978-457f-8e35-2221ca7e8dd8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:22.699727 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d6e7a-1978-457f-8e35-2221ca7e8dd8 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:22.712919 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 122/245] 10.222.0.30 () {56 vars in 1397 bytes} [Fri Oct 15 03:26:22 2021] GET /identity/v3/role_assignments?group.id=d78b7e95b910411b9b9ebebb8ca315ad&scope.project.id=098453151f33456db2f118ed4fac105c&role.id=ee5acd2d5378499bb27dc24366041b42 => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:23.183703 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f901c5d-06c0-49c0-b9dc-1b01d3356550 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:23.184402 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f901c5d-06c0-49c0-b9dc-1b01d3356550 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:23.184402 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f901c5d-06c0-49c0-b9dc-1b01d3356550 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:23.186645 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 124/246] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:23.194360 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3d9a3-f186-4534-9c47-1706011bf990 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:23.194870 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3d9a3-f186-4534-9c47-1706011bf990 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:23.195042 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3d9a3-f186-4534-9c47-1706011bf990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:23.216017 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-98c3d9a3-f186-4534-9c47-1706011bf990 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:23.217211 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-98c3d9a3-f186-4534-9c47-1706011bf990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:23.230113 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 123/247] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:26:23.260392 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f901c5d-06c0-49c0-b9dc-1b01d3356550 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:23.277770 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f901c5d-06c0-49c0-b9dc-1b01d3356550 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:23.287377 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6e948-7c5b-4498-92ea-456b13b37f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:23.288206 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6e948-7c5b-4498-92ea-456b13b37f1a admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:23.288491 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6e948-7c5b-4498-92ea-456b13b37f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:23.288773 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6e948-7c5b-4498-92ea-456b13b37f1a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:23.301610 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6e948-7c5b-4498-92ea-456b13b37f1a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:23.309551 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-10d6e948-7c5b-4498-92ea-456b13b37f1a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 03:26:23.311081 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 125/248] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Oct 15 03:26:23 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:23.317589 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3d9a3-f186-4534-9c47-1706011bf990 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:23.328834 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3d9a3-f186-4534-9c47-1706011bf990 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:23.335984 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d95539-6b20-4af6-bb79-1fdd7607c617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:23.337291 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d95539-6b20-4af6-bb79-1fdd7607c617 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:23.337580 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d95539-6b20-4af6-bb79-1fdd7607c617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:23.337859 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d95539-6b20-4af6-bb79-1fdd7607c617 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:23.338628 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d95539-6b20-4af6-bb79-1fdd7607c617 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:23.338992 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d95539-6b20-4af6-bb79-1fdd7607c617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:23.340693 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d95539-6b20-4af6-bb79-1fdd7607c617 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:23.356616 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 124/249] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:23 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:23.363196 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6e948-7c5b-4498-92ea-456b13b37f1a admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:23.373954 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6e948-7c5b-4498-92ea-456b13b37f1a admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:23.386952 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d1b18-45e9-49d1-b5bf-890f48a5c167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:23.387646 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d1b18-45e9-49d1-b5bf-890f48a5c167 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:23.388014 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d1b18-45e9-49d1-b5bf-890f48a5c167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:23.388343 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d1b18-45e9-49d1-b5bf-890f48a5c167 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:23.397124 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d1b18-45e9-49d1-b5bf-890f48a5c167 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:23.398935 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d1b18-45e9-49d1-b5bf-890f48a5c167 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:23.413773 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 126/250] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:23.420904 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d95539-6b20-4af6-bb79-1fdd7607c617 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:23.435184 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d95539-6b20-4af6-bb79-1fdd7607c617 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:23.442059 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cac936-03cf-4ab0-bdc6-193f16c1cc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:23.442915 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cac936-03cf-4ab0-bdc6-193f16c1cc44 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:23.443300 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cac936-03cf-4ab0-bdc6-193f16c1cc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:23.443584 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cac936-03cf-4ab0-bdc6-193f16c1cc44 admin admin] PATH_INFO: `/v3/projects/098453151f33456db2f118ed4fac105c` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:23.444914 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cac936-03cf-4ab0-bdc6-193f16c1cc44 admin admin] RBAC: Authorizing `identity:get_project(project_id=098453151f33456db2f118ed4fac105c)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:23.447653 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cac936-03cf-4ab0-bdc6-193f16c1cc44 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:23.449748 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 125/251] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:23 2021] GET /identity/v3/projects/098453151f33456db2f118ed4fac105c => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:23.455894 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d1b18-45e9-49d1-b5bf-890f48a5c167 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:23.468688 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d1b18-45e9-49d1-b5bf-890f48a5c167 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:23.475604 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6e72d-728c-4441-984a-d112d5a18b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:23.476690 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6e72d-728c-4441-984a-d112d5a18b8b admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:23.477169 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6e72d-728c-4441-984a-d112d5a18b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:23.477694 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6e72d-728c-4441-984a-d112d5a18b8b admin admin] PATH_INFO: `/v3/groups/d78b7e95b910411b9b9ebebb8ca315ad` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:23.480448 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6e72d-728c-4441-984a-d112d5a18b8b admin admin] RBAC: Authorizing `identity:get_group(group_id=d78b7e95b910411b9b9ebebb8ca315ad)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:23.482360 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6e72d-728c-4441-984a-d112d5a18b8b admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:23.484307 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 127/252] 10.222.0.30 () {56 vars in 1201 bytes} [Fri Oct 15 03:26:23 2021] GET /identity/v3/groups/d78b7e95b910411b9b9ebebb8ca315ad => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:23.490792 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cac936-03cf-4ab0-bdc6-193f16c1cc44 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:23.504131 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cac936-03cf-4ab0-bdc6-193f16c1cc44 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:23.511890 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2fa36-6b48-4a79-8c88-54e142dfbf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:23.512552 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2fa36-6b48-4a79-8c88-54e142dfbf20 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:23.512890 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2fa36-6b48-4a79-8c88-54e142dfbf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:23.513165 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2fa36-6b48-4a79-8c88-54e142dfbf20 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:23.514068 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2fa36-6b48-4a79-8c88-54e142dfbf20 admin admin] RBAC: Adding query filter params (group.id=d78b7e95b910411b9b9ebebb8ca315ad, role.id=3f958dcb5c7c413a9d9edd4ed05d20a2, scope.project.id=098453151f33456db2f118ed4fac105c) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:23.514381 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2fa36-6b48-4a79-8c88-54e142dfbf20 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:23.516442 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2fa36-6b48-4a79-8c88-54e142dfbf20 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:23.525790 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 126/253] 10.222.0.30 () {56 vars in 1397 bytes} [Fri Oct 15 03:26:23 2021] GET /identity/v3/role_assignments?group.id=d78b7e95b910411b9b9ebebb8ca315ad&scope.project.id=098453151f33456db2f118ed4fac105c&role.id=3f958dcb5c7c413a9d9edd4ed05d20a2 => generated 260 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:23.811091 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc4fed-cdf8-4fbd-923d-525bff03f840 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:23.811459 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc4fed-cdf8-4fbd-923d-525bff03f840 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:23.811649 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc4fed-cdf8-4fbd-923d-525bff03f840 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:23.813771 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 128/254] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:23.819715 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20861e5-e590-4153-b313-75227caad311 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:23.820036 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20861e5-e590-4153-b313-75227caad311 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:23.820315 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20861e5-e590-4153-b313-75227caad311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:23.844781 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-e20861e5-e590-4153-b313-75227caad311 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:23.845996 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e20861e5-e590-4153-b313-75227caad311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:23.857986 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 127/255] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:23.884209 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc4fed-cdf8-4fbd-923d-525bff03f840 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:23.901744 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc4fed-cdf8-4fbd-923d-525bff03f840 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:23.906109 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed93dd-3af2-4da3-8e93-aa37931ece61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:23.906878 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed93dd-3af2-4da3-8e93-aa37931ece61 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:23.907155 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed93dd-3af2-4da3-8e93-aa37931ece61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:23.907428 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed93dd-3af2-4da3-8e93-aa37931ece61 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:23.923108 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed93dd-3af2-4da3-8e93-aa37931ece61 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:23.929963 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-e3ed93dd-3af2-4da3-8e93-aa37931ece61 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 03:26:23.931936 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 129/256] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:23.938149 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20861e5-e590-4153-b313-75227caad311 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:23.947928 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20861e5-e590-4153-b313-75227caad311 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:23.952352 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be5d6e-4b3f-42df-9826-606df1d7835e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:23.953007 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be5d6e-4b3f-42df-9826-606df1d7835e admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:23.953284 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be5d6e-4b3f-42df-9826-606df1d7835e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:23.953559 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be5d6e-4b3f-42df-9826-606df1d7835e admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:23.954310 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be5d6e-4b3f-42df-9826-606df1d7835e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:23.954607 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be5d6e-4b3f-42df-9826-606df1d7835e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:23.956241 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be5d6e-4b3f-42df-9826-606df1d7835e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:23.967561 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 128/257] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Oct 15 03:26:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:23.976761 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed93dd-3af2-4da3-8e93-aa37931ece61 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:23.986781 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed93dd-3af2-4da3-8e93-aa37931ece61 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:23.992306 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d989df-6381-4aa2-a110-fcbe7d83e141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:23.993548 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d989df-6381-4aa2-a110-fcbe7d83e141 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:23.993833 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d989df-6381-4aa2-a110-fcbe7d83e141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:23.994107 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d989df-6381-4aa2-a110-fcbe7d83e141 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:24.005021 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d989df-6381-4aa2-a110-fcbe7d83e141 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:24.006840 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d989df-6381-4aa2-a110-fcbe7d83e141 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:24.018094 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 130/258] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:24.024438 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be5d6e-4b3f-42df-9826-606df1d7835e admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:24.034467 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be5d6e-4b3f-42df-9826-606df1d7835e admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:24.042878 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddd6c0-4904-403d-af41-6515606d23c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:24.043801 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddd6c0-4904-403d-af41-6515606d23c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:24.044080 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddd6c0-4904-403d-af41-6515606d23c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:24.044356 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddd6c0-4904-403d-af41-6515606d23c0 admin admin] PATH_INFO: `/v3/projects/984f06ad9e80456fb94208662a6d8477` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:24.045574 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddd6c0-4904-403d-af41-6515606d23c0 admin admin] RBAC: Authorizing `identity:get_project(project_id=984f06ad9e80456fb94208662a6d8477)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:24.047827 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddd6c0-4904-403d-af41-6515606d23c0 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:24.049765 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 129/259] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:24 2021] GET /identity/v3/projects/984f06ad9e80456fb94208662a6d8477 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:24.056417 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d989df-6381-4aa2-a110-fcbe7d83e141 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:24.069018 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d989df-6381-4aa2-a110-fcbe7d83e141 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:24.074477 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72404e71-d799-4bd1-b271-812204b99fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:24.075365 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72404e71-d799-4bd1-b271-812204b99fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:24.075648 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72404e71-d799-4bd1-b271-812204b99fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:24.075967 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72404e71-d799-4bd1-b271-812204b99fa2 admin admin] PATH_INFO: `/v3/groups/d78b7e95b910411b9b9ebebb8ca315ad` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:24.077198 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72404e71-d799-4bd1-b271-812204b99fa2 admin admin] RBAC: Authorizing `identity:get_group(group_id=d78b7e95b910411b9b9ebebb8ca315ad)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:24.079210 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72404e71-d799-4bd1-b271-812204b99fa2 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:24.080840 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 131/260] 10.222.0.30 () {56 vars in 1201 bytes} [Fri Oct 15 03:26:24 2021] GET /identity/v3/groups/d78b7e95b910411b9b9ebebb8ca315ad => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:24.087907 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddd6c0-4904-403d-af41-6515606d23c0 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:24.097982 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddd6c0-4904-403d-af41-6515606d23c0 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:24.107498 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50157dc2-1475-41dc-9407-ed1566d49f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:24.108172 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50157dc2-1475-41dc-9407-ed1566d49f65 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:24.108496 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50157dc2-1475-41dc-9407-ed1566d49f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:24.108773 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50157dc2-1475-41dc-9407-ed1566d49f65 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:24.109617 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50157dc2-1475-41dc-9407-ed1566d49f65 admin admin] RBAC: Adding query filter params (group.id=d78b7e95b910411b9b9ebebb8ca315ad, role.id=ee5acd2d5378499bb27dc24366041b42, scope.project.id=984f06ad9e80456fb94208662a6d8477) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:24.109971 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50157dc2-1475-41dc-9407-ed1566d49f65 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:24.112502 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50157dc2-1475-41dc-9407-ed1566d49f65 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:24.119269 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 130/261] 10.222.0.30 () {56 vars in 1397 bytes} [Fri Oct 15 03:26:24 2021] GET /identity/v3/role_assignments?group.id=d78b7e95b910411b9b9ebebb8ca315ad&scope.project.id=984f06ad9e80456fb94208662a6d8477&role.id=ee5acd2d5378499bb27dc24366041b42 => generated 260 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:24.499128 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4092eb-ac59-48b7-b8c2-45d9e7e50081 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:24.499806 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4092eb-ac59-48b7-b8c2-45d9e7e50081 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:24.499806 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4092eb-ac59-48b7-b8c2-45d9e7e50081 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:24.501543 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 132/262] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:24.507611 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b48f98-682c-4d6d-8a82-eb27057be75d None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:24.508127 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b48f98-682c-4d6d-8a82-eb27057be75d None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:24.508276 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b48f98-682c-4d6d-8a82-eb27057be75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:24.527833 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-a3b48f98-682c-4d6d-8a82-eb27057be75d None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:24.529030 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-a3b48f98-682c-4d6d-8a82-eb27057be75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:24.536996 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 131/263] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:26:24.561825 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4092eb-ac59-48b7-b8c2-45d9e7e50081 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:24.574656 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4092eb-ac59-48b7-b8c2-45d9e7e50081 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:24.579116 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745c2e6-be91-43af-bbcd-9c2edbfb4ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:24.579987 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745c2e6-be91-43af-bbcd-9c2edbfb4ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:24.580318 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745c2e6-be91-43af-bbcd-9c2edbfb4ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:24.580625 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745c2e6-be91-43af-bbcd-9c2edbfb4ab7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:24.591628 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745c2e6-be91-43af-bbcd-9c2edbfb4ab7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:24.595122 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ca229-b5e3-4dac-8ccf-111c52b57bdb None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:24.598492 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ca229-b5e3-4dac-8ccf-111c52b57bdb None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:24.598492 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ca229-b5e3-4dac-8ccf-111c52b57bdb None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:24.598492 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 132/264] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:26:24.601943 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-3745c2e6-be91-43af-bbcd-9c2edbfb4ab7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:26:24.603625 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487987a5-8ed1-40c7-b10c-7a9b1919d08f None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:24.603871 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 133/265] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:26:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:24.604024 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487987a5-8ed1-40c7-b10c-7a9b1919d08f None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:24.604211 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487987a5-8ed1-40c7-b10c-7a9b1919d08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:24.622536 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745c2e6-be91-43af-bbcd-9c2edbfb4ab7 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:24.626820 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-487987a5-8ed1-40c7-b10c-7a9b1919d08f None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:24.628093 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-487987a5-8ed1-40c7-b10c-7a9b1919d08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:24.635835 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745c2e6-be91-43af-bbcd-9c2edbfb4ab7 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:24.641821 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 133/266] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:26:24.650975 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916de1f-6324-46e1-9648-701d0c0278e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:24.651723 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916de1f-6324-46e1-9648-701d0c0278e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:24.652014 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916de1f-6324-46e1-9648-701d0c0278e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:24.652290 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916de1f-6324-46e1-9648-701d0c0278e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:24.653112 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916de1f-6324-46e1-9648-701d0c0278e9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:24.653415 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916de1f-6324-46e1-9648-701d0c0278e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:24.655182 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916de1f-6324-46e1-9648-701d0c0278e9 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:24.668683 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 134/267] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:24.675444 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487987a5-8ed1-40c7-b10c-7a9b1919d08f None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:24.688859 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487987a5-8ed1-40c7-b10c-7a9b1919d08f None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:24.696695 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d299d-db3b-412b-aa37-17b3899b3243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:24.697338 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d299d-db3b-412b-aa37-17b3899b3243 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:24.697669 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d299d-db3b-412b-aa37-17b3899b3243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:24.697943 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d299d-db3b-412b-aa37-17b3899b3243 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:24.712156 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d299d-db3b-412b-aa37-17b3899b3243 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:24.713987 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d299d-db3b-412b-aa37-17b3899b3243 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:24.720738 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916de1f-6324-46e1-9648-701d0c0278e9 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:24.725965 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 134/268] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:24.734204 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d299d-db3b-412b-aa37-17b3899b3243 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:24.736841 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916de1f-6324-46e1-9648-701d0c0278e9 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:24.743813 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e4d0a-2a67-47f3-93f6-5ad16f4e898e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:24.744608 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e4d0a-2a67-47f3-93f6-5ad16f4e898e admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:24.744884 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e4d0a-2a67-47f3-93f6-5ad16f4e898e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:24.745162 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e4d0a-2a67-47f3-93f6-5ad16f4e898e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:24.753771 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d299d-db3b-412b-aa37-17b3899b3243 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:24.764022 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e1430-1238-45ab-9eec-0a1af9404325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:24.764877 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e1430-1238-45ab-9eec-0a1af9404325 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:24.765203 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e1430-1238-45ab-9eec-0a1af9404325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:24.765405 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e4d0a-2a67-47f3-93f6-5ad16f4e898e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:24.765507 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e1430-1238-45ab-9eec-0a1af9404325 admin admin] PATH_INFO: `/v3/projects/38d38c962f4f466f9c11db2457ea0b1e` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:24.766733 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e1430-1238-45ab-9eec-0a1af9404325 admin admin] RBAC: Authorizing `identity:get_project(project_id=38d38c962f4f466f9c11db2457ea0b1e)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:24.768683 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e1430-1238-45ab-9eec-0a1af9404325 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:24.770734 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 135/269] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:24 2021] GET /identity/v3/projects/38d38c962f4f466f9c11db2457ea0b1e => generated 344 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:24.776726 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e1430-1238-45ab-9eec-0a1af9404325 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:24.781027 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-f74e4d0a-2a67-47f3-93f6-5ad16f4e898e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 03:26:24.782536 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 135/270] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Oct 15 03:26:24 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:24.791908 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e1430-1238-45ab-9eec-0a1af9404325 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:24.795090 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e4d0a-2a67-47f3-93f6-5ad16f4e898e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:24.797874 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffaa87e-0837-4663-8881-1c68ad90e2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:24.798768 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaa87e-0837-4663-8881-1c68ad90e2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:24.799057 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaa87e-0837-4663-8881-1c68ad90e2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:24.799334 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaa87e-0837-4663-8881-1c68ad90e2d4 admin admin] PATH_INFO: `/v3/groups/abc6d36e366a491b9cb1764b780ab1f9` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:24.805219 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e4d0a-2a67-47f3-93f6-5ad16f4e898e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:24.812430 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffaa87e-0837-4663-8881-1c68ad90e2d4 admin admin] RBAC: Authorizing `identity:get_group(group_id=abc6d36e366a491b9cb1764b780ab1f9)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:24.813981 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING py.warnings [None req-6ffaa87e-0837-4663-8881-1c68ad90e2d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:26:24.813981 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: warnings.warn(msg) Oct 15 03:26:24.813981 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: Oct 15 03:26:24.817314 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffaa87e-0837-4663-8881-1c68ad90e2d4 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:24.818660 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37b669-07da-469c-8010-e7c1514e8292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:24.820244 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37b669-07da-469c-8010-e7c1514e8292 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:24.821777 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37b669-07da-469c-8010-e7c1514e8292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:24.822804 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 136/271] 10.222.0.30 () {56 vars in 1201 bytes} [Fri Oct 15 03:26:24 2021] GET /identity/v3/groups/abc6d36e366a491b9cb1764b780ab1f9 => generated 229 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:24.823296 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37b669-07da-469c-8010-e7c1514e8292 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:24.828391 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37b669-07da-469c-8010-e7c1514e8292 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:24.828856 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37b669-07da-469c-8010-e7c1514e8292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:24.830663 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37b669-07da-469c-8010-e7c1514e8292 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:24.840704 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 136/272] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:24 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:24.842429 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffaa87e-0837-4663-8881-1c68ad90e2d4 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:24.853694 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffaa87e-0837-4663-8881-1c68ad90e2d4 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:24.860298 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700c3ed-e9bb-4dfe-9031-5fc7ced7750d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:24.861113 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700c3ed-e9bb-4dfe-9031-5fc7ced7750d admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:24.861594 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700c3ed-e9bb-4dfe-9031-5fc7ced7750d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:24.862028 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700c3ed-e9bb-4dfe-9031-5fc7ced7750d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:24.863079 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700c3ed-e9bb-4dfe-9031-5fc7ced7750d admin admin] RBAC: Adding query filter params (group.id=abc6d36e366a491b9cb1764b780ab1f9, role.id=15ba70b0cba04962a6d0b80b50c07004, scope.project.id=38d38c962f4f466f9c11db2457ea0b1e) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:24.863533 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700c3ed-e9bb-4dfe-9031-5fc7ced7750d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:24.865673 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700c3ed-e9bb-4dfe-9031-5fc7ced7750d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:24.871353 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37b669-07da-469c-8010-e7c1514e8292 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:24.881579 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37b669-07da-469c-8010-e7c1514e8292 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:24.885892 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 137/273] 10.222.0.30 () {56 vars in 1397 bytes} [Fri Oct 15 03:26:24 2021] GET /identity/v3/role_assignments?group.id=abc6d36e366a491b9cb1764b780ab1f9&scope.project.id=38d38c962f4f466f9c11db2457ea0b1e&role.id=15ba70b0cba04962a6d0b80b50c07004 => generated 260 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:24.897588 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280212e-dc9a-42bc-80b8-87d214753a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:24.898257 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280212e-dc9a-42bc-80b8-87d214753a79 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:24.898539 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280212e-dc9a-42bc-80b8-87d214753a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:24.898815 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280212e-dc9a-42bc-80b8-87d214753a79 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:24.911976 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c280212e-dc9a-42bc-80b8-87d214753a79 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:24.913781 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c280212e-dc9a-42bc-80b8-87d214753a79 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:24.931009 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 137/274] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:26:24.937365 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700c3ed-e9bb-4dfe-9031-5fc7ced7750d admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:24.958608 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700c3ed-e9bb-4dfe-9031-5fc7ced7750d admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:24.966318 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e92f7-41c6-4f08-94e6-3d5e93485191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:24.967415 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e92f7-41c6-4f08-94e6-3d5e93485191 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:24.967941 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e92f7-41c6-4f08-94e6-3d5e93485191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:24.968439 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e92f7-41c6-4f08-94e6-3d5e93485191 admin admin] PATH_INFO: `/v3/projects/984f06ad9e80456fb94208662a6d8477` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:24.972427 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e92f7-41c6-4f08-94e6-3d5e93485191 admin admin] RBAC: Authorizing `identity:get_project(project_id=984f06ad9e80456fb94208662a6d8477)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:24.975034 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e92f7-41c6-4f08-94e6-3d5e93485191 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:24.977803 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 138/275] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:24 2021] GET /identity/v3/projects/984f06ad9e80456fb94208662a6d8477 => generated 302 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:24.984122 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280212e-dc9a-42bc-80b8-87d214753a79 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:24.997837 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280212e-dc9a-42bc-80b8-87d214753a79 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:25.005439 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b40d8f-6c51-445b-9c6b-4245cc0b10e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:25.006215 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b40d8f-6c51-445b-9c6b-4245cc0b10e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:25.006487 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b40d8f-6c51-445b-9c6b-4245cc0b10e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:25.006754 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b40d8f-6c51-445b-9c6b-4245cc0b10e1 admin admin] PATH_INFO: `/v3/groups/d78b7e95b910411b9b9ebebb8ca315ad` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:25.007965 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b40d8f-6c51-445b-9c6b-4245cc0b10e1 admin admin] RBAC: Authorizing `identity:get_group(group_id=d78b7e95b910411b9b9ebebb8ca315ad)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:25.009919 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b40d8f-6c51-445b-9c6b-4245cc0b10e1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:25.011892 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 138/276] 10.222.0.30 () {56 vars in 1201 bytes} [Fri Oct 15 03:26:24 2021] GET /identity/v3/groups/d78b7e95b910411b9b9ebebb8ca315ad => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:25.018223 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e92f7-41c6-4f08-94e6-3d5e93485191 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:25.028975 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e92f7-41c6-4f08-94e6-3d5e93485191 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:25.033941 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf284d58-0040-4067-87ed-bd6a047a1307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:25.034892 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf284d58-0040-4067-87ed-bd6a047a1307 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:25.035380 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf284d58-0040-4067-87ed-bd6a047a1307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:25.035896 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf284d58-0040-4067-87ed-bd6a047a1307 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:25.037046 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf284d58-0040-4067-87ed-bd6a047a1307 admin admin] RBAC: Adding query filter params (group.id=d78b7e95b910411b9b9ebebb8ca315ad, role.id=3f958dcb5c7c413a9d9edd4ed05d20a2, scope.project.id=984f06ad9e80456fb94208662a6d8477) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:25.037615 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf284d58-0040-4067-87ed-bd6a047a1307 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:25.040385 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf284d58-0040-4067-87ed-bd6a047a1307 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:25.047287 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 139/277] 10.222.0.30 () {56 vars in 1397 bytes} [Fri Oct 15 03:26:25 2021] GET /identity/v3/role_assignments?group.id=d78b7e95b910411b9b9ebebb8ca315ad&scope.project.id=984f06ad9e80456fb94208662a6d8477&role.id=3f958dcb5c7c413a9d9edd4ed05d20a2 => generated 260 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:25.843004 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f85026-b70f-4cad-9716-079d212a83fd None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:25.843553 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f85026-b70f-4cad-9716-079d212a83fd None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:25.843553 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f85026-b70f-4cad-9716-079d212a83fd None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:25.845740 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 139/278] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:25.852752 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac4705-8f85-4add-bb01-c72adbf6902b None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:25.853178 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac4705-8f85-4add-bb01-c72adbf6902b None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:25.853393 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac4705-8f85-4add-bb01-c72adbf6902b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:25.876026 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-15ac4705-8f85-4add-bb01-c72adbf6902b None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:25.877216 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-15ac4705-8f85-4add-bb01-c72adbf6902b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:25.890167 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 140/279] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:26:25.928714 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f85026-b70f-4cad-9716-079d212a83fd None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:25.944324 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f85026-b70f-4cad-9716-079d212a83fd None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:25.952270 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b888c-55bd-4df9-87eb-366170dbf145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:25.953056 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b888c-55bd-4df9-87eb-366170dbf145 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:25.953339 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b888c-55bd-4df9-87eb-366170dbf145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:25.953611 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b888c-55bd-4df9-87eb-366170dbf145 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:25.968685 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b888c-55bd-4df9-87eb-366170dbf145 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:25.975877 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-836b888c-55bd-4df9-87eb-366170dbf145 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 03:26:25.977303 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 140/280] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:25 2021] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:25.983575 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac4705-8f85-4add-bb01-c72adbf6902b None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:25.994707 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac4705-8f85-4add-bb01-c72adbf6902b None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:26.003927 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca566d1-4a7b-4899-a07e-61525f1343ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:26.004903 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca566d1-4a7b-4899-a07e-61525f1343ba admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:26.005428 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca566d1-4a7b-4899-a07e-61525f1343ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:26.005898 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca566d1-4a7b-4899-a07e-61525f1343ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:26.006870 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca566d1-4a7b-4899-a07e-61525f1343ba admin admin] RBAC: Adding query filter params (name=member) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:26.007369 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca566d1-4a7b-4899-a07e-61525f1343ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:26.009753 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca566d1-4a7b-4899-a07e-61525f1343ba admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:26.023389 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 141/281] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Oct 15 03:26:25 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:26.030209 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b888c-55bd-4df9-87eb-366170dbf145 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:26.046040 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b888c-55bd-4df9-87eb-366170dbf145 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:26.057378 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad494c-9d3f-46a0-b062-409dcc777194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:26.058240 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad494c-9d3f-46a0-b062-409dcc777194 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:26.058522 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad494c-9d3f-46a0-b062-409dcc777194 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:26.058801 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad494c-9d3f-46a0-b062-409dcc777194 admin admin] PATH_INFO: `/v3/groups/d78b7e95b910411b9b9ebebb8ca315ad` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:26.060024 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad494c-9d3f-46a0-b062-409dcc777194 admin admin] RBAC: Authorizing `identity:get_group(group_id=d78b7e95b910411b9b9ebebb8ca315ad)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:26.061960 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad494c-9d3f-46a0-b062-409dcc777194 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:26.063914 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 141/282] 10.222.0.30 () {56 vars in 1201 bytes} [Fri Oct 15 03:26:26 2021] GET /identity/v3/groups/d78b7e95b910411b9b9ebebb8ca315ad => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:26.069698 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca566d1-4a7b-4899-a07e-61525f1343ba admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:26.080885 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca566d1-4a7b-4899-a07e-61525f1343ba admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:26.092179 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087c5f6-bc19-44d2-9fd8-6b6554bc1f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:26.093489 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087c5f6-bc19-44d2-9fd8-6b6554bc1f87 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:26.094015 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087c5f6-bc19-44d2-9fd8-6b6554bc1f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:26.094493 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087c5f6-bc19-44d2-9fd8-6b6554bc1f87 admin admin] PATH_INFO: `/v3/projects/098453151f33456db2f118ed4fac105c` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:26.096950 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087c5f6-bc19-44d2-9fd8-6b6554bc1f87 admin admin] RBAC: Authorizing `identity:get_project(project_id=098453151f33456db2f118ed4fac105c)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:26.099699 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087c5f6-bc19-44d2-9fd8-6b6554bc1f87 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:26.101672 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 142/283] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:26 2021] GET /identity/v3/projects/098453151f33456db2f118ed4fac105c => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:26.108937 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad494c-9d3f-46a0-b062-409dcc777194 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:26.121869 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad494c-9d3f-46a0-b062-409dcc777194 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:26.131733 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a7131-cb6b-4211-a35a-9ba441e68912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:26.132617 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a7131-cb6b-4211-a35a-9ba441e68912 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:26.132900 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a7131-cb6b-4211-a35a-9ba441e68912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:26.133179 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a7131-cb6b-4211-a35a-9ba441e68912 admin admin] PATH_INFO: `/v3/projects/098453151f33456db2f118ed4fac105c/groups/d78b7e95b910411b9b9ebebb8ca315ad/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:26.137571 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a7131-cb6b-4211-a35a-9ba441e68912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098453151f33456db2f118ed4fac105c, group_id=d78b7e95b910411b9b9ebebb8ca315ad, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:26.140282 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a7131-cb6b-4211-a35a-9ba441e68912 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:26.175400 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 142/284] 10.222.0.30 () {58 vars in 1463 bytes} [Fri Oct 15 03:26:26 2021] PUT /identity/v3/projects/098453151f33456db2f118ed4fac105c/groups/d78b7e95b910411b9b9ebebb8ca315ad/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:26:26.568758 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92840b8e-672b-4d27-8a35-1ac8c3d4543f None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:26.569465 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92840b8e-672b-4d27-8a35-1ac8c3d4543f None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:26.569951 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92840b8e-672b-4d27-8a35-1ac8c3d4543f None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:26.572514 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 143/285] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:26.578751 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0ab1f-e2cb-4328-9eeb-f5d8c7556a7d None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:26.579039 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0ab1f-e2cb-4328-9eeb-f5d8c7556a7d None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:26.579315 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0ab1f-e2cb-4328-9eeb-f5d8c7556a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:26.726374 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-a4b0ab1f-e2cb-4328-9eeb-f5d8c7556a7d None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:26.728395 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-a4b0ab1f-e2cb-4328-9eeb-f5d8c7556a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:26.811517 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 143/286] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:26.847926 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92840b8e-672b-4d27-8a35-1ac8c3d4543f None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:26.870169 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92840b8e-672b-4d27-8a35-1ac8c3d4543f None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:26.878095 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79c467-dfa0-444e-a462-c69545aa3ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:26.879165 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79c467-dfa0-444e-a462-c69545aa3ede admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:26.879652 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79c467-dfa0-444e-a462-c69545aa3ede admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:26.880151 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79c467-dfa0-444e-a462-c69545aa3ede admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:26.895118 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79c467-dfa0-444e-a462-c69545aa3ede admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:26.902689 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-6a79c467-dfa0-444e-a462-c69545aa3ede admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 03:26:26.904202 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 144/287] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Oct 15 03:26:26 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:26.910768 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0ab1f-e2cb-4328-9eeb-f5d8c7556a7d None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:26.920018 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0ab1f-e2cb-4328-9eeb-f5d8c7556a7d None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:26.929787 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a976bb3-b434-4ef1-92ff-774ab11981c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:26.930995 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a976bb3-b434-4ef1-92ff-774ab11981c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:26.931278 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a976bb3-b434-4ef1-92ff-774ab11981c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:26.931554 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a976bb3-b434-4ef1-92ff-774ab11981c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:26.932423 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a976bb3-b434-4ef1-92ff-774ab11981c8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:26.932727 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a976bb3-b434-4ef1-92ff-774ab11981c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:26.934331 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a976bb3-b434-4ef1-92ff-774ab11981c8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:26.947746 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 144/288] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:26 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:26.954107 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79c467-dfa0-444e-a462-c69545aa3ede admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:26.965793 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79c467-dfa0-444e-a462-c69545aa3ede admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:26.974687 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081523f-dc76-43de-b608-a6bcddbad300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:26.975936 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081523f-dc76-43de-b608-a6bcddbad300 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:26.976450 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081523f-dc76-43de-b608-a6bcddbad300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:26.976965 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081523f-dc76-43de-b608-a6bcddbad300 admin admin] PATH_INFO: `/v3/groups/d78b7e95b910411b9b9ebebb8ca315ad` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:26.979961 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081523f-dc76-43de-b608-a6bcddbad300 admin admin] RBAC: Authorizing `identity:get_group(group_id=d78b7e95b910411b9b9ebebb8ca315ad)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:26.982253 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081523f-dc76-43de-b608-a6bcddbad300 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:26.984513 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 145/289] 10.222.0.30 () {56 vars in 1201 bytes} [Fri Oct 15 03:26:26 2021] GET /identity/v3/groups/d78b7e95b910411b9b9ebebb8ca315ad => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:26.990338 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a976bb3-b434-4ef1-92ff-774ab11981c8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:27.005004 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a976bb3-b434-4ef1-92ff-774ab11981c8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:27.015322 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c56f9f-baeb-4b67-9010-2b239b249951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:27.016210 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c56f9f-baeb-4b67-9010-2b239b249951 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:27.016494 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c56f9f-baeb-4b67-9010-2b239b249951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:27.016775 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c56f9f-baeb-4b67-9010-2b239b249951 admin admin] PATH_INFO: `/v3/projects/098453151f33456db2f118ed4fac105c` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:27.020405 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c56f9f-baeb-4b67-9010-2b239b249951 admin admin] RBAC: Authorizing `identity:get_project(project_id=098453151f33456db2f118ed4fac105c)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:27.022674 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c56f9f-baeb-4b67-9010-2b239b249951 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:27.025108 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 145/290] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:26 2021] GET /identity/v3/projects/098453151f33456db2f118ed4fac105c => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:27.031205 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081523f-dc76-43de-b608-a6bcddbad300 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:27.042341 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081523f-dc76-43de-b608-a6bcddbad300 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:27.049725 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc766b-f68f-4444-9ec4-d0e217c2c616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:27.050874 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc766b-f68f-4444-9ec4-d0e217c2c616 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:27.051392 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc766b-f68f-4444-9ec4-d0e217c2c616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:27.051932 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc766b-f68f-4444-9ec4-d0e217c2c616 admin admin] PATH_INFO: `/v3/projects/098453151f33456db2f118ed4fac105c/groups/d78b7e95b910411b9b9ebebb8ca315ad/roles/3f958dcb5c7c413a9d9edd4ed05d20a2` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:27.056017 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc766b-f68f-4444-9ec4-d0e217c2c616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098453151f33456db2f118ed4fac105c, group_id=d78b7e95b910411b9b9ebebb8ca315ad, role_id=3f958dcb5c7c413a9d9edd4ed05d20a2)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:27.059085 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc766b-f68f-4444-9ec4-d0e217c2c616 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:27.084407 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 146/291] 10.222.0.30 () {58 vars in 1463 bytes} [Fri Oct 15 03:26:27 2021] PUT /identity/v3/projects/098453151f33456db2f118ed4fac105c/groups/d78b7e95b910411b9b9ebebb8ca315ad/roles/3f958dcb5c7c413a9d9edd4ed05d20a2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:26:27.504466 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7929d2f-7bee-413f-811e-f738fd6c30bc None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:27.504815 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7929d2f-7bee-413f-811e-f738fd6c30bc None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:27.504996 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7929d2f-7bee-413f-811e-f738fd6c30bc None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:27.506970 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 146/292] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:27.513340 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467951f5-9044-4250-a6d9-0a2387a23239 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:27.513630 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467951f5-9044-4250-a6d9-0a2387a23239 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:27.513910 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467951f5-9044-4250-a6d9-0a2387a23239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:27.536199 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-467951f5-9044-4250-a6d9-0a2387a23239 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:27.537427 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-467951f5-9044-4250-a6d9-0a2387a23239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:27.609261 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 147/293] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:27.640079 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7929d2f-7bee-413f-811e-f738fd6c30bc None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:27.658880 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7929d2f-7bee-413f-811e-f738fd6c30bc None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:27.664043 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41ff20-cc1c-42fc-a1ad-2e91bbafce90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:27.665413 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41ff20-cc1c-42fc-a1ad-2e91bbafce90 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:27.665696 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41ff20-cc1c-42fc-a1ad-2e91bbafce90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:27.665969 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41ff20-cc1c-42fc-a1ad-2e91bbafce90 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:27.678677 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41ff20-cc1c-42fc-a1ad-2e91bbafce90 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:27.682098 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef920a8-03b4-42ce-824a-6f2d8acacd0f None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:27.682382 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef920a8-03b4-42ce-824a-6f2d8acacd0f None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:27.682655 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef920a8-03b4-42ce-824a-6f2d8acacd0f None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:27.684612 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 148/294] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:27.690491 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce229d3e-61e2-49c8-b2b0-da4608947a0f None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:27.690777 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce229d3e-61e2-49c8-b2b0-da4608947a0f None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:27.691051 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce229d3e-61e2-49c8-b2b0-da4608947a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:27.691455 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-ca41ff20-cc1c-42fc-a1ad-2e91bbafce90 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 03:26:27.692735 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 147/295] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:27 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:27.699202 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41ff20-cc1c-42fc-a1ad-2e91bbafce90 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:27.711354 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41ff20-cc1c-42fc-a1ad-2e91bbafce90 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:27.718018 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186deff-debf-48fc-b541-b0cf5ceec17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:27.718706 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186deff-debf-48fc-b541-b0cf5ceec17c admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:27.719004 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186deff-debf-48fc-b541-b0cf5ceec17c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:27.719303 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186deff-debf-48fc-b541-b0cf5ceec17c admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:27.720183 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186deff-debf-48fc-b541-b0cf5ceec17c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:27.720695 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186deff-debf-48fc-b541-b0cf5ceec17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:27.722908 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186deff-debf-48fc-b541-b0cf5ceec17c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:27.733274 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 148/296] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Oct 15 03:26:27 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:27.739641 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186deff-debf-48fc-b541-b0cf5ceec17c admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:27.758498 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186deff-debf-48fc-b541-b0cf5ceec17c admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:27.778043 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf08c3-ad1e-4977-b64a-e9e92d342ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:27.778934 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf08c3-ad1e-4977-b64a-e9e92d342ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:27.779202 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf08c3-ad1e-4977-b64a-e9e92d342ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:27.779483 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf08c3-ad1e-4977-b64a-e9e92d342ba2 admin admin] PATH_INFO: `/v3/groups/d78b7e95b910411b9b9ebebb8ca315ad` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:27.780965 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf08c3-ad1e-4977-b64a-e9e92d342ba2 admin admin] RBAC: Authorizing `identity:get_group(group_id=d78b7e95b910411b9b9ebebb8ca315ad)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:27.782943 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf08c3-ad1e-4977-b64a-e9e92d342ba2 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:27.785054 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 149/297] 10.222.0.30 () {56 vars in 1201 bytes} [Fri Oct 15 03:26:27 2021] GET /identity/v3/groups/d78b7e95b910411b9b9ebebb8ca315ad => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:27.791345 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf08c3-ad1e-4977-b64a-e9e92d342ba2 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:27.810378 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf08c3-ad1e-4977-b64a-e9e92d342ba2 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:27.822445 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5180b-90c3-4b86-89d5-1c5cdbaf844f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:27.823311 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5180b-90c3-4b86-89d5-1c5cdbaf844f admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:27.823594 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5180b-90c3-4b86-89d5-1c5cdbaf844f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:27.823912 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5180b-90c3-4b86-89d5-1c5cdbaf844f admin admin] PATH_INFO: `/v3/projects/984f06ad9e80456fb94208662a6d8477` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:27.825255 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5180b-90c3-4b86-89d5-1c5cdbaf844f admin admin] RBAC: Authorizing `identity:get_project(project_id=984f06ad9e80456fb94208662a6d8477)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:27.827347 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5180b-90c3-4b86-89d5-1c5cdbaf844f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:27.829313 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 150/298] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:27 2021] GET /identity/v3/projects/984f06ad9e80456fb94208662a6d8477 => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:27.835536 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5180b-90c3-4b86-89d5-1c5cdbaf844f admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:27.849907 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-ce229d3e-61e2-49c8-b2b0-da4608947a0f None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:27.851139 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-ce229d3e-61e2-49c8-b2b0-da4608947a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:27.854487 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5180b-90c3-4b86-89d5-1c5cdbaf844f admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:27.863270 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372492a3-8a90-4b4b-ac66-5b54fd9e3d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:27.864304 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372492a3-8a90-4b4b-ac66-5b54fd9e3d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:27.866209 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372492a3-8a90-4b4b-ac66-5b54fd9e3d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:27.866209 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372492a3-8a90-4b4b-ac66-5b54fd9e3d02 admin admin] PATH_INFO: `/v3/projects/984f06ad9e80456fb94208662a6d8477/groups/d78b7e95b910411b9b9ebebb8ca315ad/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:27.866523 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 149/299] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:26:27.873038 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372492a3-8a90-4b4b-ac66-5b54fd9e3d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=984f06ad9e80456fb94208662a6d8477, group_id=d78b7e95b910411b9b9ebebb8ca315ad, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:27.875714 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372492a3-8a90-4b4b-ac66-5b54fd9e3d02 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:27.902251 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce229d3e-61e2-49c8-b2b0-da4608947a0f None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:27.904896 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 151/300] 10.222.0.30 () {58 vars in 1463 bytes} [Fri Oct 15 03:26:27 2021] PUT /identity/v3/projects/984f06ad9e80456fb94208662a6d8477/groups/d78b7e95b910411b9b9ebebb8ca315ad/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:26:27.913173 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce229d3e-61e2-49c8-b2b0-da4608947a0f None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:28.000158 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48fa07-9277-48e3-bc03-a1118bdb4fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:28.001388 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48fa07-9277-48e3-bc03-a1118bdb4fac admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:28.001952 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48fa07-9277-48e3-bc03-a1118bdb4fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:28.002447 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48fa07-9277-48e3-bc03-a1118bdb4fac admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:28.021807 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48fa07-9277-48e3-bc03-a1118bdb4fac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:28.030376 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-1b48fa07-9277-48e3-bc03-a1118bdb4fac admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 03:26:28.036050 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 150/301] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Oct 15 03:26:27 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 135 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:28.043323 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372492a3-8a90-4b4b-ac66-5b54fd9e3d02 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:28.066328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372492a3-8a90-4b4b-ac66-5b54fd9e3d02 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:28.080485 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77e379-56eb-4a96-8fef-c938bc85d89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:28.081189 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e379-56eb-4a96-8fef-c938bc85d89a admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:28.081476 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e379-56eb-4a96-8fef-c938bc85d89a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:28.081755 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e379-56eb-4a96-8fef-c938bc85d89a admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:28.082547 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77e379-56eb-4a96-8fef-c938bc85d89a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:28.082856 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77e379-56eb-4a96-8fef-c938bc85d89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:28.084666 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77e379-56eb-4a96-8fef-c938bc85d89a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:28.093996 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 152/302] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:28 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:28.100578 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48fa07-9277-48e3-bc03-a1118bdb4fac admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:28.113081 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48fa07-9277-48e3-bc03-a1118bdb4fac admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:28.119745 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62535cb-f6e4-4e8a-bfd6-7a8cbd73dbfa None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:28.119745 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62535cb-f6e4-4e8a-bfd6-7a8cbd73dbfa None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:28.119745 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62535cb-f6e4-4e8a-bfd6-7a8cbd73dbfa None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:28.121513 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 153/303] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:28 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:28.125181 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4988b2b-8fd4-4e54-a5c8-40e086fc6f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:28.126374 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4988b2b-8fd4-4e54-a5c8-40e086fc6f3b admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:28.126930 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4988b2b-8fd4-4e54-a5c8-40e086fc6f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:28.127410 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4988b2b-8fd4-4e54-a5c8-40e086fc6f3b admin admin] PATH_INFO: `/v3/groups/d78b7e95b910411b9b9ebebb8ca315ad` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:28.129520 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62056af-fbb9-4b3f-9d1f-f2412b485a24 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:28.129520 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62056af-fbb9-4b3f-9d1f-f2412b485a24 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:28.129520 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62056af-fbb9-4b3f-9d1f-f2412b485a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:28.130644 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4988b2b-8fd4-4e54-a5c8-40e086fc6f3b admin admin] RBAC: Authorizing `identity:get_group(group_id=d78b7e95b910411b9b9ebebb8ca315ad)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:28.133037 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4988b2b-8fd4-4e54-a5c8-40e086fc6f3b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:28.135945 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 151/304] 10.222.0.30 () {56 vars in 1201 bytes} [Fri Oct 15 03:26:28 2021] GET /identity/v3/groups/d78b7e95b910411b9b9ebebb8ca315ad => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:28.141866 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4988b2b-8fd4-4e54-a5c8-40e086fc6f3b admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:28.149796 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-a62056af-fbb9-4b3f-9d1f-f2412b485a24 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:28.151111 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-a62056af-fbb9-4b3f-9d1f-f2412b485a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:28.153401 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4988b2b-8fd4-4e54-a5c8-40e086fc6f3b admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:28.165612 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 154/305] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:26:28.172448 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfdb6f-4073-460a-a84d-9c32e040586a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:28.173326 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfdb6f-4073-460a-a84d-9c32e040586a admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:28.173611 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfdb6f-4073-460a-a84d-9c32e040586a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:28.173880 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfdb6f-4073-460a-a84d-9c32e040586a admin admin] PATH_INFO: `/v3/projects/984f06ad9e80456fb94208662a6d8477` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:28.175198 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bfdb6f-4073-460a-a84d-9c32e040586a admin admin] RBAC: Authorizing `identity:get_project(project_id=984f06ad9e80456fb94208662a6d8477)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:28.177305 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bfdb6f-4073-460a-a84d-9c32e040586a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:28.179325 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 152/306] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:28 2021] GET /identity/v3/projects/984f06ad9e80456fb94208662a6d8477 => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:28.186019 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62056af-fbb9-4b3f-9d1f-f2412b485a24 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:28.195892 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62056af-fbb9-4b3f-9d1f-f2412b485a24 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:28.203670 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606d918-1b46-47f1-bfb5-93ef204282b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:28.204543 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606d918-1b46-47f1-bfb5-93ef204282b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:28.204821 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606d918-1b46-47f1-bfb5-93ef204282b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:28.205089 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606d918-1b46-47f1-bfb5-93ef204282b6 admin admin] PATH_INFO: `/v3/projects/984f06ad9e80456fb94208662a6d8477/groups/d78b7e95b910411b9b9ebebb8ca315ad/roles/3f958dcb5c7c413a9d9edd4ed05d20a2` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:28.207302 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606d918-1b46-47f1-bfb5-93ef204282b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=984f06ad9e80456fb94208662a6d8477, group_id=d78b7e95b910411b9b9ebebb8ca315ad, role_id=3f958dcb5c7c413a9d9edd4ed05d20a2)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:28.209970 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606d918-1b46-47f1-bfb5-93ef204282b6 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:28.220342 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfdb6f-4073-460a-a84d-9c32e040586a admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:28.234184 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfdb6f-4073-460a-a84d-9c32e040586a admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:28.251557 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 155/307] 10.222.0.30 () {58 vars in 1463 bytes} [Fri Oct 15 03:26:28 2021] PUT /identity/v3/projects/984f06ad9e80456fb94208662a6d8477/groups/d78b7e95b910411b9b9ebebb8ca315ad/roles/3f958dcb5c7c413a9d9edd4ed05d20a2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:26:28.310680 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91ee7a-d59b-4c8b-b55a-ed6e61052642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:28.311952 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91ee7a-d59b-4c8b-b55a-ed6e61052642 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:28.312440 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91ee7a-d59b-4c8b-b55a-ed6e61052642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:28.312974 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91ee7a-d59b-4c8b-b55a-ed6e61052642 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:28.329277 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91ee7a-d59b-4c8b-b55a-ed6e61052642 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:28.336815 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-4d91ee7a-d59b-4c8b-b55a-ed6e61052642 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:26:28.338537 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 153/308] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:26:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:28.344843 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606d918-1b46-47f1-bfb5-93ef204282b6 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:28.358543 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606d918-1b46-47f1-bfb5-93ef204282b6 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:28.364176 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbffef-27ba-45a7-82b0-dfa73205d874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:28.365097 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbffef-27ba-45a7-82b0-dfa73205d874 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:28.365647 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbffef-27ba-45a7-82b0-dfa73205d874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:28.366166 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbffef-27ba-45a7-82b0-dfa73205d874 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:28.367127 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbffef-27ba-45a7-82b0-dfa73205d874 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:28.368270 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbffef-27ba-45a7-82b0-dfa73205d874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:28.370159 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbffef-27ba-45a7-82b0-dfa73205d874 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:28.384658 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 156/309] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:28 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:28.390652 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91ee7a-d59b-4c8b-b55a-ed6e61052642 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:28.401411 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91ee7a-d59b-4c8b-b55a-ed6e61052642 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:28.409364 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f08a6b-9538-45ae-a233-d777fd486f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:28.410605 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f08a6b-9538-45ae-a233-d777fd486f17 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:28.411085 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f08a6b-9538-45ae-a233-d777fd486f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:28.411583 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f08a6b-9538-45ae-a233-d777fd486f17 admin admin] PATH_INFO: `/v3/groups/abc6d36e366a491b9cb1764b780ab1f9` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:28.413053 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f08a6b-9538-45ae-a233-d777fd486f17 admin admin] RBAC: Authorizing `identity:get_group(group_id=abc6d36e366a491b9cb1764b780ab1f9)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:28.415377 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f08a6b-9538-45ae-a233-d777fd486f17 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:28.417218 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 154/310] 10.222.0.30 () {56 vars in 1201 bytes} [Fri Oct 15 03:26:28 2021] GET /identity/v3/groups/abc6d36e366a491b9cb1764b780ab1f9 => generated 229 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:28.423870 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbffef-27ba-45a7-82b0-dfa73205d874 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:28.434954 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbffef-27ba-45a7-82b0-dfa73205d874 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:28.444093 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fd4dd-bcf5-4c76-8c70-6f630916b817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:28.445341 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fd4dd-bcf5-4c76-8c70-6f630916b817 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:28.445851 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fd4dd-bcf5-4c76-8c70-6f630916b817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:28.446928 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fd4dd-bcf5-4c76-8c70-6f630916b817 admin admin] PATH_INFO: `/v3/projects/38d38c962f4f466f9c11db2457ea0b1e` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:28.448405 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fd4dd-bcf5-4c76-8c70-6f630916b817 admin admin] RBAC: Authorizing `identity:get_project(project_id=38d38c962f4f466f9c11db2457ea0b1e)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:28.450597 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fd4dd-bcf5-4c76-8c70-6f630916b817 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:28.452882 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 157/311] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:28 2021] GET /identity/v3/projects/38d38c962f4f466f9c11db2457ea0b1e => generated 344 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:28.458845 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f08a6b-9538-45ae-a233-d777fd486f17 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:28.471097 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f08a6b-9538-45ae-a233-d777fd486f17 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:28.479086 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d7064-ed93-42cd-b698-f4cb5fc52b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:28.480455 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d7064-ed93-42cd-b698-f4cb5fc52b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:28.480997 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d7064-ed93-42cd-b698-f4cb5fc52b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:28.481519 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d7064-ed93-42cd-b698-f4cb5fc52b20 admin admin] PATH_INFO: `/v3/projects/38d38c962f4f466f9c11db2457ea0b1e/groups/abc6d36e366a491b9cb1764b780ab1f9/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:28.484441 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d7064-ed93-42cd-b698-f4cb5fc52b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d38c962f4f466f9c11db2457ea0b1e, group_id=abc6d36e366a491b9cb1764b780ab1f9, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:28.487494 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d7064-ed93-42cd-b698-f4cb5fc52b20 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:28.515242 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 155/312] 10.222.0.30 () {58 vars in 1463 bytes} [Fri Oct 15 03:26:28 2021] PUT /identity/v3/projects/38d38c962f4f466f9c11db2457ea0b1e/groups/abc6d36e366a491b9cb1764b780ab1f9/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:26:29.176099 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d5ccc-4199-4b5e-bc32-a78ced8a7b0a None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:29.176614 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d5ccc-4199-4b5e-bc32-a78ced8a7b0a None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:29.176614 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d5ccc-4199-4b5e-bc32-a78ced8a7b0a None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:29.178473 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 158/313] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:29.189076 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62938ab3-d0be-4f56-88bb-10fb50eb2259 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:29.189483 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62938ab3-d0be-4f56-88bb-10fb50eb2259 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:29.189652 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62938ab3-d0be-4f56-88bb-10fb50eb2259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:29.212912 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-62938ab3-d0be-4f56-88bb-10fb50eb2259 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:29.214082 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-62938ab3-d0be-4f56-88bb-10fb50eb2259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:29.271647 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 156/314] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:29.294859 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d5ccc-4199-4b5e-bc32-a78ced8a7b0a None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:29.307691 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d5ccc-4199-4b5e-bc32-a78ced8a7b0a None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:29.311961 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5413b70-5dc6-4ceb-a51f-3a09ae446af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:29.312721 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5413b70-5dc6-4ceb-a51f-3a09ae446af6 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:29.312999 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5413b70-5dc6-4ceb-a51f-3a09ae446af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:29.313271 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5413b70-5dc6-4ceb-a51f-3a09ae446af6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:29.331494 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5413b70-5dc6-4ceb-a51f-3a09ae446af6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:29.338873 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-a5413b70-5dc6-4ceb-a51f-3a09ae446af6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 03:26:29.340366 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 159/315] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:29 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:29.346730 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62938ab3-d0be-4f56-88bb-10fb50eb2259 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:29.356441 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62938ab3-d0be-4f56-88bb-10fb50eb2259 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:29.361209 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89af72e-b266-478c-a987-12bdab6d156c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:29.361984 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89af72e-b266-478c-a987-12bdab6d156c admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:29.362267 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89af72e-b266-478c-a987-12bdab6d156c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:29.362538 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89af72e-b266-478c-a987-12bdab6d156c admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:29.363284 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89af72e-b266-478c-a987-12bdab6d156c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:29.363582 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89af72e-b266-478c-a987-12bdab6d156c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:29.365209 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89af72e-b266-478c-a987-12bdab6d156c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:29.374249 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 157/316] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Oct 15 03:26:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:29.380302 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5413b70-5dc6-4ceb-a51f-3a09ae446af6 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:29.395935 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5413b70-5dc6-4ceb-a51f-3a09ae446af6 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:29.402149 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03acb1-fe0d-40e3-8cdb-72a4197dce81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:29.402846 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03acb1-fe0d-40e3-8cdb-72a4197dce81 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:29.403173 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03acb1-fe0d-40e3-8cdb-72a4197dce81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:29.403449 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03acb1-fe0d-40e3-8cdb-72a4197dce81 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:29.416010 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03acb1-fe0d-40e3-8cdb-72a4197dce81 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:29.417894 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03acb1-fe0d-40e3-8cdb-72a4197dce81 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:29.429578 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 160/317] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:29 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:29.436594 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89af72e-b266-478c-a987-12bdab6d156c admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:29.448029 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89af72e-b266-478c-a987-12bdab6d156c admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:29.455657 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feef08-bfcd-41ac-898a-69b6745cd43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:29.456586 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feef08-bfcd-41ac-898a-69b6745cd43f admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:29.456862 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feef08-bfcd-41ac-898a-69b6745cd43f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:29.457135 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96feef08-bfcd-41ac-898a-69b6745cd43f admin admin] PATH_INFO: `/v3/projects/098453151f33456db2f118ed4fac105c` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:29.458395 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96feef08-bfcd-41ac-898a-69b6745cd43f admin admin] RBAC: Authorizing `identity:get_project(project_id=098453151f33456db2f118ed4fac105c)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:29.460718 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96feef08-bfcd-41ac-898a-69b6745cd43f admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:29.463168 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 158/318] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:29 2021] GET /identity/v3/projects/098453151f33456db2f118ed4fac105c => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:29.469463 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03acb1-fe0d-40e3-8cdb-72a4197dce81 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:29.484804 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03acb1-fe0d-40e3-8cdb-72a4197dce81 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:29.493707 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98912973-7553-4548-bef0-53edaa0ad150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:29.494537 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98912973-7553-4548-bef0-53edaa0ad150 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:29.494811 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98912973-7553-4548-bef0-53edaa0ad150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:29.495079 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98912973-7553-4548-bef0-53edaa0ad150 admin admin] PATH_INFO: `/v3/groups/d78b7e95b910411b9b9ebebb8ca315ad` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:29.496267 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98912973-7553-4548-bef0-53edaa0ad150 admin admin] RBAC: Authorizing `identity:get_group(group_id=d78b7e95b910411b9b9ebebb8ca315ad)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:29.498168 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98912973-7553-4548-bef0-53edaa0ad150 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:29.500067 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 161/319] 10.222.0.30 () {56 vars in 1201 bytes} [Fri Oct 15 03:26:29 2021] GET /identity/v3/groups/d78b7e95b910411b9b9ebebb8ca315ad => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:29.506312 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feef08-bfcd-41ac-898a-69b6745cd43f admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:29.520664 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96feef08-bfcd-41ac-898a-69b6745cd43f admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:29.525833 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f9af8-b3d3-41b9-bc1a-a72826cb4939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:29.526490 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f9af8-b3d3-41b9-bc1a-a72826cb4939 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:29.526769 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f9af8-b3d3-41b9-bc1a-a72826cb4939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:29.527044 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f9af8-b3d3-41b9-bc1a-a72826cb4939 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:29.527924 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f9af8-b3d3-41b9-bc1a-a72826cb4939 admin admin] RBAC: Adding query filter params (group.id=d78b7e95b910411b9b9ebebb8ca315ad, role.id=ee5acd2d5378499bb27dc24366041b42, scope.project.id=098453151f33456db2f118ed4fac105c) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:29.528233 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f9af8-b3d3-41b9-bc1a-a72826cb4939 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:29.530143 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f9af8-b3d3-41b9-bc1a-a72826cb4939 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:29.541488 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 159/320] 10.222.0.30 () {56 vars in 1397 bytes} [Fri Oct 15 03:26:29 2021] GET /identity/v3/role_assignments?group.id=d78b7e95b910411b9b9ebebb8ca315ad&scope.project.id=098453151f33456db2f118ed4fac105c&role.id=ee5acd2d5378499bb27dc24366041b42 => generated 611 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:30.137944 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab51a7-4e70-4180-b8b4-a51c36d9babc None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:30.138314 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab51a7-4e70-4180-b8b4-a51c36d9babc None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:30.138499 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab51a7-4e70-4180-b8b4-a51c36d9babc None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:30.140316 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 162/321] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:30.148749 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc2d38-cc94-4748-af7c-ce26adab5f29 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:30.149210 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc2d38-cc94-4748-af7c-ce26adab5f29 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:30.149702 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc2d38-cc94-4748-af7c-ce26adab5f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:30.173642 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-99dc2d38-cc94-4748-af7c-ce26adab5f29 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:30.174837 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-99dc2d38-cc94-4748-af7c-ce26adab5f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:30.185014 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 160/322] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:30.209648 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab51a7-4e70-4180-b8b4-a51c36d9babc None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:30.222551 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab51a7-4e70-4180-b8b4-a51c36d9babc None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:30.227708 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d698c4e-0431-4640-b471-f34df4ff5099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:30.228492 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d698c4e-0431-4640-b471-f34df4ff5099 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:30.228766 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d698c4e-0431-4640-b471-f34df4ff5099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:30.229030 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d698c4e-0431-4640-b471-f34df4ff5099 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:30.244152 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d698c4e-0431-4640-b471-f34df4ff5099 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:30.251556 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-8d698c4e-0431-4640-b471-f34df4ff5099 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 03:26:30.253108 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 163/323] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Oct 15 03:26:30 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:30.259883 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc2d38-cc94-4748-af7c-ce26adab5f29 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:30.269270 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc2d38-cc94-4748-af7c-ce26adab5f29 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:30.275105 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46043cc3-0dec-4d07-b9d3-5a185169c7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:30.275840 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46043cc3-0dec-4d07-b9d3-5a185169c7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:30.276118 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46043cc3-0dec-4d07-b9d3-5a185169c7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:30.276386 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46043cc3-0dec-4d07-b9d3-5a185169c7d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:30.277145 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46043cc3-0dec-4d07-b9d3-5a185169c7d3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:30.277445 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46043cc3-0dec-4d07-b9d3-5a185169c7d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:30.279036 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46043cc3-0dec-4d07-b9d3-5a185169c7d3 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:30.288143 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 161/324] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:30 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:30.294965 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d698c4e-0431-4640-b471-f34df4ff5099 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:30.304764 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d698c4e-0431-4640-b471-f34df4ff5099 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:30.309897 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289052c-01be-4fc5-9420-d49f1f33de81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:30.310534 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289052c-01be-4fc5-9420-d49f1f33de81 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:30.310813 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289052c-01be-4fc5-9420-d49f1f33de81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:30.311134 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289052c-01be-4fc5-9420-d49f1f33de81 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:30.321587 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289052c-01be-4fc5-9420-d49f1f33de81 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:30.323391 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289052c-01be-4fc5-9420-d49f1f33de81 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:30.332970 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 164/325] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:30.339778 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46043cc3-0dec-4d07-b9d3-5a185169c7d3 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:30.350074 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46043cc3-0dec-4d07-b9d3-5a185169c7d3 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:30.354589 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51195064-275b-4a31-b07f-6749699edd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:30.355477 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51195064-275b-4a31-b07f-6749699edd1a admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:30.355845 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51195064-275b-4a31-b07f-6749699edd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:30.356137 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51195064-275b-4a31-b07f-6749699edd1a admin admin] PATH_INFO: `/v3/projects/098453151f33456db2f118ed4fac105c` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:30.357573 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51195064-275b-4a31-b07f-6749699edd1a admin admin] RBAC: Authorizing `identity:get_project(project_id=098453151f33456db2f118ed4fac105c)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:30.362740 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51195064-275b-4a31-b07f-6749699edd1a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:30.366130 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 162/326] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:30 2021] GET /identity/v3/projects/098453151f33456db2f118ed4fac105c => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:30.372206 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289052c-01be-4fc5-9420-d49f1f33de81 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:30.381864 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289052c-01be-4fc5-9420-d49f1f33de81 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:30.386891 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ca34d-d15c-4b7c-bcf8-27ec22695845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:30.387802 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ca34d-d15c-4b7c-bcf8-27ec22695845 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:30.388134 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ca34d-d15c-4b7c-bcf8-27ec22695845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:30.388409 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ca34d-d15c-4b7c-bcf8-27ec22695845 admin admin] PATH_INFO: `/v3/groups/d78b7e95b910411b9b9ebebb8ca315ad` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:30.389622 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ca34d-d15c-4b7c-bcf8-27ec22695845 admin admin] RBAC: Authorizing `identity:get_group(group_id=d78b7e95b910411b9b9ebebb8ca315ad)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:30.391612 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ca34d-d15c-4b7c-bcf8-27ec22695845 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:30.393501 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 165/327] 10.222.0.30 () {56 vars in 1201 bytes} [Fri Oct 15 03:26:30 2021] GET /identity/v3/groups/d78b7e95b910411b9b9ebebb8ca315ad => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:30.400487 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51195064-275b-4a31-b07f-6749699edd1a admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:30.414956 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51195064-275b-4a31-b07f-6749699edd1a admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:30.420668 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4970ad7-946e-4cca-adb2-72c670602d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:30.421320 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4970ad7-946e-4cca-adb2-72c670602d12 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:30.421599 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4970ad7-946e-4cca-adb2-72c670602d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:30.421870 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4970ad7-946e-4cca-adb2-72c670602d12 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:30.422873 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4970ad7-946e-4cca-adb2-72c670602d12 admin admin] RBAC: Adding query filter params (group.id=d78b7e95b910411b9b9ebebb8ca315ad, role.id=3f958dcb5c7c413a9d9edd4ed05d20a2, scope.project.id=098453151f33456db2f118ed4fac105c) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:30.423187 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4970ad7-946e-4cca-adb2-72c670602d12 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:30.425403 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4970ad7-946e-4cca-adb2-72c670602d12 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:30.432973 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 163/328] 10.222.0.30 () {56 vars in 1397 bytes} [Fri Oct 15 03:26:30 2021] GET /identity/v3/role_assignments?group.id=d78b7e95b910411b9b9ebebb8ca315ad&scope.project.id=098453151f33456db2f118ed4fac105c&role.id=3f958dcb5c7c413a9d9edd4ed05d20a2 => generated 611 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:30.749945 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a129b-15ed-47bf-b382-d1d83c6fc4f9 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:30.750303 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a129b-15ed-47bf-b382-d1d83c6fc4f9 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:30.750499 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a129b-15ed-47bf-b382-d1d83c6fc4f9 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:30.752592 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 166/329] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:30.758373 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587be3c-6dc1-4f90-b90f-d10cd804a274 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:30.758660 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587be3c-6dc1-4f90-b90f-d10cd804a274 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:30.758940 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587be3c-6dc1-4f90-b90f-d10cd804a274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:30.779559 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-d587be3c-6dc1-4f90-b90f-d10cd804a274 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:30.781124 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d587be3c-6dc1-4f90-b90f-d10cd804a274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:30.791813 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 164/330] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:30.819586 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a129b-15ed-47bf-b382-d1d83c6fc4f9 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:30.833784 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a129b-15ed-47bf-b382-d1d83c6fc4f9 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:30.838849 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88363440-a10f-4e66-be6f-894e05810a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:30.839631 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88363440-a10f-4e66-be6f-894e05810a90 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:30.839938 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88363440-a10f-4e66-be6f-894e05810a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:30.840213 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88363440-a10f-4e66-be6f-894e05810a90 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:30.851595 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88363440-a10f-4e66-be6f-894e05810a90 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:30.859094 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-88363440-a10f-4e66-be6f-894e05810a90 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 15 03:26:30.860535 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 167/331] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:30 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:30.866954 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587be3c-6dc1-4f90-b90f-d10cd804a274 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:30.876711 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587be3c-6dc1-4f90-b90f-d10cd804a274 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:30.883189 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88e324-115c-4822-8eb3-3288e44ecdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:30.884471 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88e324-115c-4822-8eb3-3288e44ecdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:30.884740 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88e324-115c-4822-8eb3-3288e44ecdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:30.885014 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88e324-115c-4822-8eb3-3288e44ecdb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:30.885770 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88e324-115c-4822-8eb3-3288e44ecdb8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:30.886079 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88e324-115c-4822-8eb3-3288e44ecdb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:30.887720 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88e324-115c-4822-8eb3-3288e44ecdb8 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:30.897100 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 165/332] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Oct 15 03:26:30 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:30.903051 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88363440-a10f-4e66-be6f-894e05810a90 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:30.913823 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88363440-a10f-4e66-be6f-894e05810a90 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:30.918721 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9724a1d-a0e2-44c1-ad58-52c85d101575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:30.919350 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9724a1d-a0e2-44c1-ad58-52c85d101575 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:30.919628 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9724a1d-a0e2-44c1-ad58-52c85d101575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:30.919996 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9724a1d-a0e2-44c1-ad58-52c85d101575 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:30.928884 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9724a1d-a0e2-44c1-ad58-52c85d101575 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:30.931219 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9724a1d-a0e2-44c1-ad58-52c85d101575 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:30.940708 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 168/333] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:30.947502 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88e324-115c-4822-8eb3-3288e44ecdb8 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:30.959080 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88e324-115c-4822-8eb3-3288e44ecdb8 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:30.965276 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d90a7d-8e49-4cf2-817a-7c3458bf8438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:30.966393 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d90a7d-8e49-4cf2-817a-7c3458bf8438 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:30.966926 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d90a7d-8e49-4cf2-817a-7c3458bf8438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:30.967396 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d90a7d-8e49-4cf2-817a-7c3458bf8438 admin admin] PATH_INFO: `/v3/projects/984f06ad9e80456fb94208662a6d8477` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:30.968890 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d90a7d-8e49-4cf2-817a-7c3458bf8438 admin admin] RBAC: Authorizing `identity:get_project(project_id=984f06ad9e80456fb94208662a6d8477)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:30.970976 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d90a7d-8e49-4cf2-817a-7c3458bf8438 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:30.972904 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 166/334] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:30 2021] GET /identity/v3/projects/984f06ad9e80456fb94208662a6d8477 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:30.979527 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9724a1d-a0e2-44c1-ad58-52c85d101575 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:30.988953 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9724a1d-a0e2-44c1-ad58-52c85d101575 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:30.993898 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af452195-2dc6-44d5-a5c6-17f74b4be213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:30.994734 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af452195-2dc6-44d5-a5c6-17f74b4be213 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:30.995170 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af452195-2dc6-44d5-a5c6-17f74b4be213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:30.995449 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af452195-2dc6-44d5-a5c6-17f74b4be213 admin admin] PATH_INFO: `/v3/groups/d78b7e95b910411b9b9ebebb8ca315ad` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:30.999145 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af452195-2dc6-44d5-a5c6-17f74b4be213 admin admin] RBAC: Authorizing `identity:get_group(group_id=d78b7e95b910411b9b9ebebb8ca315ad)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:31.002226 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af452195-2dc6-44d5-a5c6-17f74b4be213 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:31.004052 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 169/335] 10.222.0.30 () {56 vars in 1201 bytes} [Fri Oct 15 03:26:30 2021] GET /identity/v3/groups/d78b7e95b910411b9b9ebebb8ca315ad => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:31.010360 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d90a7d-8e49-4cf2-817a-7c3458bf8438 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:31.020160 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d90a7d-8e49-4cf2-817a-7c3458bf8438 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:31.024492 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11c6d7-bc1e-47a2-87f9-687589c7fbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:31.025198 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11c6d7-bc1e-47a2-87f9-687589c7fbc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:31.025568 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11c6d7-bc1e-47a2-87f9-687589c7fbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:31.025913 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11c6d7-bc1e-47a2-87f9-687589c7fbc1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:31.026818 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11c6d7-bc1e-47a2-87f9-687589c7fbc1 admin admin] RBAC: Adding query filter params (group.id=d78b7e95b910411b9b9ebebb8ca315ad, role.id=ee5acd2d5378499bb27dc24366041b42, scope.project.id=984f06ad9e80456fb94208662a6d8477) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:31.027198 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11c6d7-bc1e-47a2-87f9-687589c7fbc1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:31.029158 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11c6d7-bc1e-47a2-87f9-687589c7fbc1 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:31.035406 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 167/336] 10.222.0.30 () {56 vars in 1397 bytes} [Fri Oct 15 03:26:31 2021] GET /identity/v3/role_assignments?group.id=d78b7e95b910411b9b9ebebb8ca315ad&scope.project.id=984f06ad9e80456fb94208662a6d8477&role.id=ee5acd2d5378499bb27dc24366041b42 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:31.200088 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88492eaa-05e7-4e5e-97e4-71a72379a59d None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:31.200452 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88492eaa-05e7-4e5e-97e4-71a72379a59d None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:31.200650 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88492eaa-05e7-4e5e-97e4-71a72379a59d None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:31.202620 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 170/337] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:31.208762 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbe046-731b-4709-ae08-b5545d8eaa96 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:31.209053 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbe046-731b-4709-ae08-b5545d8eaa96 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:31.209332 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbe046-731b-4709-ae08-b5545d8eaa96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:31.228288 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-e7dbe046-731b-4709-ae08-b5545d8eaa96 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:31.229506 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e7dbe046-731b-4709-ae08-b5545d8eaa96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:31.242613 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 168/338] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:31.269020 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88492eaa-05e7-4e5e-97e4-71a72379a59d None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:31.282372 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88492eaa-05e7-4e5e-97e4-71a72379a59d None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:31.286966 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4d0f6-8f77-4ccf-b740-f6dd02c3e4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:31.288034 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4d0f6-8f77-4ccf-b740-f6dd02c3e4ee admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:31.288512 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4d0f6-8f77-4ccf-b740-f6dd02c3e4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:31.288976 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4d0f6-8f77-4ccf-b740-f6dd02c3e4ee admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:31.299722 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4d0f6-8f77-4ccf-b740-f6dd02c3e4ee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:31.307499 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-a6b4d0f6-8f77-4ccf-b740-f6dd02c3e4ee admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 03:26:31.308914 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 171/339] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Oct 15 03:26:31 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:31.315263 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbe046-731b-4709-ae08-b5545d8eaa96 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:31.325022 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbe046-731b-4709-ae08-b5545d8eaa96 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:31.329486 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbba52-7e9f-402e-b9e3-98b01b691591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:31.330146 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbba52-7e9f-402e-b9e3-98b01b691591 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:31.330425 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbba52-7e9f-402e-b9e3-98b01b691591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:31.330697 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbba52-7e9f-402e-b9e3-98b01b691591 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:31.331480 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbba52-7e9f-402e-b9e3-98b01b691591 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:31.331887 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbba52-7e9f-402e-b9e3-98b01b691591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:31.333491 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbba52-7e9f-402e-b9e3-98b01b691591 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:31.342199 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 169/340] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:31 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:31.348298 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4d0f6-8f77-4ccf-b740-f6dd02c3e4ee admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:31.358360 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4d0f6-8f77-4ccf-b740-f6dd02c3e4ee admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:31.363104 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f090c-3fa9-4247-a017-84fb190f3fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:31.363749 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f090c-3fa9-4247-a017-84fb190f3fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:31.364029 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f090c-3fa9-4247-a017-84fb190f3fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:31.364298 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f090c-3fa9-4247-a017-84fb190f3fc9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:31.373405 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f090c-3fa9-4247-a017-84fb190f3fc9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:31.375350 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f090c-3fa9-4247-a017-84fb190f3fc9 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:31.387402 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd9fb9-f6d7-4d21-a32b-332e4ef85aa9 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:31.387732 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd9fb9-f6d7-4d21-a32b-332e4ef85aa9 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:31.388023 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd9fb9-f6d7-4d21-a32b-332e4ef85aa9 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:31.388401 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 172/341] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:26:31.389901 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 170/342] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:31.395552 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a2a3f-f55a-459a-96b2-0f8f8bca7cbc None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:31.396051 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a2a3f-f55a-459a-96b2-0f8f8bca7cbc None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:31.396215 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a2a3f-f55a-459a-96b2-0f8f8bca7cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:31.397244 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd9fb9-f6d7-4d21-a32b-332e4ef85aa9 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:31.409636 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd9fb9-f6d7-4d21-a32b-332e4ef85aa9 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:31.413720 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-988a2a3f-f55a-459a-96b2-0f8f8bca7cbc None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:31.414948 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-988a2a3f-f55a-459a-96b2-0f8f8bca7cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:31.415834 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02bcd2-4b43-40f8-873d-0cd345b7dab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:31.416759 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02bcd2-4b43-40f8-873d-0cd345b7dab9 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:31.417042 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02bcd2-4b43-40f8-873d-0cd345b7dab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:31.417315 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02bcd2-4b43-40f8-873d-0cd345b7dab9 admin admin] PATH_INFO: `/v3/projects/984f06ad9e80456fb94208662a6d8477` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:31.418481 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02bcd2-4b43-40f8-873d-0cd345b7dab9 admin admin] RBAC: Authorizing `identity:get_project(project_id=984f06ad9e80456fb94208662a6d8477)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:31.420605 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02bcd2-4b43-40f8-873d-0cd345b7dab9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:31.422472 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 173/343] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:26:31.423855 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 171/344] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:31 2021] GET /identity/v3/projects/984f06ad9e80456fb94208662a6d8477 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:31.431083 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a2a3f-f55a-459a-96b2-0f8f8bca7cbc None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:31.440604 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a2a3f-f55a-459a-96b2-0f8f8bca7cbc None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:31.447321 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b9477-2562-4ed4-9326-870f99e87835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:31.448331 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b9477-2562-4ed4-9326-870f99e87835 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:31.448614 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b9477-2562-4ed4-9326-870f99e87835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:31.448884 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b9477-2562-4ed4-9326-870f99e87835 admin admin] PATH_INFO: `/v3/groups/d78b7e95b910411b9b9ebebb8ca315ad` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:31.449845 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02bcd2-4b43-40f8-873d-0cd345b7dab9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:31.450114 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b9477-2562-4ed4-9326-870f99e87835 admin admin] RBAC: Authorizing `identity:get_group(group_id=d78b7e95b910411b9b9ebebb8ca315ad)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:31.452057 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b9477-2562-4ed4-9326-870f99e87835 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:31.453726 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 174/345] 10.222.0.30 () {56 vars in 1201 bytes} [Fri Oct 15 03:26:31 2021] GET /identity/v3/groups/d78b7e95b910411b9b9ebebb8ca315ad => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:31.460596 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02bcd2-4b43-40f8-873d-0cd345b7dab9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:31.462071 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b9477-2562-4ed4-9326-870f99e87835 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:31.465196 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7db2af-50cd-4a92-a0d1-6872ae9d4112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:31.465971 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7db2af-50cd-4a92-a0d1-6872ae9d4112 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:31.466251 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7db2af-50cd-4a92-a0d1-6872ae9d4112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:31.466522 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7db2af-50cd-4a92-a0d1-6872ae9d4112 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:31.471615 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b9477-2562-4ed4-9326-870f99e87835 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:31.477977 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bd3a7-9198-4b84-9aef-7c3755e66a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:31.478608 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bd3a7-9198-4b84-9aef-7c3755e66a40 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:31.478885 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bd3a7-9198-4b84-9aef-7c3755e66a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:31.479156 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bd3a7-9198-4b84-9aef-7c3755e66a40 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:31.480025 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721bd3a7-9198-4b84-9aef-7c3755e66a40 admin admin] RBAC: Adding query filter params (group.id=d78b7e95b910411b9b9ebebb8ca315ad, role.id=3f958dcb5c7c413a9d9edd4ed05d20a2, scope.project.id=984f06ad9e80456fb94208662a6d8477) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:31.480305 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7db2af-50cd-4a92-a0d1-6872ae9d4112 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:31.480413 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721bd3a7-9198-4b84-9aef-7c3755e66a40 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:31.482152 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721bd3a7-9198-4b84-9aef-7c3755e66a40 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:31.487074 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-ee7db2af-50cd-4a92-a0d1-6872ae9d4112 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:26:31.488169 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 175/346] 10.222.0.30 () {56 vars in 1397 bytes} [Fri Oct 15 03:26:31 2021] GET /identity/v3/role_assignments?group.id=d78b7e95b910411b9b9ebebb8ca315ad&scope.project.id=984f06ad9e80456fb94208662a6d8477&role.id=3f958dcb5c7c413a9d9edd4ed05d20a2 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:31.489032 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 172/347] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:26:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:31.495336 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bd3a7-9198-4b84-9aef-7c3755e66a40 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:31.505408 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bd3a7-9198-4b84-9aef-7c3755e66a40 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:31.510638 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787662d5-c0f0-44f3-8a91-1782059b1111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:31.511318 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787662d5-c0f0-44f3-8a91-1782059b1111 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:31.511600 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787662d5-c0f0-44f3-8a91-1782059b1111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:31.511908 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787662d5-c0f0-44f3-8a91-1782059b1111 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:31.512688 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787662d5-c0f0-44f3-8a91-1782059b1111 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:31.512993 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787662d5-c0f0-44f3-8a91-1782059b1111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:31.514638 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787662d5-c0f0-44f3-8a91-1782059b1111 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:31.524512 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 176/348] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:31.531029 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7db2af-50cd-4a92-a0d1-6872ae9d4112 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:31.542194 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7db2af-50cd-4a92-a0d1-6872ae9d4112 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:31.546784 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b87e36-2aa7-4ceb-af4c-ef535976fa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:31.547552 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b87e36-2aa7-4ceb-af4c-ef535976fa17 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:31.547901 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b87e36-2aa7-4ceb-af4c-ef535976fa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:31.548314 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b87e36-2aa7-4ceb-af4c-ef535976fa17 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:31.557762 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b87e36-2aa7-4ceb-af4c-ef535976fa17 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:31.559541 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b87e36-2aa7-4ceb-af4c-ef535976fa17 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:31.569373 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 173/349] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:31.576582 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787662d5-c0f0-44f3-8a91-1782059b1111 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:31.586497 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787662d5-c0f0-44f3-8a91-1782059b1111 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:31.590927 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b5883-1baf-4753-92ee-dcac33c51570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:31.591843 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b5883-1baf-4753-92ee-dcac33c51570 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:31.592128 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b5883-1baf-4753-92ee-dcac33c51570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:31.592404 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b5883-1baf-4753-92ee-dcac33c51570 admin admin] PATH_INFO: `/v3/projects/38d38c962f4f466f9c11db2457ea0b1e` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:31.593615 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b5883-1baf-4753-92ee-dcac33c51570 admin admin] RBAC: Authorizing `identity:get_project(project_id=38d38c962f4f466f9c11db2457ea0b1e)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:31.595421 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b5883-1baf-4753-92ee-dcac33c51570 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:31.597175 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 177/350] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:26:31 2021] GET /identity/v3/projects/38d38c962f4f466f9c11db2457ea0b1e => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:31.603811 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b87e36-2aa7-4ceb-af4c-ef535976fa17 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:31.613077 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b87e36-2aa7-4ceb-af4c-ef535976fa17 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:31.617530 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07ca15-9d57-4148-841e-eb4ce3a5eb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:31.618889 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07ca15-9d57-4148-841e-eb4ce3a5eb76 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:31.619167 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07ca15-9d57-4148-841e-eb4ce3a5eb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:31.619436 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07ca15-9d57-4148-841e-eb4ce3a5eb76 admin admin] PATH_INFO: `/v3/groups/abc6d36e366a491b9cb1764b780ab1f9` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:31.620667 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07ca15-9d57-4148-841e-eb4ce3a5eb76 admin admin] RBAC: Authorizing `identity:get_group(group_id=abc6d36e366a491b9cb1764b780ab1f9)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:31.622623 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07ca15-9d57-4148-841e-eb4ce3a5eb76 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:31.624287 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 174/351] 10.222.0.30 () {56 vars in 1201 bytes} [Fri Oct 15 03:26:31 2021] GET /identity/v3/groups/abc6d36e366a491b9cb1764b780ab1f9 => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:31.630874 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b5883-1baf-4753-92ee-dcac33c51570 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:31.641642 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b5883-1baf-4753-92ee-dcac33c51570 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:31.646075 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58da473-89cb-45cf-8dd7-3aca6f38d5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:31.646730 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58da473-89cb-45cf-8dd7-3aca6f38d5fd admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:31.647016 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58da473-89cb-45cf-8dd7-3aca6f38d5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:31.647288 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58da473-89cb-45cf-8dd7-3aca6f38d5fd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:31.648175 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58da473-89cb-45cf-8dd7-3aca6f38d5fd admin admin] RBAC: Adding query filter params (group.id=abc6d36e366a491b9cb1764b780ab1f9, role.id=15ba70b0cba04962a6d0b80b50c07004, scope.project.id=38d38c962f4f466f9c11db2457ea0b1e) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:31.648486 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58da473-89cb-45cf-8dd7-3aca6f38d5fd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:31.650875 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58da473-89cb-45cf-8dd7-3aca6f38d5fd admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:31.657350 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 178/352] 10.222.0.30 () {56 vars in 1397 bytes} [Fri Oct 15 03:26:31 2021] GET /identity/v3/role_assignments?group.id=abc6d36e366a491b9cb1764b780ab1f9&scope.project.id=38d38c962f4f466f9c11db2457ea0b1e&role.id=15ba70b0cba04962a6d0b80b50c07004 => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:34.425884 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fe804-73ae-457b-9216-dbe5649797b3 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:34.426897 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fe804-73ae-457b-9216-dbe5649797b3 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:34.427378 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fe804-73ae-457b-9216-dbe5649797b3 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:34.429645 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 175/353] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:34 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:34.435457 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac4247-5fd0-4ae9-a4d5-b41ae9cd7e0a None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:34.435971 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac4247-5fd0-4ae9-a4d5-b41ae9cd7e0a None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:34.436049 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac4247-5fd0-4ae9-a4d5-b41ae9cd7e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:34.460693 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-87ac4247-5fd0-4ae9-a4d5-b41ae9cd7e0a None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:34.461900 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-87ac4247-5fd0-4ae9-a4d5-b41ae9cd7e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:34.470396 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 179/354] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:34.499584 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fe804-73ae-457b-9216-dbe5649797b3 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:34.513828 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fe804-73ae-457b-9216-dbe5649797b3 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:34.523861 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32835ae-d4a3-4e6a-877f-4b86a24b73e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:34.524675 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32835ae-d4a3-4e6a-877f-4b86a24b73e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:34.524955 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32835ae-d4a3-4e6a-877f-4b86a24b73e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:34.525230 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32835ae-d4a3-4e6a-877f-4b86a24b73e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:34.543350 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32835ae-d4a3-4e6a-877f-4b86a24b73e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:34.545238 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32835ae-d4a3-4e6a-877f-4b86a24b73e6 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:34.568118 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-e32835ae-d4a3-4e6a-877f-4b86a24b73e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:34.569796 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 176/355] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:34.577088 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac4247-5fd0-4ae9-a4d5-b41ae9cd7e0a None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:34.594437 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac4247-5fd0-4ae9-a4d5-b41ae9cd7e0a None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:34.609273 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be3896-ca76-4aef-916f-02b91f591592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:34.609952 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be3896-ca76-4aef-916f-02b91f591592 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:34.610243 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be3896-ca76-4aef-916f-02b91f591592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:34.610519 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be3896-ca76-4aef-916f-02b91f591592 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:34.611269 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be3896-ca76-4aef-916f-02b91f591592 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:34.611575 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be3896-ca76-4aef-916f-02b91f591592 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:34.612610 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING py.warnings [None req-34be3896-ca76-4aef-916f-02b91f591592 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:26:34.612610 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: warnings.warn(msg) Oct 15 03:26:34.612610 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: Oct 15 03:26:34.613498 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be3896-ca76-4aef-916f-02b91f591592 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:34.639100 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 180/356] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:34.645341 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32835ae-d4a3-4e6a-877f-4b86a24b73e6 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:34.661359 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32835ae-d4a3-4e6a-877f-4b86a24b73e6 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:34.671812 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e01b19-ac5b-44dc-88ca-f74538dab62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:34.672740 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e01b19-ac5b-44dc-88ca-f74538dab62d admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:34.673218 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e01b19-ac5b-44dc-88ca-f74538dab62d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:34.673702 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e01b19-ac5b-44dc-88ca-f74538dab62d admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:34.674612 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e01b19-ac5b-44dc-88ca-f74538dab62d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:34.676768 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e01b19-ac5b-44dc-88ca-f74538dab62d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:34.719996 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 177/357] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Oct 15 03:26:34 2021] POST /identity/v3/users => generated 246 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:26:34.766945 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641c4cb-d449-488a-9e7d-26c02642f1ae None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:34.767125 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641c4cb-d449-488a-9e7d-26c02642f1ae None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:34.767410 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641c4cb-d449-488a-9e7d-26c02642f1ae None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:34.769288 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 181/358] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:34.776133 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c980d-fbe0-4568-9a0d-0d9c3bf511f4 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:34.776435 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c980d-fbe0-4568-9a0d-0d9c3bf511f4 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:34.776695 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c980d-fbe0-4568-9a0d-0d9c3bf511f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:34.800794 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-554c980d-fbe0-4568-9a0d-0d9c3bf511f4 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:34.802008 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-554c980d-fbe0-4568-9a0d-0d9c3bf511f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:34.810750 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 178/359] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:34.837896 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641c4cb-d449-488a-9e7d-26c02642f1ae None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:34.855770 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641c4cb-d449-488a-9e7d-26c02642f1ae None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:34.860819 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72502155-1275-465d-92cf-1e98fe21bae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:34.861953 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72502155-1275-465d-92cf-1e98fe21bae2 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:34.862463 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72502155-1275-465d-92cf-1e98fe21bae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:34.862954 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72502155-1275-465d-92cf-1e98fe21bae2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:34.878301 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72502155-1275-465d-92cf-1e98fe21bae2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:34.880609 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72502155-1275-465d-92cf-1e98fe21bae2 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:34.902618 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-72502155-1275-465d-92cf-1e98fe21bae2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:34.903040 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a97075-6e12-48ca-8aba-1925e6f4c213 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:34.903568 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a97075-6e12-48ca-8aba-1925e6f4c213 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:34.904066 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a97075-6e12-48ca-8aba-1925e6f4c213 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:34.904577 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 182/360] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:34.906288 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 179/361] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:26:34.910995 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72502155-1275-465d-92cf-1e98fe21bae2 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:34.916600 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc43b4-3410-4425-a5f7-84868d70932c None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:34.917180 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc43b4-3410-4425-a5f7-84868d70932c None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:34.917707 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc43b4-3410-4425-a5f7-84868d70932c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:34.926578 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72502155-1275-465d-92cf-1e98fe21bae2 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:34.944327 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ee528-68f9-435f-a317-a3b7a8107bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:34.945377 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ee528-68f9-435f-a317-a3b7a8107bcc admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:34.945857 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ee528-68f9-435f-a317-a3b7a8107bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:34.946327 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ee528-68f9-435f-a317-a3b7a8107bcc admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:34.947865 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ee528-68f9-435f-a317-a3b7a8107bcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:34.948397 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ee528-68f9-435f-a317-a3b7a8107bcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:34.950232 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ee528-68f9-435f-a317-a3b7a8107bcc admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:34.957694 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-d7cc43b4-3410-4425-a5f7-84868d70932c None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:34.965029 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d7cc43b4-3410-4425-a5f7-84868d70932c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:34.981692 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 180/363] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:34.982063 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 183/363] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:34.997009 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc43b4-3410-4425-a5f7-84868d70932c None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:35.007372 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc43b4-3410-4425-a5f7-84868d70932c None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:35.016549 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d8b8b-9fd5-49ba-bf74-30da327aed22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:35.017699 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d8b8b-9fd5-49ba-bf74-30da327aed22 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:35.018199 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d8b8b-9fd5-49ba-bf74-30da327aed22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:35.019632 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ee528-68f9-435f-a317-a3b7a8107bcc admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:35.030541 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ee528-68f9-435f-a317-a3b7a8107bcc admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:35.031264 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d8b8b-9fd5-49ba-bf74-30da327aed22 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:35.032307 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d8b8b-9fd5-49ba-bf74-30da327aed22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:35.034501 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d8b8b-9fd5-49ba-bf74-30da327aed22 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:35.046682 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7d2c9-402b-4c2a-ab26-3a14d1f81d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:35.047899 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7d2c9-402b-4c2a-ab26-3a14d1f81d41 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:35.048380 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7d2c9-402b-4c2a-ab26-3a14d1f81d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:35.048848 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7d2c9-402b-4c2a-ab26-3a14d1f81d41 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:35.067013 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7d2c9-402b-4c2a-ab26-3a14d1f81d41 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:35.069407 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7d2c9-402b-4c2a-ab26-3a14d1f81d41 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:35.087418 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 181/364] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Oct 15 03:26:34 2021] POST /identity/v3/users => generated 248 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:26:35.101914 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-08e7d2c9-402b-4c2a-ab26-3a14d1f81d41 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:35.103897 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 184/365] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:35.110450 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d8b8b-9fd5-49ba-bf74-30da327aed22 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:35.121570 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d8b8b-9fd5-49ba-bf74-30da327aed22 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:35.126290 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a206d2c-1eb8-4c41-b448-53491693209e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:35.127033 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a206d2c-1eb8-4c41-b448-53491693209e admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:35.127259 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a206d2c-1eb8-4c41-b448-53491693209e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:35.127540 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a206d2c-1eb8-4c41-b448-53491693209e admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:35.128619 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a206d2c-1eb8-4c41-b448-53491693209e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:35.128932 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a206d2c-1eb8-4c41-b448-53491693209e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:35.130555 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a206d2c-1eb8-4c41-b448-53491693209e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:35.151906 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 182/366] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:35.158099 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7d2c9-402b-4c2a-ab26-3a14d1f81d41 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:35.169892 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7d2c9-402b-4c2a-ab26-3a14d1f81d41 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:35.174845 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc657bd-349a-4604-8354-fd0a7b1fec9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:35.175530 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc657bd-349a-4604-8354-fd0a7b1fec9a admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:35.175840 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc657bd-349a-4604-8354-fd0a7b1fec9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:35.178248 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06496b78-de85-4e58-8a91-f199d32fad4e None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:35.178553 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06496b78-de85-4e58-8a91-f199d32fad4e None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:35.178804 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06496b78-de85-4e58-8a91-f199d32fad4e None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:35.181104 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc657bd-349a-4604-8354-fd0a7b1fec9a admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:35.181238 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 183/367] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:26:35.181340 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc657bd-349a-4604-8354-fd0a7b1fec9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:35.183069 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc657bd-349a-4604-8354-fd0a7b1fec9a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:35.189478 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a6812-23a1-4e50-9d8d-cea161ced6bb None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:35.190046 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a6812-23a1-4e50-9d8d-cea161ced6bb None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:35.190496 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a6812-23a1-4e50-9d8d-cea161ced6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:35.214087 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 185/368] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Oct 15 03:26:35 2021] POST /identity/v3/users => generated 248 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:26:35.218145 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-903a6812-23a1-4e50-9d8d-cea161ced6bb None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:35.219779 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-903a6812-23a1-4e50-9d8d-cea161ced6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:35.235906 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 184/369] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:26:35.258273 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc657bd-349a-4604-8354-fd0a7b1fec9a admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:35.271909 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc657bd-349a-4604-8354-fd0a7b1fec9a admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:35.277306 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d2d86-52ab-4efa-8103-513e8fe123fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:35.278159 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d2d86-52ab-4efa-8103-513e8fe123fb admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:35.278444 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d2d86-52ab-4efa-8103-513e8fe123fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:35.278714 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d2d86-52ab-4efa-8103-513e8fe123fb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:35.293239 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d2d86-52ab-4efa-8103-513e8fe123fb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:35.297388 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d2d86-52ab-4efa-8103-513e8fe123fb admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:35.319195 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-346d2d86-52ab-4efa-8103-513e8fe123fb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:35.321066 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 186/370] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:35.328197 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a6812-23a1-4e50-9d8d-cea161ced6bb None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:35.338473 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a6812-23a1-4e50-9d8d-cea161ced6bb None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:35.343361 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc5599-920b-4218-8f71-c726fefce1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:35.344131 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc5599-920b-4218-8f71-c726fefce1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:35.344463 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc5599-920b-4218-8f71-c726fefce1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:35.344740 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc5599-920b-4218-8f71-c726fefce1e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:35.345540 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc5599-920b-4218-8f71-c726fefce1e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:35.345843 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc5599-920b-4218-8f71-c726fefce1e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:35.347532 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc5599-920b-4218-8f71-c726fefce1e8 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:35.361275 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 185/371] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:35.368053 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d2d86-52ab-4efa-8103-513e8fe123fb admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:35.379373 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d2d86-52ab-4efa-8103-513e8fe123fb admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:35.386954 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086128c-b49b-4bf7-9c4f-5aaf93fd928a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:35.387727 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086128c-b49b-4bf7-9c4f-5aaf93fd928a admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:35.388002 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086128c-b49b-4bf7-9c4f-5aaf93fd928a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:35.388274 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086128c-b49b-4bf7-9c4f-5aaf93fd928a admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:35.389066 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086128c-b49b-4bf7-9c4f-5aaf93fd928a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:35.391191 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086128c-b49b-4bf7-9c4f-5aaf93fd928a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:35.419740 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 187/372] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Oct 15 03:26:35 2021] POST /identity/v3/users => generated 249 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:26:36.269907 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebc79d-4979-4a5b-975e-a97fc26321a9 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:36.270903 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebc79d-4979-4a5b-975e-a97fc26321a9 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:36.271385 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebc79d-4979-4a5b-975e-a97fc26321a9 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:36.273718 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 186/373] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:36.279565 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b4034-ba7c-4651-b10a-2141babca0ee None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:36.280424 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b4034-ba7c-4651-b10a-2141babca0ee None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:36.280934 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b4034-ba7c-4651-b10a-2141babca0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:36.303711 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-024b4034-ba7c-4651-b10a-2141babca0ee None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:36.305227 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-024b4034-ba7c-4651-b10a-2141babca0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:36.317745 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 188/374] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:26:36.358192 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebc79d-4979-4a5b-975e-a97fc26321a9 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:36.373897 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebc79d-4979-4a5b-975e-a97fc26321a9 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:36.378411 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426da795-c673-4331-a456-d0da8e25c4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:36.379286 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426da795-c673-4331-a456-d0da8e25c4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:36.379825 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426da795-c673-4331-a456-d0da8e25c4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:36.380295 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426da795-c673-4331-a456-d0da8e25c4a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:36.381268 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426da795-c673-4331-a456-d0da8e25c4a9 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:36.383044 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426da795-c673-4331-a456-d0da8e25c4a9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:36.401580 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.sql.core [None req-426da795-c673-4331-a456-d0da8e25c4a9 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 15 03:26:36.401580 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 15 03:26:36.401580 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [parameters: {'id': 'ec348d5978ed4682ad024976c9552402', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 15 03:26:36.401580 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79361) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 15 03:26:36.416108 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-426da795-c673-4331-a456-d0da8e25c4a9 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 15 03:26:36.417988 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 187/375] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:26:36 2021] POST /identity/v3/roles => generated 144 bytes in 60 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:36.424028 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b4034-ba7c-4651-b10a-2141babca0ee None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:36.433319 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b4034-ba7c-4651-b10a-2141babca0ee None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:36.443359 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d7ee4-5ecc-459c-9560-313938a30260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:36.444476 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d7ee4-5ecc-459c-9560-313938a30260 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:36.444957 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d7ee4-5ecc-459c-9560-313938a30260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:36.445422 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d7ee4-5ecc-459c-9560-313938a30260 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:36.470165 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d7ee4-5ecc-459c-9560-313938a30260 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:36.479023 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-f15d7ee4-5ecc-459c-9560-313938a30260 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 15 03:26:36.481014 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 189/376] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Oct 15 03:26:36 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:36.487278 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426da795-c673-4331-a456-d0da8e25c4a9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:36.499829 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426da795-c673-4331-a456-d0da8e25c4a9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:36.504586 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f6af3-a72b-49d6-a0a2-258b14a54a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:36.505482 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f6af3-a72b-49d6-a0a2-258b14a54a3d admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:36.505963 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f6af3-a72b-49d6-a0a2-258b14a54a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:36.506431 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f6af3-a72b-49d6-a0a2-258b14a54a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:36.507376 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f6af3-a72b-49d6-a0a2-258b14a54a3d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:36.507896 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f6af3-a72b-49d6-a0a2-258b14a54a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:36.510277 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f6af3-a72b-49d6-a0a2-258b14a54a3d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:36.522926 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 188/377] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:36 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:37.878328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0ca39-0c87-4588-b652-2fc221b2374f None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:37.879176 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0ca39-0c87-4588-b652-2fc221b2374f None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:37.879596 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0ca39-0c87-4588-b652-2fc221b2374f None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:37.881788 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 190/378] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:37.888553 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe63893-0829-4eba-8d69-4f5c1db32b7b None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:37.889380 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe63893-0829-4eba-8d69-4f5c1db32b7b None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:37.889854 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe63893-0829-4eba-8d69-4f5c1db32b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:37.902669 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a3f39-ed09-41d9-80bd-31bdb63c6df9 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:37.903288 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a3f39-ed09-41d9-80bd-31bdb63c6df9 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:37.903810 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a3f39-ed09-41d9-80bd-31bdb63c6df9 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:37.906030 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 191/379] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:26:37.912136 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac26fa-d359-45d2-a31d-158192516c8a None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:37.912659 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac26fa-d359-45d2-a31d-158192516c8a None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:37.913153 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac26fa-d359-45d2-a31d-158192516c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:37.915659 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-6fe63893-0829-4eba-8d69-4f5c1db32b7b None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:37.917458 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-6fe63893-0829-4eba-8d69-4f5c1db32b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:37.939273 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 189/380] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:37.940548 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-ecac26fa-d359-45d2-a31d-158192516c8a None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:37.941990 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-ecac26fa-d359-45d2-a31d-158192516c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:37.950817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 192/381] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:37.975986 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe63893-0829-4eba-8d69-4f5c1db32b7b None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:37.986018 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe63893-0829-4eba-8d69-4f5c1db32b7b None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:37.988992 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac26fa-d359-45d2-a31d-158192516c8a None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:37.999645 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e75d13-27bf-4184-8e0d-8dc2fc23dbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.000776 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e75d13-27bf-4184-8e0d-8dc2fc23dbdc admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.001260 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e75d13-27bf-4184-8e0d-8dc2fc23dbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.001734 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e75d13-27bf-4184-8e0d-8dc2fc23dbdc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.004447 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac26fa-d359-45d2-a31d-158192516c8a None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.013206 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d743da-6a6d-4bf1-be30-c06c64df4b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.014254 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d743da-6a6d-4bf1-be30-c06c64df4b51 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.014713 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d743da-6a6d-4bf1-be30-c06c64df4b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.015130 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d743da-6a6d-4bf1-be30-c06c64df4b51 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.022455 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e75d13-27bf-4184-8e0d-8dc2fc23dbdc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:38.031759 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-98e75d13-27bf-4184-8e0d-8dc2fc23dbdc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 03:26:38.036020 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 190/382] 10.222.0.30 () {56 vars in 1123 bytes} [Fri Oct 15 03:26:37 2021] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:38.044550 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e75d13-27bf-4184-8e0d-8dc2fc23dbdc admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.045267 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d743da-6a6d-4bf1-be30-c06c64df4b51 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:38.052421 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-61d743da-6a6d-4bf1-be30-c06c64df4b51 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 03:26:38.060759 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 193/383] 10.222.0.30 () {56 vars in 1123 bytes} [Fri Oct 15 03:26:37 2021] GET /identity/v3/roles/service => generated 85 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:38.064354 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e75d13-27bf-4184-8e0d-8dc2fc23dbdc admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.065771 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d743da-6a6d-4bf1-be30-c06c64df4b51 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.077911 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d743da-6a6d-4bf1-be30-c06c64df4b51 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.080346 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c760c74-be69-4938-9942-55a4c876c8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.081196 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c760c74-be69-4938-9942-55a4c876c8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.081623 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c760c74-be69-4938-9942-55a4c876c8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.082037 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c760c74-be69-4938-9942-55a4c876c8e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.082930 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c760c74-be69-4938-9942-55a4c876c8e5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:38.083376 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c760c74-be69-4938-9942-55a4c876c8e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.086153 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c760c74-be69-4938-9942-55a4c876c8e5 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.094500 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33865c68-fb69-40e8-ac59-f13d71ba29cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.095400 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33865c68-fb69-40e8-ac59-f13d71ba29cb admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.095848 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33865c68-fb69-40e8-ac59-f13d71ba29cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.096262 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33865c68-fb69-40e8-ac59-f13d71ba29cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.097186 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33865c68-fb69-40e8-ac59-f13d71ba29cb admin admin] RBAC: Adding query filter params (name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:38.097638 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33865c68-fb69-40e8-ac59-f13d71ba29cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.099651 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33865c68-fb69-40e8-ac59-f13d71ba29cb admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.105086 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 191/384] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:38.108972 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194640cf-29f5-4efb-80f4-5dd4bd41d189 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.109468 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194640cf-29f5-4efb-80f4-5dd4bd41d189 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.109919 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194640cf-29f5-4efb-80f4-5dd4bd41d189 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.112034 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 192/385] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:38.112496 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 194/386] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:38.120649 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194640cf-29f5-4efb-80f4-5dd4bd41d189 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.120801 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33865c68-fb69-40e8-ac59-f13d71ba29cb admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.133327 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33865c68-fb69-40e8-ac59-f13d71ba29cb admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.133497 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194640cf-29f5-4efb-80f4-5dd4bd41d189 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.138728 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a44b5f-0827-417d-961d-ad32e8023900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.139326 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7aa21b-72b0-4cf2-a852-896af8178078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.140044 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a44b5f-0827-417d-961d-ad32e8023900 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.140153 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aa21b-72b0-4cf2-a852-896af8178078 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.140387 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aa21b-72b0-4cf2-a852-896af8178078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.140661 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aa21b-72b0-4cf2-a852-896af8178078 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.141024 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a44b5f-0827-417d-961d-ad32e8023900 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.141511 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a44b5f-0827-417d-961d-ad32e8023900 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.151706 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7aa21b-72b0-4cf2-a852-896af8178078 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.153541 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7aa21b-72b0-4cf2-a852-896af8178078 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.154679 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a44b5f-0827-417d-961d-ad32e8023900 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.157202 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a44b5f-0827-417d-961d-ad32e8023900 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.170942 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-3f7aa21b-72b0-4cf2-a852-896af8178078 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:38.172164 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 195/387] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:38.173480 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4df27-47ed-4527-9f28-f950246bf376 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.173907 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4df27-47ed-4527-9f28-f950246bf376 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.174306 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4df27-47ed-4527-9f28-f950246bf376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.183259 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-38a44b5f-0827-417d-961d-ad32e8023900 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:38.185010 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 193/388] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:38.185997 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a44b5f-0827-417d-961d-ad32e8023900 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.192610 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-e2e4df27-47ed-4527-9f28-f950246bf376 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:38.193795 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-e2e4df27-47ed-4527-9f28-f950246bf376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:38.197122 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a44b5f-0827-417d-961d-ad32e8023900 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.201761 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e001a-58bd-4717-9092-5c9933b20803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.202567 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 196/389] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:38.202854 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e001a-58bd-4717-9092-5c9933b20803 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.203340 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4df27-47ed-4527-9f28-f950246bf376 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.203466 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e001a-58bd-4717-9092-5c9933b20803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.203991 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e001a-58bd-4717-9092-5c9933b20803 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.204981 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e001a-58bd-4717-9092-5c9933b20803 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:38.205499 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e001a-58bd-4717-9092-5c9933b20803 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.207325 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e001a-58bd-4717-9092-5c9933b20803 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.219927 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 194/390] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:38.227175 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e001a-58bd-4717-9092-5c9933b20803 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.229212 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4df27-47ed-4527-9f28-f950246bf376 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.237990 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc970e6-2658-4757-8c90-a34cfbca423c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.238711 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc970e6-2658-4757-8c90-a34cfbca423c admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.239244 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc970e6-2658-4757-8c90-a34cfbca423c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.239648 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc970e6-2658-4757-8c90-a34cfbca423c admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.240560 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc970e6-2658-4757-8c90-a34cfbca423c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:38.240996 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc970e6-2658-4757-8c90-a34cfbca423c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.243829 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc970e6-2658-4757-8c90-a34cfbca423c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.251284 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e001a-58bd-4717-9092-5c9933b20803 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.257180 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1cd4f-cf72-4d7a-9136-2dd1c49a2603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.259608 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1cd4f-cf72-4d7a-9136-2dd1c49a2603 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.260244 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1cd4f-cf72-4d7a-9136-2dd1c49a2603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.260733 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1cd4f-cf72-4d7a-9136-2dd1c49a2603 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.262649 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 197/391] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:38.263606 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc970e6-2658-4757-8c90-a34cfbca423c admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.271309 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1cd4f-cf72-4d7a-9136-2dd1c49a2603 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.273999 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1cd4f-cf72-4d7a-9136-2dd1c49a2603 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.274162 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc970e6-2658-4757-8c90-a34cfbca423c admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.279250 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bba719-7815-45b7-9b30-7a21da17c647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.280227 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bba719-7815-45b7-9b30-7a21da17c647 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.280622 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bba719-7815-45b7-9b30-7a21da17c647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.280962 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bba719-7815-45b7-9b30-7a21da17c647 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.291448 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-24a1cd4f-cf72-4d7a-9136-2dd1c49a2603 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 15 03:26:38.292847 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bba719-7815-45b7-9b30-7a21da17c647 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:38.293786 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 195/392] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/users/nova => generated 82 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:38.299704 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1cd4f-cf72-4d7a-9136-2dd1c49a2603 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.300108 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-26bba719-7815-45b7-9b30-7a21da17c647 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 03:26:38.301649 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 198/393] 10.222.0.30 () {56 vars in 1123 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:38.302469 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bba719-7815-45b7-9b30-7a21da17c647 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.311237 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1cd4f-cf72-4d7a-9136-2dd1c49a2603 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.316991 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3081cc6-ea4d-4965-b90f-dd200491d239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.318003 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3081cc6-ea4d-4965-b90f-dd200491d239 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.318511 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3081cc6-ea4d-4965-b90f-dd200491d239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.318771 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bba719-7815-45b7-9b30-7a21da17c647 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.319210 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3081cc6-ea4d-4965-b90f-dd200491d239 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.324216 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878beb72-d9dd-4740-af1a-faf2e21ca75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.324906 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878beb72-d9dd-4740-af1a-faf2e21ca75b admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.325187 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878beb72-d9dd-4740-af1a-faf2e21ca75b admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.325460 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878beb72-d9dd-4740-af1a-faf2e21ca75b admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.326366 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878beb72-d9dd-4740-af1a-faf2e21ca75b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:38.326674 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878beb72-d9dd-4740-af1a-faf2e21ca75b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.327810 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING py.warnings [None req-878beb72-d9dd-4740-af1a-faf2e21ca75b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:26:38.327810 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: warnings.warn(msg) Oct 15 03:26:38.327810 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: Oct 15 03:26:38.328987 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878beb72-d9dd-4740-af1a-faf2e21ca75b admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.330107 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3081cc6-ea4d-4965-b90f-dd200491d239 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.332558 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3081cc6-ea4d-4965-b90f-dd200491d239 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.348384 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-e3081cc6-ea4d-4965-b90f-dd200491d239 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 15 03:26:38.350460 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 196/394] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/users/cinder => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:38.351501 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3081cc6-ea4d-4965-b90f-dd200491d239 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.363021 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3081cc6-ea4d-4965-b90f-dd200491d239 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.368837 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f9828-028e-4c69-858a-2524cb8e38d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.369347 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 199/395] 10.222.0.30 () {56 vars in 1154 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:38.370084 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f9828-028e-4c69-858a-2524cb8e38d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.370244 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878beb72-d9dd-4740-af1a-faf2e21ca75b admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.370662 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f9828-028e-4c69-858a-2524cb8e38d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.371040 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f9828-028e-4c69-858a-2524cb8e38d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.372087 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f9828-028e-4c69-858a-2524cb8e38d8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:38.372502 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f9828-028e-4c69-858a-2524cb8e38d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.374263 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f9828-028e-4c69-858a-2524cb8e38d8 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.381544 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878beb72-d9dd-4740-af1a-faf2e21ca75b admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.385653 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 197/396] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:38.386543 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f9828-028e-4c69-858a-2524cb8e38d8 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.396407 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706f603-da6b-4f74-b94c-96f434ebc2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.397324 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706f603-da6b-4f74-b94c-96f434ebc2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.397750 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706f603-da6b-4f74-b94c-96f434ebc2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.398193 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706f603-da6b-4f74-b94c-96f434ebc2d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.399209 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706f603-da6b-4f74-b94c-96f434ebc2d0 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:38.400311 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706f603-da6b-4f74-b94c-96f434ebc2d0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.402450 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f9828-028e-4c69-858a-2524cb8e38d8 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.402570 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706f603-da6b-4f74-b94c-96f434ebc2d0 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.408256 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0f730-5a3f-4f0a-a40b-620470d1b2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.408900 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0f730-5a3f-4f0a-a40b-620470d1b2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.409185 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0f730-5a3f-4f0a-a40b-620470d1b2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.409462 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0f730-5a3f-4f0a-a40b-620470d1b2a8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.417425 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0f730-5a3f-4f0a-a40b-620470d1b2a8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.419191 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0f730-5a3f-4f0a-a40b-620470d1b2a8 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.423018 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 200/397] 10.222.0.30 () {56 vars in 1158 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:38.423865 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706f603-da6b-4f74-b94c-96f434ebc2d0 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.428630 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 198/398] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:38.431723 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ceaeda-9b89-4bdb-877d-66a207ac7f8d None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.431723 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ceaeda-9b89-4bdb-877d-66a207ac7f8d None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.431723 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ceaeda-9b89-4bdb-877d-66a207ac7f8d None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.432459 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 199/399] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:38.432981 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ceaeda-9b89-4bdb-877d-66a207ac7f8d None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.436427 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706f603-da6b-4f74-b94c-96f434ebc2d0 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.440866 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb94ac-fbc4-45ef-90b0-662a593aafdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.441628 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb94ac-fbc4-45ef-90b0-662a593aafdd admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.441908 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb94ac-fbc4-45ef-90b0-662a593aafdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.442178 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb94ac-fbc4-45ef-90b0-662a593aafdd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.448785 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ceaeda-9b89-4bdb-877d-66a207ac7f8d None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.453063 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34b147-0d7f-4a01-9461-e312d77fc55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.453672 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34b147-0d7f-4a01-9461-e312d77fc55f admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.453979 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34b147-0d7f-4a01-9461-e312d77fc55f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.454077 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb94ac-fbc4-45ef-90b0-662a593aafdd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.454240 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34b147-0d7f-4a01-9461-e312d77fc55f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.455925 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb94ac-fbc4-45ef-90b0-662a593aafdd admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.462551 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34b147-0d7f-4a01-9461-e312d77fc55f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.464333 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34b147-0d7f-4a01-9461-e312d77fc55f admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.473127 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-29eb94ac-fbc4-45ef-90b0-662a593aafdd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:38.473247 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 200/400] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:38.478576 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34b147-0d7f-4a01-9461-e312d77fc55f admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.478723 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 201/401] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:38.478723 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fadf64-fc98-4238-8261-8589ff2118b1 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.478723 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fadf64-fc98-4238-8261-8589ff2118b1 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.478723 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fadf64-fc98-4238-8261-8589ff2118b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.487956 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34b147-0d7f-4a01-9461-e312d77fc55f admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.492291 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910aec92-d014-4dd7-b6f3-6a1824c413d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.493081 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910aec92-d014-4dd7-b6f3-6a1824c413d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.493396 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910aec92-d014-4dd7-b6f3-6a1824c413d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.493671 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910aec92-d014-4dd7-b6f3-6a1824c413d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.495501 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-b0fadf64-fc98-4238-8261-8589ff2118b1 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:38.496716 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-b0fadf64-fc98-4238-8261-8589ff2118b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:38.504466 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 202/402] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:38.504604 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910aec92-d014-4dd7-b6f3-6a1824c413d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.505087 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fadf64-fc98-4238-8261-8589ff2118b1 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.506448 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910aec92-d014-4dd7-b6f3-6a1824c413d0 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.518091 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fadf64-fc98-4238-8261-8589ff2118b1 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.526565 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-910aec92-d014-4dd7-b6f3-6a1824c413d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:38.528052 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 201/403] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:38.528827 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910aec92-d014-4dd7-b6f3-6a1824c413d0 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.532030 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94768aa6-f71d-4655-a034-94e0757c9cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.533349 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94768aa6-f71d-4655-a034-94e0757c9cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.533792 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94768aa6-f71d-4655-a034-94e0757c9cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.534071 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94768aa6-f71d-4655-a034-94e0757c9cc3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.538085 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910aec92-d014-4dd7-b6f3-6a1824c413d0 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.542956 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5ed43-ffb3-4e6b-9e17-1f82c5b95a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.543584 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5ed43-ffb3-4e6b-9e17-1f82c5b95a58 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.543895 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5ed43-ffb3-4e6b-9e17-1f82c5b95a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.544285 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5ed43-ffb3-4e6b-9e17-1f82c5b95a58 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.545014 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5ed43-ffb3-4e6b-9e17-1f82c5b95a58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:38.545320 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5ed43-ffb3-4e6b-9e17-1f82c5b95a58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.545445 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94768aa6-f71d-4655-a034-94e0757c9cc3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.546970 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5ed43-ffb3-4e6b-9e17-1f82c5b95a58 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.547264 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94768aa6-f71d-4655-a034-94e0757c9cc3 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.559620 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 202/404] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:38.560681 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5ed43-ffb3-4e6b-9e17-1f82c5b95a58 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.564817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-94768aa6-f71d-4655-a034-94e0757c9cc3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:38.566111 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 203/405] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:38.568688 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94768aa6-f71d-4655-a034-94e0757c9cc3 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.574112 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5ed43-ffb3-4e6b-9e17-1f82c5b95a58 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.576623 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94768aa6-f71d-4655-a034-94e0757c9cc3 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.578586 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0836d1-15d9-4539-bcaa-97ba954ffed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.579223 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0836d1-15d9-4539-bcaa-97ba954ffed9 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.579503 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0836d1-15d9-4539-bcaa-97ba954ffed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.579804 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0836d1-15d9-4539-bcaa-97ba954ffed9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.580526 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0836d1-15d9-4539-bcaa-97ba954ffed9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:38.580864 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0836d1-15d9-4539-bcaa-97ba954ffed9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.581431 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856f5bf-2efc-4fd0-8704-1b1f80cc75a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.582231 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856f5bf-2efc-4fd0-8704-1b1f80cc75a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.582399 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0836d1-15d9-4539-bcaa-97ba954ffed9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.582547 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856f5bf-2efc-4fd0-8704-1b1f80cc75a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.582831 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856f5bf-2efc-4fd0-8704-1b1f80cc75a5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.593653 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 203/406] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:38.594664 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856f5bf-2efc-4fd0-8704-1b1f80cc75a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:38.596674 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0836d1-15d9-4539-bcaa-97ba954ffed9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.603084 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-8856f5bf-2efc-4fd0-8704-1b1f80cc75a5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 03:26:38.604397 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 204/407] 10.222.0.30 () {56 vars in 1123 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:38.609610 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856f5bf-2efc-4fd0-8704-1b1f80cc75a5 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.612158 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0836d1-15d9-4539-bcaa-97ba954ffed9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.614928 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856f5bf-2efc-4fd0-8704-1b1f80cc75a5 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.616585 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8c8d5-35b2-4ca7-ae7f-fa3ebc58336e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.617347 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8c8d5-35b2-4ca7-ae7f-fa3ebc58336e admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.617630 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8c8d5-35b2-4ca7-ae7f-fa3ebc58336e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.617905 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8c8d5-35b2-4ca7-ae7f-fa3ebc58336e admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.620004 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d30f0-e90e-4ac7-a6dd-f990f61a6f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.620630 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d30f0-e90e-4ac7-a6dd-f990f61a6f5f admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.620924 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d30f0-e90e-4ac7-a6dd-f990f61a6f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.621187 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d30f0-e90e-4ac7-a6dd-f990f61a6f5f admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.621900 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d30f0-e90e-4ac7-a6dd-f990f61a6f5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:38.622202 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d30f0-e90e-4ac7-a6dd-f990f61a6f5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.623829 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d30f0-e90e-4ac7-a6dd-f990f61a6f5f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.627331 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8c8d5-35b2-4ca7-ae7f-fa3ebc58336e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.629393 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8c8d5-35b2-4ca7-ae7f-fa3ebc58336e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.641001 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 205/408] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:38.641001 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d30f0-e90e-4ac7-a6dd-f990f61a6f5f admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.643640 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-77b8c8d5-35b2-4ca7-ae7f-fa3ebc58336e admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 15 03:26:38.645105 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 204/409] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/users/glance => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:38.650785 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8c8d5-35b2-4ca7-ae7f-fa3ebc58336e admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.650900 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d30f0-e90e-4ac7-a6dd-f990f61a6f5f admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.651362 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c304e-df7f-474d-9535-364ce13bcd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.654512 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c304e-df7f-474d-9535-364ce13bcd00 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.654512 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c304e-df7f-474d-9535-364ce13bcd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.654512 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c304e-df7f-474d-9535-364ce13bcd00 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.655565 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8c8d5-35b2-4ca7-ae7f-fa3ebc58336e admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.660223 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc49712-df07-491b-821b-6bff43ea821e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.660839 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc49712-df07-491b-821b-6bff43ea821e admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.661119 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc49712-df07-491b-821b-6bff43ea821e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.661391 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc49712-df07-491b-821b-6bff43ea821e admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.662192 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc49712-df07-491b-821b-6bff43ea821e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:38.662627 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc49712-df07-491b-821b-6bff43ea821e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.663518 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c304e-df7f-474d-9535-364ce13bcd00 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.664097 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc49712-df07-491b-821b-6bff43ea821e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.666043 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c304e-df7f-474d-9535-364ce13bcd00 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.677857 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 205/410] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:38.677857 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc49712-df07-491b-821b-6bff43ea821e admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.679790 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-315c304e-df7f-474d-9535-364ce13bcd00 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:26:38.681503 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 206/411] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:38.683432 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c304e-df7f-474d-9535-364ce13bcd00 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.687658 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc49712-df07-491b-821b-6bff43ea821e admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.692038 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4234504-647a-40f0-bd49-6d7900d8fe05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.692777 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4234504-647a-40f0-bd49-6d7900d8fe05 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.693060 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4234504-647a-40f0-bd49-6d7900d8fe05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.693332 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4234504-647a-40f0-bd49-6d7900d8fe05 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.694326 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c304e-df7f-474d-9535-364ce13bcd00 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.698928 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680d9e1-b5e7-41b0-853a-ecbb7d9d11a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.699645 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680d9e1-b5e7-41b0-853a-ecbb7d9d11a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.700267 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680d9e1-b5e7-41b0-853a-ecbb7d9d11a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.700377 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680d9e1-b5e7-41b0-853a-ecbb7d9d11a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.701295 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680d9e1-b5e7-41b0-853a-ecbb7d9d11a8 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:38.701512 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4234504-647a-40f0-bd49-6d7900d8fe05 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.701796 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680d9e1-b5e7-41b0-853a-ecbb7d9d11a8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.703667 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680d9e1-b5e7-41b0-853a-ecbb7d9d11a8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.703945 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4234504-647a-40f0-bd49-6d7900d8fe05 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.717871 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-e4234504-647a-40f0-bd49-6d7900d8fe05 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:26:38.719111 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 206/412] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:38.719883 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4234504-647a-40f0-bd49-6d7900d8fe05 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.726502 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 207/413] 10.222.0.30 () {56 vars in 1158 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:38.728074 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680d9e1-b5e7-41b0-853a-ecbb7d9d11a8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.734143 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4234504-647a-40f0-bd49-6d7900d8fe05 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.737352 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680d9e1-b5e7-41b0-853a-ecbb7d9d11a8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.738858 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601da5cc-dfe8-4710-a1c5-909218de1a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.739673 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601da5cc-dfe8-4710-a1c5-909218de1a52 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.740105 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601da5cc-dfe8-4710-a1c5-909218de1a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.740392 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601da5cc-dfe8-4710-a1c5-909218de1a52 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.741945 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030be16-fc32-48d7-9026-ca73ad1dce99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.742623 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030be16-fc32-48d7-9026-ca73ad1dce99 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.742964 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030be16-fc32-48d7-9026-ca73ad1dce99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.743905 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030be16-fc32-48d7-9026-ca73ad1dce99 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.744798 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030be16-fc32-48d7-9026-ca73ad1dce99 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:38.745105 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030be16-fc32-48d7-9026-ca73ad1dce99 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.746108 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING py.warnings [None req-c030be16-fc32-48d7-9026-ca73ad1dce99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:26:38.746108 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: warnings.warn(msg) Oct 15 03:26:38.746108 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: Oct 15 03:26:38.747231 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030be16-fc32-48d7-9026-ca73ad1dce99 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.753578 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601da5cc-dfe8-4710-a1c5-909218de1a52 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.755623 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601da5cc-dfe8-4710-a1c5-909218de1a52 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.764657 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 208/414] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:38.765524 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030be16-fc32-48d7-9026-ca73ad1dce99 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.775177 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030be16-fc32-48d7-9026-ca73ad1dce99 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.778670 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-601da5cc-dfe8-4710-a1c5-909218de1a52 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:38.779625 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530cca3-e4cf-463a-955b-b15ea2674768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.780211 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 207/415] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:38.780447 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530cca3-e4cf-463a-955b-b15ea2674768 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.780733 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530cca3-e4cf-463a-955b-b15ea2674768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.781060 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530cca3-e4cf-463a-955b-b15ea2674768 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.781909 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530cca3-e4cf-463a-955b-b15ea2674768 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:38.782277 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530cca3-e4cf-463a-955b-b15ea2674768 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.784207 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530cca3-e4cf-463a-955b-b15ea2674768 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.785877 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601da5cc-dfe8-4710-a1c5-909218de1a52 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.796054 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601da5cc-dfe8-4710-a1c5-909218de1a52 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.797103 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 209/416] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:38.797823 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530cca3-e4cf-463a-955b-b15ea2674768 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.805763 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8a150-dfbb-411e-9b81-f95d21d48702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.806388 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8a150-dfbb-411e-9b81-f95d21d48702 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.806666 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8a150-dfbb-411e-9b81-f95d21d48702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.806940 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8a150-dfbb-411e-9b81-f95d21d48702 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.810968 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530cca3-e4cf-463a-955b-b15ea2674768 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.815109 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8a150-dfbb-411e-9b81-f95d21d48702 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.815730 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5961e63-69b3-4406-a34a-4a67716a29fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.816475 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5961e63-69b3-4406-a34a-4a67716a29fd admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.816859 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5961e63-69b3-4406-a34a-4a67716a29fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.816966 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8a150-dfbb-411e-9b81-f95d21d48702 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.817341 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5961e63-69b3-4406-a34a-4a67716a29fd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.818305 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5961e63-69b3-4406-a34a-4a67716a29fd admin admin] RBAC: Adding query filter params (role.id=04a530eb7b7e46d4a07b4c3b02cee3aa, scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user.id=3d71a1bd93b04249b2b8e6a054de44c7) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:38.818767 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5961e63-69b3-4406-a34a-4a67716a29fd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.820786 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5961e63-69b3-4406-a34a-4a67716a29fd admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.830578 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 208/417] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:38.830578 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8a150-dfbb-411e-9b81-f95d21d48702 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.830817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 210/418] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/role_assignments?user.id=3d71a1bd93b04249b2b8e6a054de44c7&scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20&role.id=04a530eb7b7e46d4a07b4c3b02cee3aa => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:38.830817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5961e63-69b3-4406-a34a-4a67716a29fd admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.841195 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8a150-dfbb-411e-9b81-f95d21d48702 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.845525 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5961e63-69b3-4406-a34a-4a67716a29fd admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.847292 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c27ce0-1d60-420e-bd3e-dd72b26b37b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.848340 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c27ce0-1d60-420e-bd3e-dd72b26b37b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.848987 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c27ce0-1d60-420e-bd3e-dd72b26b37b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.849393 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c27ce0-1d60-420e-bd3e-dd72b26b37b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.850246 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c27ce0-1d60-420e-bd3e-dd72b26b37b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:38.850704 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c27ce0-1d60-420e-bd3e-dd72b26b37b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.851852 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc40aa5-ae52-494c-bb9f-cc73e279a966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.853267 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c27ce0-1d60-420e-bd3e-dd72b26b37b9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.853409 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc40aa5-ae52-494c-bb9f-cc73e279a966 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.853819 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc40aa5-ae52-494c-bb9f-cc73e279a966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.854236 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc40aa5-ae52-494c-bb9f-cc73e279a966 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.855247 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc40aa5-ae52-494c-bb9f-cc73e279a966 admin admin] RBAC: Adding query filter params (role.id=04a530eb7b7e46d4a07b4c3b02cee3aa, scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user.id=4edffc4b89f74ce590a2dd7b8fc904bf) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:38.855727 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc40aa5-ae52-494c-bb9f-cc73e279a966 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.857821 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc40aa5-ae52-494c-bb9f-cc73e279a966 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.864289 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 211/419] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/role_assignments?user.id=4edffc4b89f74ce590a2dd7b8fc904bf&scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20&role.id=04a530eb7b7e46d4a07b4c3b02cee3aa => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:38.865364 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc40aa5-ae52-494c-bb9f-cc73e279a966 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.869914 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 209/420] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:38.876748 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c27ce0-1d60-420e-bd3e-dd72b26b37b9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.877205 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc40aa5-ae52-494c-bb9f-cc73e279a966 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.882545 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a18e5-870e-4fba-84f5-76f584e5fc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.884749 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a18e5-870e-4fba-84f5-76f584e5fc99 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.885214 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a18e5-870e-4fba-84f5-76f584e5fc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.885627 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a18e5-870e-4fba-84f5-76f584e5fc99 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.895821 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c27ce0-1d60-420e-bd3e-dd72b26b37b9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.899544 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a18e5-870e-4fba-84f5-76f584e5fc99 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.901841 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a18e5-870e-4fba-84f5-76f584e5fc99 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.909517 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01895e9-01d6-4880-bc68-738ab06405b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.910520 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01895e9-01d6-4880-bc68-738ab06405b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.910900 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01895e9-01d6-4880-bc68-738ab06405b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.911270 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01895e9-01d6-4880-bc68-738ab06405b9 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.922125 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-e23a18e5-870e-4fba-84f5-76f584e5fc99 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:38.927835 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 212/421] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:38.930028 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01895e9-01d6-4880-bc68-738ab06405b9 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.931222 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a18e5-870e-4fba-84f5-76f584e5fc99 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.933001 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01895e9-01d6-4880-bc68-738ab06405b9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.945960 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a18e5-870e-4fba-84f5-76f584e5fc99 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:38.955769 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09754f64-17c1-412e-812f-aeaeedd176f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:38.958046 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09754f64-17c1-412e-812f-aeaeedd176f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:38.958918 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09754f64-17c1-412e-812f-aeaeedd176f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:38.959350 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09754f64-17c1-412e-812f-aeaeedd176f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:38.961769 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09754f64-17c1-412e-812f-aeaeedd176f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:38.962368 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09754f64-17c1-412e-812f-aeaeedd176f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:38.964894 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09754f64-17c1-412e-812f-aeaeedd176f3 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:38.970174 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-b01895e9-01d6-4880-bc68-738ab06405b9 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 15 03:26:38.972624 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 210/422] 10.222.0.30 () {56 vars in 1123 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/users/neutron => generated 85 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:38.979379 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01895e9-01d6-4880-bc68-738ab06405b9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:38.994333 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 213/423] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:39.002274 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01895e9-01d6-4880-bc68-738ab06405b9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:39.003597 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09754f64-17c1-412e-812f-aeaeedd176f3 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:39.017420 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125440a2-8f96-43d5-bcca-ff42d093a249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:39.018261 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125440a2-8f96-43d5-bcca-ff42d093a249 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:39.018642 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125440a2-8f96-43d5-bcca-ff42d093a249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:39.018830 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09754f64-17c1-412e-812f-aeaeedd176f3 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:39.019121 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125440a2-8f96-43d5-bcca-ff42d093a249 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:39.020252 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125440a2-8f96-43d5-bcca-ff42d093a249 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:39.020654 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125440a2-8f96-43d5-bcca-ff42d093a249 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:39.021937 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING py.warnings [None req-125440a2-8f96-43d5-bcca-ff42d093a249 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:26:39.021937 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: warnings.warn(msg) Oct 15 03:26:39.021937 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: Oct 15 03:26:39.023396 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125440a2-8f96-43d5-bcca-ff42d093a249 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:39.025018 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e87c7-33ae-4e9f-a2db-48e7327058d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:39.026046 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e87c7-33ae-4e9f-a2db-48e7327058d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:39.026558 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e87c7-33ae-4e9f-a2db-48e7327058d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:39.026977 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e87c7-33ae-4e9f-a2db-48e7327058d2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:39.035218 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e87c7-33ae-4e9f-a2db-48e7327058d2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:39.037635 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e87c7-33ae-4e9f-a2db-48e7327058d2 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:39.056718 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-db4e87c7-33ae-4e9f-a2db-48e7327058d2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:26:39.058247 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 214/424] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:39.064640 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e87c7-33ae-4e9f-a2db-48e7327058d2 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:39.079353 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 211/425] 10.222.0.30 () {56 vars in 1160 bytes} [Fri Oct 15 03:26:38 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:39.079547 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e87c7-33ae-4e9f-a2db-48e7327058d2 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:39.086202 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125440a2-8f96-43d5-bcca-ff42d093a249 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:39.089753 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858116f-cedd-404e-8b17-87088c3c9728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:39.090439 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858116f-cedd-404e-8b17-87088c3c9728 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:39.090722 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858116f-cedd-404e-8b17-87088c3c9728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:39.090997 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858116f-cedd-404e-8b17-87088c3c9728 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:39.093071 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858116f-cedd-404e-8b17-87088c3c9728 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:39.093412 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858116f-cedd-404e-8b17-87088c3c9728 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:39.095353 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858116f-cedd-404e-8b17-87088c3c9728 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:39.098784 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125440a2-8f96-43d5-bcca-ff42d093a249 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:39.104247 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d90a0-2340-434c-a5b2-3b7929ac6392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:39.105140 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d90a0-2340-434c-a5b2-3b7929ac6392 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:39.105520 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d90a0-2340-434c-a5b2-3b7929ac6392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:39.105896 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d90a0-2340-434c-a5b2-3b7929ac6392 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:39.110014 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 215/426] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:26:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:39.116692 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858116f-cedd-404e-8b17-87088c3c9728 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:39.130052 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d90a0-2340-434c-a5b2-3b7929ac6392 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:39.131929 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d90a0-2340-434c-a5b2-3b7929ac6392 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:39.141135 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858116f-cedd-404e-8b17-87088c3c9728 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:39.148342 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 212/427] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:39 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:39.150511 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e02e0e-85fe-4fb9-bafd-e63a706a88fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:39.151175 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e02e0e-85fe-4fb9-bafd-e63a706a88fa admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:39.151456 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e02e0e-85fe-4fb9-bafd-e63a706a88fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:39.151788 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e02e0e-85fe-4fb9-bafd-e63a706a88fa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:39.152644 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e02e0e-85fe-4fb9-bafd-e63a706a88fa admin admin] RBAC: Adding query filter params (role.id=04a530eb7b7e46d4a07b4c3b02cee3aa, scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user.id=456c83b8619847279927251ca48fca37) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:39.152958 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e02e0e-85fe-4fb9-bafd-e63a706a88fa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:39.154821 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e02e0e-85fe-4fb9-bafd-e63a706a88fa admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:39.156934 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d90a0-2340-434c-a5b2-3b7929ac6392 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:39.166068 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 216/428] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:39 2021] GET /identity/v3/role_assignments?user.id=456c83b8619847279927251ca48fca37&scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20&role.id=04a530eb7b7e46d4a07b4c3b02cee3aa => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:39.169263 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d90a0-2340-434c-a5b2-3b7929ac6392 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:39.179187 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af8f31-9e95-49ed-a111-e26b5297c732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:39.180464 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af8f31-9e95-49ed-a111-e26b5297c732 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:39.180983 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af8f31-9e95-49ed-a111-e26b5297c732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:39.181521 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af8f31-9e95-49ed-a111-e26b5297c732 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:39.195366 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af8f31-9e95-49ed-a111-e26b5297c732 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:39.198276 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af8f31-9e95-49ed-a111-e26b5297c732 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:39.217782 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-c3af8f31-9e95-49ed-a111-e26b5297c732 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:39.223759 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 213/429] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:39.226531 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e02e0e-85fe-4fb9-bafd-e63a706a88fa admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:39.257314 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e02e0e-85fe-4fb9-bafd-e63a706a88fa admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:39.268109 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9915026-8259-4479-8c65-d8d855c25374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:39.268802 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9915026-8259-4479-8c65-d8d855c25374 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:39.269079 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9915026-8259-4479-8c65-d8d855c25374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:39.269359 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9915026-8259-4479-8c65-d8d855c25374 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:39.270106 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9915026-8259-4479-8c65-d8d855c25374 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:39.270413 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9915026-8259-4479-8c65-d8d855c25374 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:39.272100 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9915026-8259-4479-8c65-d8d855c25374 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:39.299535 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 217/430] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:39.305791 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af8f31-9e95-49ed-a111-e26b5297c732 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:39.317515 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af8f31-9e95-49ed-a111-e26b5297c732 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:39.328007 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6f9b0-9b5d-4264-a901-e5b915faa07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:39.329154 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6f9b0-9b5d-4264-a901-e5b915faa07a admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:39.329674 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6f9b0-9b5d-4264-a901-e5b915faa07a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:39.330139 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6f9b0-9b5d-4264-a901-e5b915faa07a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:39.344812 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6f9b0-9b5d-4264-a901-e5b915faa07a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:39.347162 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6f9b0-9b5d-4264-a901-e5b915faa07a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:39.364500 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-58e6f9b0-9b5d-4264-a901-e5b915faa07a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:26:39.366089 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 214/431] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:39.372581 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9915026-8259-4479-8c65-d8d855c25374 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:39.394298 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9915026-8259-4479-8c65-d8d855c25374 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:39.409657 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cbcd0-3f55-4e23-a2a0-eb256a5e5fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:39.410257 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cbcd0-3f55-4e23-a2a0-eb256a5e5fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:39.410540 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cbcd0-3f55-4e23-a2a0-eb256a5e5fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:39.410815 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cbcd0-3f55-4e23-a2a0-eb256a5e5fa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:39.411642 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cbcd0-3f55-4e23-a2a0-eb256a5e5fa0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:39.411984 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cbcd0-3f55-4e23-a2a0-eb256a5e5fa0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:39.413931 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cbcd0-3f55-4e23-a2a0-eb256a5e5fa0 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:39.437660 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 218/432] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:26:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:39.444805 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6f9b0-9b5d-4264-a901-e5b915faa07a admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:39.455747 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6f9b0-9b5d-4264-a901-e5b915faa07a admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:39.467398 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f09c0-105b-45f7-b171-6002938c1ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:39.468522 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f09c0-105b-45f7-b171-6002938c1ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:39.469027 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f09c0-105b-45f7-b171-6002938c1ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:39.469529 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f09c0-105b-45f7-b171-6002938c1ee3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:39.470625 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f09c0-105b-45f7-b171-6002938c1ee3 admin admin] RBAC: Adding query filter params (role.id=04a530eb7b7e46d4a07b4c3b02cee3aa, scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user.id=3ea75b4f9132494388b223a309a40640) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:39.471135 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f09c0-105b-45f7-b171-6002938c1ee3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:39.477492 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f09c0-105b-45f7-b171-6002938c1ee3 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:39.485103 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 215/433] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:39 2021] GET /identity/v3/role_assignments?user.id=3ea75b4f9132494388b223a309a40640&scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20&role.id=04a530eb7b7e46d4a07b4c3b02cee3aa => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:39.687239 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f96dd-e5ef-4b11-b53b-a5d0d54a9751 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:39.687913 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f96dd-e5ef-4b11-b53b-a5d0d54a9751 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:39.688419 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f96dd-e5ef-4b11-b53b-a5d0d54a9751 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:39.690598 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 219/434] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:39.697050 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fb547-6a8c-44df-8b93-fee10c09848a None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:39.697608 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fb547-6a8c-44df-8b93-fee10c09848a None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:39.698081 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fb547-6a8c-44df-8b93-fee10c09848a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:39.724497 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-cb4fb547-6a8c-44df-8b93-fee10c09848a None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:39.726029 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-cb4fb547-6a8c-44df-8b93-fee10c09848a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:39.737819 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 216/435] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:39.764183 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f96dd-e5ef-4b11-b53b-a5d0d54a9751 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:39.780480 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f96dd-e5ef-4b11-b53b-a5d0d54a9751 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:39.790449 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259b587-f170-4eca-9cea-6891ff154d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:39.791601 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259b587-f170-4eca-9cea-6891ff154d9e admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:39.792127 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259b587-f170-4eca-9cea-6891ff154d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:39.792597 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259b587-f170-4eca-9cea-6891ff154d9e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:39.804200 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4259b587-f170-4eca-9cea-6891ff154d9e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:39.806850 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4259b587-f170-4eca-9cea-6891ff154d9e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:39.833806 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-4259b587-f170-4eca-9cea-6891ff154d9e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:39.835396 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 220/436] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:39.842038 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fb547-6a8c-44df-8b93-fee10c09848a None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:39.851662 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fb547-6a8c-44df-8b93-fee10c09848a None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:39.859653 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba68c5-01d3-463d-9742-e4d73977e7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:39.860606 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba68c5-01d3-463d-9742-e4d73977e7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:39.861110 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba68c5-01d3-463d-9742-e4d73977e7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:39.861578 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba68c5-01d3-463d-9742-e4d73977e7b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:39.862504 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba68c5-01d3-463d-9742-e4d73977e7b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:39.863015 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba68c5-01d3-463d-9742-e4d73977e7b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:39.864878 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba68c5-01d3-463d-9742-e4d73977e7b7 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:39.882121 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 217/437] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:39.889073 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259b587-f170-4eca-9cea-6891ff154d9e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:39.899737 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259b587-f170-4eca-9cea-6891ff154d9e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:39.910942 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216f30c-e4d4-4914-8928-bf15cfbea5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:39.911997 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216f30c-e4d4-4914-8928-bf15cfbea5d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:39.912513 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216f30c-e4d4-4914-8928-bf15cfbea5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:39.912984 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216f30c-e4d4-4914-8928-bf15cfbea5d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:39.913907 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216f30c-e4d4-4914-8928-bf15cfbea5d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:39.916632 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216f30c-e4d4-4914-8928-bf15cfbea5d1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:39.956345 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 221/438] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Oct 15 03:26:39 2021] POST /identity/v3/users => generated 247 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:26:41.672753 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bb2f7-d6c4-4821-9b76-62b5ca4d5e91 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:41.673236 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bb2f7-d6c4-4821-9b76-62b5ca4d5e91 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:41.673236 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bb2f7-d6c4-4821-9b76-62b5ca4d5e91 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:41.675231 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 218/439] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:41.681064 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a0945-9450-430d-89a6-02b119cfdf2c None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:41.681477 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a0945-9450-430d-89a6-02b119cfdf2c None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:41.681644 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a0945-9450-430d-89a6-02b119cfdf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:41.703117 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-513a0945-9450-430d-89a6-02b119cfdf2c None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:41.704381 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-513a0945-9450-430d-89a6-02b119cfdf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:41.716242 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 222/440] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:41.743166 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d385efa-a6cc-417e-ab47-21c201402e81 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:41.744000 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d385efa-a6cc-417e-ab47-21c201402e81 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:41.744248 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d385efa-a6cc-417e-ab47-21c201402e81 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:41.746269 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 219/441] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:41.752300 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b8446-f965-4202-9e76-ee965975968b None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:41.752610 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b8446-f965-4202-9e76-ee965975968b None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:41.752853 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b8446-f965-4202-9e76-ee965975968b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:41.753547 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d385efa-a6cc-417e-ab47-21c201402e81 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:41.779246 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-970b8446-f965-4202-9e76-ee965975968b None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:41.780475 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-970b8446-f965-4202-9e76-ee965975968b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:41.781899 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d385efa-a6cc-417e-ab47-21c201402e81 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:41.787385 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f016e33-14fa-485e-827d-d2f3f4563ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:41.788207 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f016e33-14fa-485e-827d-d2f3f4563ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:41.788490 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f016e33-14fa-485e-827d-d2f3f4563ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:41.788771 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f016e33-14fa-485e-827d-d2f3f4563ca2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:41.802536 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 223/442] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:41.812613 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f016e33-14fa-485e-827d-d2f3f4563ca2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:41.819577 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-8f016e33-14fa-485e-827d-d2f3f4563ca2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 03:26:41.825492 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 220/443] 10.222.0.30 () {56 vars in 1123 bytes} [Fri Oct 15 03:26:41 2021] GET /identity/v3/roles/service => generated 85 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:41.826725 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b8446-f965-4202-9e76-ee965975968b None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:41.832640 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f016e33-14fa-485e-827d-d2f3f4563ca2 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:41.836139 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b8446-f965-4202-9e76-ee965975968b None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:41.841148 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa515e0-9e56-4204-a434-65fa2d0b5fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:41.841940 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa515e0-9e56-4204-a434-65fa2d0b5fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:41.842216 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa515e0-9e56-4204-a434-65fa2d0b5fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:41.842492 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa515e0-9e56-4204-a434-65fa2d0b5fa1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:41.851040 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f016e33-14fa-485e-827d-d2f3f4563ca2 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:41.858812 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa515e0-9e56-4204-a434-65fa2d0b5fa1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:41.865695 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-3fa515e0-9e56-4204-a434-65fa2d0b5fa1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 03:26:41.872838 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 224/444] 10.222.0.30 () {56 vars in 1123 bytes} [Fri Oct 15 03:26:41 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:41.879717 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9babf-08fd-43dc-ac65-0091fbb976a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:41.879717 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9babf-08fd-43dc-ac65-0091fbb976a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:41.880111 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa515e0-9e56-4204-a434-65fa2d0b5fa1 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:41.880301 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9babf-08fd-43dc-ac65-0091fbb976a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:41.880301 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9babf-08fd-43dc-ac65-0091fbb976a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:41.880301 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9babf-08fd-43dc-ac65-0091fbb976a6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:41.880301 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9babf-08fd-43dc-ac65-0091fbb976a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:41.880301 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9babf-08fd-43dc-ac65-0091fbb976a6 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:41.888077 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 221/445] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Oct 15 03:26:41 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:41.888579 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa515e0-9e56-4204-a434-65fa2d0b5fa1 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:41.889464 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d1dd5-fef1-43a0-a9fd-03115363628d None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:41.889763 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d1dd5-fef1-43a0-a9fd-03115363628d None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:41.890041 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d1dd5-fef1-43a0-a9fd-03115363628d None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:41.892387 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 222/446] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:41.894042 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d1dd5-fef1-43a0-a9fd-03115363628d None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:41.894774 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec188552-13c7-4b68-b7d3-a4f32e60d9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:41.895671 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec188552-13c7-4b68-b7d3-a4f32e60d9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:41.896297 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec188552-13c7-4b68-b7d3-a4f32e60d9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:41.896766 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec188552-13c7-4b68-b7d3-a4f32e60d9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:41.897771 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec188552-13c7-4b68-b7d3-a4f32e60d9c6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:41.898276 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec188552-13c7-4b68-b7d3-a4f32e60d9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:41.900937 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec188552-13c7-4b68-b7d3-a4f32e60d9c6 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:41.912597 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 225/447] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Oct 15 03:26:41 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:41.912886 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d1dd5-fef1-43a0-a9fd-03115363628d None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:41.914385 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd033efc-322f-4a10-af56-496ee472f4c8 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:41.914885 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd033efc-322f-4a10-af56-496ee472f4c8 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:41.915997 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd033efc-322f-4a10-af56-496ee472f4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:41.930282 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e09a4-d26d-4750-982f-bc6febc9cdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:41.931989 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e09a4-d26d-4750-982f-bc6febc9cdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:41.932283 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e09a4-d26d-4750-982f-bc6febc9cdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:41.932561 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e09a4-d26d-4750-982f-bc6febc9cdd9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:41.938558 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-cd033efc-322f-4a10-af56-496ee472f4c8 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:41.940434 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-cd033efc-322f-4a10-af56-496ee472f4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:41.943769 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e09a4-d26d-4750-982f-bc6febc9cdd9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:41.945970 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e09a4-d26d-4750-982f-bc6febc9cdd9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:41.950976 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 226/448] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:41.952028 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd033efc-322f-4a10-af56-496ee472f4c8 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:41.962332 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd033efc-322f-4a10-af56-496ee472f4c8 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:41.964946 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-8a5e09a4-d26d-4750-982f-bc6febc9cdd9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:41.966510 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 223/449] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:41.967547 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2726da-b4e2-4701-b6b5-20c862ac0ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:41.968574 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2726da-b4e2-4701-b6b5-20c862ac0ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:41.969051 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2726da-b4e2-4701-b6b5-20c862ac0ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:41.969524 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2726da-b4e2-4701-b6b5-20c862ac0ce9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:41.972265 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e09a4-d26d-4750-982f-bc6febc9cdd9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:41.987376 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e09a4-d26d-4750-982f-bc6febc9cdd9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:41.987543 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2726da-b4e2-4701-b6b5-20c862ac0ce9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:41.989530 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2726da-b4e2-4701-b6b5-20c862ac0ce9 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:41.992634 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54912b17-3e02-4c84-a52b-8eacafd25c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:41.994096 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54912b17-3e02-4c84-a52b-8eacafd25c25 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:41.994576 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54912b17-3e02-4c84-a52b-8eacafd25c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:41.995045 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54912b17-3e02-4c84-a52b-8eacafd25c25 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:41.995995 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54912b17-3e02-4c84-a52b-8eacafd25c25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:41.996513 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54912b17-3e02-4c84-a52b-8eacafd25c25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:41.998312 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54912b17-3e02-4c84-a52b-8eacafd25c25 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.007297 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-9c2726da-b4e2-4701-b6b5-20c862ac0ce9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:42.011522 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 224/451] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:42.012623 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54912b17-3e02-4c84-a52b-8eacafd25c25 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.013860 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 227/451] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:42.015212 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2726da-b4e2-4701-b6b5-20c862ac0ce9 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.023493 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54912b17-3e02-4c84-a52b-8eacafd25c25 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.024993 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2726da-b4e2-4701-b6b5-20c862ac0ce9 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.029421 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebccee1-0fba-4337-bb17-4810f58aec5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.029803 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1a1da-6ade-4173-937e-8b84c61916a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.030441 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1a1da-6ade-4173-937e-8b84c61916a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.030772 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1a1da-6ade-4173-937e-8b84c61916a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.031053 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1a1da-6ade-4173-937e-8b84c61916a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.031322 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebccee1-0fba-4337-bb17-4810f58aec5f admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.031819 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1a1da-6ade-4173-937e-8b84c61916a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:42.032037 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebccee1-0fba-4337-bb17-4810f58aec5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.032134 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1a1da-6ade-4173-937e-8b84c61916a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.032612 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebccee1-0fba-4337-bb17-4810f58aec5f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.033720 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1a1da-6ade-4173-937e-8b84c61916a1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.045593 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebccee1-0fba-4337-bb17-4810f58aec5f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:42.050714 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 228/452] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:42.051471 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1a1da-6ade-4173-937e-8b84c61916a1 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.054992 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-5ebccee1-0fba-4337-bb17-4810f58aec5f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 03:26:42.057208 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 225/453] 10.222.0.30 () {56 vars in 1123 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:42.058164 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebccee1-0fba-4337-bb17-4810f58aec5f admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.073730 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1a1da-6ade-4173-937e-8b84c61916a1 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.074216 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebccee1-0fba-4337-bb17-4810f58aec5f admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.078807 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab60fa-4498-417a-af60-9d1f0df701e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.079574 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab60fa-4498-417a-af60-9d1f0df701e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.079930 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab60fa-4498-417a-af60-9d1f0df701e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.080206 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab60fa-4498-417a-af60-9d1f0df701e3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.080478 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f23fdf-0014-4b85-b2a8-55fec12c7866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.081623 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f23fdf-0014-4b85-b2a8-55fec12c7866 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.082102 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f23fdf-0014-4b85-b2a8-55fec12c7866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.082589 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f23fdf-0014-4b85-b2a8-55fec12c7866 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.089298 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab60fa-4498-417a-af60-9d1f0df701e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.091602 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab60fa-4498-417a-af60-9d1f0df701e3 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.095835 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f23fdf-0014-4b85-b2a8-55fec12c7866 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.098160 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f23fdf-0014-4b85-b2a8-55fec12c7866 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.107778 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-e5ab60fa-4498-417a-af60-9d1f0df701e3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 15 03:26:42.109215 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 226/454] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/users/nova => generated 82 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:42.109822 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab60fa-4498-417a-af60-9d1f0df701e3 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.113354 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-61f23fdf-0014-4b85-b2a8-55fec12c7866 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 15 03:26:42.115006 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 229/455] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/users/cinder => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:42.116196 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f23fdf-0014-4b85-b2a8-55fec12c7866 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.126244 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab60fa-4498-417a-af60-9d1f0df701e3 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.126974 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f23fdf-0014-4b85-b2a8-55fec12c7866 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.130823 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b62d04-0c73-4d88-8d92-643a3b05584d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.131467 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b62d04-0c73-4d88-8d92-643a3b05584d admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.131780 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b62d04-0c73-4d88-8d92-643a3b05584d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.132063 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b62d04-0c73-4d88-8d92-643a3b05584d admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.132812 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b62d04-0c73-4d88-8d92-643a3b05584d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:42.133116 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b62d04-0c73-4d88-8d92-643a3b05584d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.133534 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c427f5-89aa-4901-a95d-d4dadab971ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.134945 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c427f5-89aa-4901-a95d-d4dadab971ad admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.135262 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b62d04-0c73-4d88-8d92-643a3b05584d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.135651 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c427f5-89aa-4901-a95d-d4dadab971ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.136157 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c427f5-89aa-4901-a95d-d4dadab971ad admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.137201 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c427f5-89aa-4901-a95d-d4dadab971ad admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:42.137726 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c427f5-89aa-4901-a95d-d4dadab971ad admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.139781 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c427f5-89aa-4901-a95d-d4dadab971ad admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.147756 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 227/456] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:42.148812 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b62d04-0c73-4d88-8d92-643a3b05584d admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.158760 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b62d04-0c73-4d88-8d92-643a3b05584d admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.163377 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5880267-6de4-4d7c-8e69-32043bd9a746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.164316 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5880267-6de4-4d7c-8e69-32043bd9a746 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.164817 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5880267-6de4-4d7c-8e69-32043bd9a746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.165829 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5880267-6de4-4d7c-8e69-32043bd9a746 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.166871 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5880267-6de4-4d7c-8e69-32043bd9a746 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:42.167400 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5880267-6de4-4d7c-8e69-32043bd9a746 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.169352 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 230/457] 10.222.0.30 () {56 vars in 1154 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:42.169736 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5880267-6de4-4d7c-8e69-32043bd9a746 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.170330 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c427f5-89aa-4901-a95d-d4dadab971ad admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.182820 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c427f5-89aa-4901-a95d-d4dadab971ad admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.187812 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89344757-c25a-4d60-a093-b679f8aa2dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.188873 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89344757-c25a-4d60-a093-b679f8aa2dcb admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.189175 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89344757-c25a-4d60-a093-b679f8aa2dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.189451 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89344757-c25a-4d60-a093-b679f8aa2dcb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.191261 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 228/458] 10.222.0.30 () {56 vars in 1158 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:42.192350 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5880267-6de4-4d7c-8e69-32043bd9a746 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.202316 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5880267-6de4-4d7c-8e69-32043bd9a746 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.204328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89344757-c25a-4d60-a093-b679f8aa2dcb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.207289 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326ec40-2dc1-46dc-962d-fb0eb6b79e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.207503 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89344757-c25a-4d60-a093-b679f8aa2dcb admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.208776 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326ec40-2dc1-46dc-962d-fb0eb6b79e3e admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.209282 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326ec40-2dc1-46dc-962d-fb0eb6b79e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.209768 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326ec40-2dc1-46dc-962d-fb0eb6b79e3e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.220252 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326ec40-2dc1-46dc-962d-fb0eb6b79e3e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.222353 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326ec40-2dc1-46dc-962d-fb0eb6b79e3e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.228026 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-89344757-c25a-4d60-a093-b679f8aa2dcb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:42.229201 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 231/459] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:42.232160 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89344757-c25a-4d60-a093-b679f8aa2dcb admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.250130 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89344757-c25a-4d60-a093-b679f8aa2dcb admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.251088 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-6326ec40-2dc1-46dc-962d-fb0eb6b79e3e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:42.252830 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 229/460] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:42.253974 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326ec40-2dc1-46dc-962d-fb0eb6b79e3e admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.259300 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bad467-a305-4ee0-a76e-03bea70c20af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.260359 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bad467-a305-4ee0-a76e-03bea70c20af admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.262241 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bad467-a305-4ee0-a76e-03bea70c20af admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.262753 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bad467-a305-4ee0-a76e-03bea70c20af admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.270849 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326ec40-2dc1-46dc-962d-fb0eb6b79e3e admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.275173 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bad467-a305-4ee0-a76e-03bea70c20af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.276158 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c28e0-9412-4e6a-bdb1-8c59a996e9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.276803 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c28e0-9412-4e6a-bdb1-8c59a996e9bd admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.277083 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c28e0-9412-4e6a-bdb1-8c59a996e9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.277362 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c28e0-9412-4e6a-bdb1-8c59a996e9bd admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.278091 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c28e0-9412-4e6a-bdb1-8c59a996e9bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:42.278394 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c28e0-9412-4e6a-bdb1-8c59a996e9bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.278998 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bad467-a305-4ee0-a76e-03bea70c20af admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.280207 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c28e0-9412-4e6a-bdb1-8c59a996e9bd admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.294231 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 230/461] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:42.294901 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c28e0-9412-4e6a-bdb1-8c59a996e9bd admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.298350 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-40bad467-a305-4ee0-a76e-03bea70c20af admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:42.300049 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 232/462] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:42.301622 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bad467-a305-4ee0-a76e-03bea70c20af admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.310972 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c28e0-9412-4e6a-bdb1-8c59a996e9bd admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.313036 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bad467-a305-4ee0-a76e-03bea70c20af admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.315634 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f2428-4224-4144-8c02-67513750d941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.316430 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f2428-4224-4144-8c02-67513750d941 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.316713 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f2428-4224-4144-8c02-67513750d941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.316997 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f2428-4224-4144-8c02-67513750d941 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.317803 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f2428-4224-4144-8c02-67513750d941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:42.318127 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f2428-4224-4144-8c02-67513750d941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.319491 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1f31a-2077-46cb-9b1e-c99a2d9dba69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.319842 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f2428-4224-4144-8c02-67513750d941 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.320790 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1f31a-2077-46cb-9b1e-c99a2d9dba69 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.321304 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1f31a-2077-46cb-9b1e-c99a2d9dba69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.321836 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1f31a-2077-46cb-9b1e-c99a2d9dba69 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.330014 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1f31a-2077-46cb-9b1e-c99a2d9dba69 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.332439 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1f31a-2077-46cb-9b1e-c99a2d9dba69 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.333221 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 231/463] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:42.336376 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f2428-4224-4144-8c02-67513750d941 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.349637 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f2428-4224-4144-8c02-67513750d941 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.354913 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618315ff-96ae-4220-ace5-26e7f178510d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.355836 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618315ff-96ae-4220-ace5-26e7f178510d admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.356339 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618315ff-96ae-4220-ace5-26e7f178510d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.356817 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618315ff-96ae-4220-ace5-26e7f178510d admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.357749 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618315ff-96ae-4220-ace5-26e7f178510d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:42.358020 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-03b1f31a-2077-46cb-9b1e-c99a2d9dba69 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 15 03:26:42.358464 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618315ff-96ae-4220-ace5-26e7f178510d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.359264 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 233/464] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/users/glance => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:42.360525 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618315ff-96ae-4220-ace5-26e7f178510d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.364224 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1f31a-2077-46cb-9b1e-c99a2d9dba69 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.377201 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1f31a-2077-46cb-9b1e-c99a2d9dba69 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.379535 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 232/465] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:42.380931 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618315ff-96ae-4220-ace5-26e7f178510d admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.381877 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ab649-579e-4fd3-bb9f-5656c455f180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.382695 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ab649-579e-4fd3-bb9f-5656c455f180 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.382983 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ab649-579e-4fd3-bb9f-5656c455f180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.383260 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ab649-579e-4fd3-bb9f-5656c455f180 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.392043 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ab649-579e-4fd3-bb9f-5656c455f180 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.392431 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618315ff-96ae-4220-ace5-26e7f178510d admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.394250 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ab649-579e-4fd3-bb9f-5656c455f180 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.397579 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416f0a3-a379-4312-b49c-6802f38e8338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.398543 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416f0a3-a379-4312-b49c-6802f38e8338 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.399085 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416f0a3-a379-4312-b49c-6802f38e8338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.400157 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416f0a3-a379-4312-b49c-6802f38e8338 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.401350 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416f0a3-a379-4312-b49c-6802f38e8338 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:42.401871 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416f0a3-a379-4312-b49c-6802f38e8338 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.404100 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416f0a3-a379-4312-b49c-6802f38e8338 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.409059 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-749ab649-579e-4fd3-bb9f-5656c455f180 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:26:42.410416 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 234/466] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:42.415983 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ab649-579e-4fd3-bb9f-5656c455f180 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.430144 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ab649-579e-4fd3-bb9f-5656c455f180 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.430399 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 233/467] 10.222.0.30 () {56 vars in 1158 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:42.431801 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416f0a3-a379-4312-b49c-6802f38e8338 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.441807 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a649b6-af3f-4c3a-b37e-310c4787b8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.443285 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a649b6-af3f-4c3a-b37e-310c4787b8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.443583 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a649b6-af3f-4c3a-b37e-310c4787b8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.443885 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a649b6-af3f-4c3a-b37e-310c4787b8b9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.447699 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416f0a3-a379-4312-b49c-6802f38e8338 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.452476 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a794a8d-dfdf-4bc1-ac5b-3db4dabf1529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.452850 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a649b6-af3f-4c3a-b37e-310c4787b8b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.453531 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a794a8d-dfdf-4bc1-ac5b-3db4dabf1529 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.453951 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a794a8d-dfdf-4bc1-ac5b-3db4dabf1529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.454360 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a794a8d-dfdf-4bc1-ac5b-3db4dabf1529 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.454979 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a649b6-af3f-4c3a-b37e-310c4787b8b9 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.455623 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a794a8d-dfdf-4bc1-ac5b-3db4dabf1529 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:42.456093 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a794a8d-dfdf-4bc1-ac5b-3db4dabf1529 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.457256 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING py.warnings [None req-3a794a8d-dfdf-4bc1-ac5b-3db4dabf1529 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:26:42.457256 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: warnings.warn(msg) Oct 15 03:26:42.457256 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: Oct 15 03:26:42.458678 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a794a8d-dfdf-4bc1-ac5b-3db4dabf1529 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.470755 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-69a649b6-af3f-4c3a-b37e-310c4787b8b9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:26:42.471997 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 235/468] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:42.473973 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a649b6-af3f-4c3a-b37e-310c4787b8b9 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.483323 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 234/469] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:42.484430 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a794a8d-dfdf-4bc1-ac5b-3db4dabf1529 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.485051 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a649b6-af3f-4c3a-b37e-310c4787b8b9 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.496849 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c06ae8-b987-440f-89ad-38ca68adef9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.497780 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c06ae8-b987-440f-89ad-38ca68adef9d admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.498222 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c06ae8-b987-440f-89ad-38ca68adef9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.498616 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c06ae8-b987-440f-89ad-38ca68adef9d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.500669 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a794a8d-dfdf-4bc1-ac5b-3db4dabf1529 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.505225 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc1aea-29ca-4464-a0c6-212d2b47b26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.506010 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc1aea-29ca-4464-a0c6-212d2b47b26f admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.506446 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc1aea-29ca-4464-a0c6-212d2b47b26f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.506858 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc1aea-29ca-4464-a0c6-212d2b47b26f admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.507834 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc1aea-29ca-4464-a0c6-212d2b47b26f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:42.508289 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc1aea-29ca-4464-a0c6-212d2b47b26f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.509905 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c06ae8-b987-440f-89ad-38ca68adef9d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.510525 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc1aea-29ca-4464-a0c6-212d2b47b26f admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.511918 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c06ae8-b987-440f-89ad-38ca68adef9d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.523124 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 235/470] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:42.529831 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc1aea-29ca-4464-a0c6-212d2b47b26f admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.532257 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-f0c06ae8-b987-440f-89ad-38ca68adef9d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:42.533904 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 236/471] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:42.536355 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c06ae8-b987-440f-89ad-38ca68adef9d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.546446 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc1aea-29ca-4464-a0c6-212d2b47b26f admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.546722 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c06ae8-b987-440f-89ad-38ca68adef9d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.551334 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1f667-11b7-4673-9bc4-67de825df16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.551787 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27761d40-abf8-435d-829e-8b967a37af2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.552276 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1f667-11b7-4673-9bc4-67de825df16e admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.552559 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1f667-11b7-4673-9bc4-67de825df16e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.552889 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1f667-11b7-4673-9bc4-67de825df16e admin admin] PATH_INFO: `/v3/projects/9f95c04b0a7b4a2d8fbb4b547f70dc20/users/3d71a1bd93b04249b2b8e6a054de44c7/roles/04a530eb7b7e46d4a07b4c3b02cee3aa` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.553245 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27761d40-abf8-435d-829e-8b967a37af2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.553657 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27761d40-abf8-435d-829e-8b967a37af2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.554076 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27761d40-abf8-435d-829e-8b967a37af2f admin admin] PATH_INFO: `/v3/projects/9f95c04b0a7b4a2d8fbb4b547f70dc20/users/4edffc4b89f74ce590a2dd7b8fc904bf/roles/04a530eb7b7e46d4a07b4c3b02cee3aa` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.569333 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27761d40-abf8-435d-829e-8b967a37af2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user_id=4edffc4b89f74ce590a2dd7b8fc904bf, role_id=04a530eb7b7e46d4a07b4c3b02cee3aa)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.572484 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27761d40-abf8-435d-829e-8b967a37af2f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.574776 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1f667-11b7-4673-9bc4-67de825df16e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user_id=3d71a1bd93b04249b2b8e6a054de44c7, role_id=04a530eb7b7e46d4a07b4c3b02cee3aa)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.577480 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1f667-11b7-4673-9bc4-67de825df16e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.585198 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 237/472] 10.222.0.30 () {58 vars in 1460 bytes} [Fri Oct 15 03:26:42 2021] PUT /identity/v3/projects/9f95c04b0a7b4a2d8fbb4b547f70dc20/users/4edffc4b89f74ce590a2dd7b8fc904bf/roles/04a530eb7b7e46d4a07b4c3b02cee3aa => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:26:42.586072 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27761d40-abf8-435d-829e-8b967a37af2f admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.592461 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 236/473] 10.222.0.30 () {58 vars in 1460 bytes} [Fri Oct 15 03:26:42 2021] PUT /identity/v3/projects/9f95c04b0a7b4a2d8fbb4b547f70dc20/users/3d71a1bd93b04249b2b8e6a054de44c7/roles/04a530eb7b7e46d4a07b4c3b02cee3aa => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:26:42.594116 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa22287-5e80-42d2-b998-5aea5a7c60e1 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.594594 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa22287-5e80-42d2-b998-5aea5a7c60e1 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.595056 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa22287-5e80-42d2-b998-5aea5a7c60e1 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.602396 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 237/474] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:42 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:42.604515 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e972d5d-7d33-40e3-8a1b-b7baea9cbfaf None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.604915 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e972d5d-7d33-40e3-8a1b-b7baea9cbfaf None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.605301 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e972d5d-7d33-40e3-8a1b-b7baea9cbfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.628675 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-8e972d5d-7d33-40e3-8a1b-b7baea9cbfaf None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:42.630090 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-8e972d5d-7d33-40e3-8a1b-b7baea9cbfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:42.678890 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27761d40-abf8-435d-829e-8b967a37af2f admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.694138 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 238/475] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:42.719563 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e972d5d-7d33-40e3-8a1b-b7baea9cbfaf None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.730423 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e972d5d-7d33-40e3-8a1b-b7baea9cbfaf None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.735541 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf089a-7f08-40cf-80ca-a12249337e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.736278 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf089a-7f08-40cf-80ca-a12249337e7e admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.736694 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf089a-7f08-40cf-80ca-a12249337e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.737064 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf089a-7f08-40cf-80ca-a12249337e7e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.748684 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf089a-7f08-40cf-80ca-a12249337e7e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:42.749988 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df52571-0540-4ca6-bd12-aabac78dc28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.751158 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df52571-0540-4ca6-bd12-aabac78dc28a admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.751598 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df52571-0540-4ca6-bd12-aabac78dc28a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.752050 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df52571-0540-4ca6-bd12-aabac78dc28a admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.752955 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df52571-0540-4ca6-bd12-aabac78dc28a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:42.753416 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df52571-0540-4ca6-bd12-aabac78dc28a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.755308 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df52571-0540-4ca6-bd12-aabac78dc28a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.757156 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-ccbf089a-7f08-40cf-80ca-a12249337e7e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 03:26:42.758691 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 239/476] 10.222.0.30 () {56 vars in 1123 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:42.765584 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf089a-7f08-40cf-80ca-a12249337e7e admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.768926 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 238/477] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:42.775784 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df52571-0540-4ca6-bd12-aabac78dc28a admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.783712 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf089a-7f08-40cf-80ca-a12249337e7e admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.787318 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df52571-0540-4ca6-bd12-aabac78dc28a admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.793331 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a154aa-d25d-4a46-9721-ce661f7b3e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.794435 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a154aa-d25d-4a46-9721-ce661f7b3e4b admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.794854 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a154aa-d25d-4a46-9721-ce661f7b3e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.795394 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a154aa-d25d-4a46-9721-ce661f7b3e4b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.795968 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04f3ab-4b01-4658-9769-7718589a0299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.796787 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04f3ab-4b01-4658-9769-7718589a0299 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.797175 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04f3ab-4b01-4658-9769-7718589a0299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.797552 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04f3ab-4b01-4658-9769-7718589a0299 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.798464 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04f3ab-4b01-4658-9769-7718589a0299 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:42.798832 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04f3ab-4b01-4658-9769-7718589a0299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.800633 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04f3ab-4b01-4658-9769-7718589a0299 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.805054 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a154aa-d25d-4a46-9721-ce661f7b3e4b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.808092 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a154aa-d25d-4a46-9721-ce661f7b3e4b admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.819027 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 240/478] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:42.825946 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-e3a154aa-d25d-4a46-9721-ce661f7b3e4b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:26:42.826256 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04f3ab-4b01-4658-9769-7718589a0299 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.827602 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 239/479] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:42.834110 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a154aa-d25d-4a46-9721-ce661f7b3e4b admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.840588 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04f3ab-4b01-4658-9769-7718589a0299 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.851588 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdb8d0-4671-43a7-85df-52e93e3b8605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.854449 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdb8d0-4671-43a7-85df-52e93e3b8605 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.855932 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdb8d0-4671-43a7-85df-52e93e3b8605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.856389 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdb8d0-4671-43a7-85df-52e93e3b8605 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.860873 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a154aa-d25d-4a46-9721-ce661f7b3e4b admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.871310 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ded87d-5cd4-44e8-a9e7-3b4efb72f408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.873490 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ded87d-5cd4-44e8-a9e7-3b4efb72f408 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.873927 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ded87d-5cd4-44e8-a9e7-3b4efb72f408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.874726 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ded87d-5cd4-44e8-a9e7-3b4efb72f408 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.879274 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ded87d-5cd4-44e8-a9e7-3b4efb72f408 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:42.879869 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ded87d-5cd4-44e8-a9e7-3b4efb72f408 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.885015 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ded87d-5cd4-44e8-a9e7-3b4efb72f408 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.886957 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdb8d0-4671-43a7-85df-52e93e3b8605 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.890082 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdb8d0-4671-43a7-85df-52e93e3b8605 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.906707 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 240/480] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:42.913488 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ded87d-5cd4-44e8-a9e7-3b4efb72f408 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.924360 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-94cdb8d0-4671-43a7-85df-52e93e3b8605 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:42.925934 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 241/481] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:42.930362 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ded87d-5cd4-44e8-a9e7-3b4efb72f408 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.933147 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdb8d0-4671-43a7-85df-52e93e3b8605 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:42.945621 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdb8d0-4671-43a7-85df-52e93e3b8605 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:42.950362 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483cb5ad-1869-405d-8fe4-58e79ec94e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.951423 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cb5ad-1869-405d-8fe4-58e79ec94e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.952360 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cb5ad-1869-405d-8fe4-58e79ec94e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.953210 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cb5ad-1869-405d-8fe4-58e79ec94e7c admin admin] PATH_INFO: `/v3/projects/9f95c04b0a7b4a2d8fbb4b547f70dc20/users/456c83b8619847279927251ca48fca37/roles/04a530eb7b7e46d4a07b4c3b02cee3aa` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.956392 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d927ec8-5cf6-499e-9678-007dca53a562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:42.958497 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d927ec8-5cf6-499e-9678-007dca53a562 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:42.960253 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d927ec8-5cf6-499e-9678-007dca53a562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:42.960253 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d927ec8-5cf6-499e-9678-007dca53a562 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:42.966600 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d927ec8-5cf6-499e-9678-007dca53a562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:42.967010 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d927ec8-5cf6-499e-9678-007dca53a562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.968771 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d927ec8-5cf6-499e-9678-007dca53a562 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.988272 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 242/482] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:42.989390 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483cb5ad-1869-405d-8fe4-58e79ec94e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user_id=456c83b8619847279927251ca48fca37, role_id=04a530eb7b7e46d4a07b4c3b02cee3aa)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:42.992376 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483cb5ad-1869-405d-8fe4-58e79ec94e7c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:42.995207 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d927ec8-5cf6-499e-9678-007dca53a562 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:43.006989 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d927ec8-5cf6-499e-9678-007dca53a562 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:43.013061 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 241/483] 10.222.0.30 () {58 vars in 1460 bytes} [Fri Oct 15 03:26:42 2021] PUT /identity/v3/projects/9f95c04b0a7b4a2d8fbb4b547f70dc20/users/456c83b8619847279927251ca48fca37/roles/04a530eb7b7e46d4a07b4c3b02cee3aa => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:26:43.068824 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae2c90-6aaa-48f1-a5e5-f09498ce1bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:43.069788 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae2c90-6aaa-48f1-a5e5-f09498ce1bdf admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:43.070182 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae2c90-6aaa-48f1-a5e5-f09498ce1bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:43.070575 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae2c90-6aaa-48f1-a5e5-f09498ce1bdf admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:43.079589 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae2c90-6aaa-48f1-a5e5-f09498ce1bdf admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:43.082013 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae2c90-6aaa-48f1-a5e5-f09498ce1bdf admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:43.097360 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6270676-8a5b-438b-8f7e-4031e3df37d7 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:43.097644 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6270676-8a5b-438b-8f7e-4031e3df37d7 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:43.097918 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6270676-8a5b-438b-8f7e-4031e3df37d7 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:43.098854 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-b0ae2c90-6aaa-48f1-a5e5-f09498ce1bdf admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 15 03:26:43.100027 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 242/484] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:43 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:26:43.100551 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 243/485] 10.222.0.30 () {56 vars in 1123 bytes} [Fri Oct 15 03:26:42 2021] GET /identity/v3/users/neutron => generated 85 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:43.106962 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48749fd4-316e-41e9-b176-c65f9bc97854 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:43.107188 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae2c90-6aaa-48f1-a5e5-f09498ce1bdf admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:43.107282 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48749fd4-316e-41e9-b176-c65f9bc97854 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:43.107512 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48749fd4-316e-41e9-b176-c65f9bc97854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:43.117698 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae2c90-6aaa-48f1-a5e5-f09498ce1bdf admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:43.122689 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5c6bb-631e-4fcd-a69b-4e8e727f3961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:43.123516 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5c6bb-631e-4fcd-a69b-4e8e727f3961 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:43.123941 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5c6bb-631e-4fcd-a69b-4e8e727f3961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:43.124315 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5c6bb-631e-4fcd-a69b-4e8e727f3961 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:43.125408 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5c6bb-631e-4fcd-a69b-4e8e727f3961 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:43.125703 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5c6bb-631e-4fcd-a69b-4e8e727f3961 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:43.127663 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5c6bb-631e-4fcd-a69b-4e8e727f3961 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:43.147218 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 244/486] 10.222.0.30 () {56 vars in 1160 bytes} [Fri Oct 15 03:26:43 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:43.148290 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-48749fd4-316e-41e9-b176-c65f9bc97854 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:43.150139 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-48749fd4-316e-41e9-b176-c65f9bc97854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:43.157401 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5c6bb-631e-4fcd-a69b-4e8e727f3961 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:43.172085 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 243/487] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:43.175563 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5c6bb-631e-4fcd-a69b-4e8e727f3961 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:43.180492 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8271f8-ed89-446b-aa85-5994a760941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:43.181532 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8271f8-ed89-446b-aa85-5994a760941f admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:43.181951 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8271f8-ed89-446b-aa85-5994a760941f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:43.182322 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8271f8-ed89-446b-aa85-5994a760941f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:43.194780 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8271f8-ed89-446b-aa85-5994a760941f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:43.197487 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8271f8-ed89-446b-aa85-5994a760941f admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:43.216966 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48749fd4-316e-41e9-b176-c65f9bc97854 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:43.224824 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-4f8271f8-ed89-446b-aa85-5994a760941f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:43.227880 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48749fd4-316e-41e9-b176-c65f9bc97854 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:43.232864 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 245/488] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:43.237599 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8271f8-ed89-446b-aa85-5994a760941f admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:43.247146 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d07092-8e11-4640-9322-5fca6d9cc427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:43.248111 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d07092-8e11-4640-9322-5fca6d9cc427 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:43.248376 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d07092-8e11-4640-9322-5fca6d9cc427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:43.248650 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d07092-8e11-4640-9322-5fca6d9cc427 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:43.258789 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8271f8-ed89-446b-aa85-5994a760941f admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:43.263843 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d07092-8e11-4640-9322-5fca6d9cc427 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:43.265195 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db96e7-24b2-4a08-83be-76d1a71227c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:43.266236 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db96e7-24b2-4a08-83be-76d1a71227c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:43.266737 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db96e7-24b2-4a08-83be-76d1a71227c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:43.267277 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db96e7-24b2-4a08-83be-76d1a71227c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:43.268310 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db96e7-24b2-4a08-83be-76d1a71227c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:43.268840 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db96e7-24b2-4a08-83be-76d1a71227c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:43.270684 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-76d07092-8e11-4640-9322-5fca6d9cc427 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 03:26:43.271005 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db96e7-24b2-4a08-83be-76d1a71227c6 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:43.273111 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 244/489] 10.222.0.30 () {56 vars in 1123 bytes} [Fri Oct 15 03:26:43 2021] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:43.280332 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d07092-8e11-4640-9322-5fca6d9cc427 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:43.285657 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 246/490] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:43.293498 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db96e7-24b2-4a08-83be-76d1a71227c6 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:43.296913 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d07092-8e11-4640-9322-5fca6d9cc427 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:43.302133 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e0c81-ce4e-4b1e-8826-65ad82df9671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:43.303171 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e0c81-ce4e-4b1e-8826-65ad82df9671 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:43.303556 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e0c81-ce4e-4b1e-8826-65ad82df9671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:43.303960 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e0c81-ce4e-4b1e-8826-65ad82df9671 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:43.304820 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e0c81-ce4e-4b1e-8826-65ad82df9671 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:43.305225 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e0c81-ce4e-4b1e-8826-65ad82df9671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:43.306503 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db96e7-24b2-4a08-83be-76d1a71227c6 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:43.307723 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e0c81-ce4e-4b1e-8826-65ad82df9671 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:43.312196 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b362cb-2dca-4419-9a7c-10ee615b234f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:43.313248 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b362cb-2dca-4419-9a7c-10ee615b234f admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:43.313695 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b362cb-2dca-4419-9a7c-10ee615b234f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:43.314193 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b362cb-2dca-4419-9a7c-10ee615b234f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:43.318814 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 245/491] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Oct 15 03:26:43 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:43.323294 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b362cb-2dca-4419-9a7c-10ee615b234f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:43.325153 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e0c81-ce4e-4b1e-8826-65ad82df9671 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:43.325744 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b362cb-2dca-4419-9a7c-10ee615b234f admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:43.337806 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e0c81-ce4e-4b1e-8826-65ad82df9671 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:43.342128 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-f2b362cb-2dca-4419-9a7c-10ee615b234f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:26:43.342654 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc918619-e67c-4406-bec4-c6a57ab29346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:43.343528 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc918619-e67c-4406-bec4-c6a57ab29346 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:43.343977 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc918619-e67c-4406-bec4-c6a57ab29346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:43.344346 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc918619-e67c-4406-bec4-c6a57ab29346 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:43.344508 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 247/492] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:43.351264 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b362cb-2dca-4419-9a7c-10ee615b234f admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:43.362493 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc918619-e67c-4406-bec4-c6a57ab29346 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:43.363330 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b362cb-2dca-4419-9a7c-10ee615b234f admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:43.364677 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc918619-e67c-4406-bec4-c6a57ab29346 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:43.369567 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17934243-910f-472a-baaa-727e5f0b9166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:43.370476 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17934243-910f-472a-baaa-727e5f0b9166 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:43.370906 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17934243-910f-472a-baaa-727e5f0b9166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:43.371372 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17934243-910f-472a-baaa-727e5f0b9166 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:43.372854 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17934243-910f-472a-baaa-727e5f0b9166 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:43.373335 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17934243-910f-472a-baaa-727e5f0b9166 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:43.376043 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17934243-910f-472a-baaa-727e5f0b9166 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:43.386235 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-bc918619-e67c-4406-bec4-c6a57ab29346 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:43.388168 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 246/493] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:43.389225 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 248/494] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:26:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:43.393950 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc918619-e67c-4406-bec4-c6a57ab29346 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:43.395829 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17934243-910f-472a-baaa-727e5f0b9166 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:43.404658 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc918619-e67c-4406-bec4-c6a57ab29346 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:43.405702 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17934243-910f-472a-baaa-727e5f0b9166 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:43.410154 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aef2d6-3159-40a9-8cd5-b12c30f3cc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:43.410536 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58977e9-d8a3-4219-8503-ab1bd78d4451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:43.411155 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aef2d6-3159-40a9-8cd5-b12c30f3cc77 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:43.411583 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aef2d6-3159-40a9-8cd5-b12c30f3cc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:43.411738 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58977e9-d8a3-4219-8503-ab1bd78d4451 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:43.412141 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58977e9-d8a3-4219-8503-ab1bd78d4451 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:43.412286 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aef2d6-3159-40a9-8cd5-b12c30f3cc77 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:43.412606 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58977e9-d8a3-4219-8503-ab1bd78d4451 admin admin] PATH_INFO: `/v3/projects/9f95c04b0a7b4a2d8fbb4b547f70dc20/users/3ea75b4f9132494388b223a309a40640/roles/04a530eb7b7e46d4a07b4c3b02cee3aa` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:43.413408 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aef2d6-3159-40a9-8cd5-b12c30f3cc77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:43.413867 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aef2d6-3159-40a9-8cd5-b12c30f3cc77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:43.415842 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aef2d6-3159-40a9-8cd5-b12c30f3cc77 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:43.428889 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58977e9-d8a3-4219-8503-ab1bd78d4451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user_id=3ea75b4f9132494388b223a309a40640, role_id=04a530eb7b7e46d4a07b4c3b02cee3aa)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:43.429636 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 247/495] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:43.435737 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58977e9-d8a3-4219-8503-ab1bd78d4451 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:43.436984 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aef2d6-3159-40a9-8cd5-b12c30f3cc77 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:43.447236 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 249/496] 10.222.0.30 () {58 vars in 1460 bytes} [Fri Oct 15 03:26:43 2021] PUT /identity/v3/projects/9f95c04b0a7b4a2d8fbb4b547f70dc20/users/3ea75b4f9132494388b223a309a40640/roles/04a530eb7b7e46d4a07b4c3b02cee3aa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:26:43.457786 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aef2d6-3159-40a9-8cd5-b12c30f3cc77 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:43.537041 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee986036-cb50-489b-b9d4-8e891ad6307f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:43.538190 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee986036-cb50-489b-b9d4-8e891ad6307f admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:43.538751 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee986036-cb50-489b-b9d4-8e891ad6307f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:43.539255 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee986036-cb50-489b-b9d4-8e891ad6307f admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:43.552122 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee986036-cb50-489b-b9d4-8e891ad6307f admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:43.554539 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee986036-cb50-489b-b9d4-8e891ad6307f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:43.575431 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-ee986036-cb50-489b-b9d4-8e891ad6307f admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 15 03:26:43.577095 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 248/497] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:26:43 2021] GET /identity/v3/users/swift => generated 83 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:43.583634 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58977e9-d8a3-4219-8503-ab1bd78d4451 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:43.595278 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58977e9-d8a3-4219-8503-ab1bd78d4451 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:43.605534 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695125d-6e50-41fd-bf5a-2c131f753de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:43.606636 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695125d-6e50-41fd-bf5a-2c131f753de0 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:43.607176 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695125d-6e50-41fd-bf5a-2c131f753de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:43.607649 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695125d-6e50-41fd-bf5a-2c131f753de0 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:43.608807 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695125d-6e50-41fd-bf5a-2c131f753de0 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:43.609321 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695125d-6e50-41fd-bf5a-2c131f753de0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:43.611574 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695125d-6e50-41fd-bf5a-2c131f753de0 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:43.637405 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 250/498] 10.222.0.30 () {56 vars in 1156 bytes} [Fri Oct 15 03:26:43 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:43.643378 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee986036-cb50-489b-b9d4-8e891ad6307f admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:43.654698 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee986036-cb50-489b-b9d4-8e891ad6307f admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:43.662576 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77bc844-2669-4a66-bb1a-728321d7ec3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:43.663651 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bc844-2669-4a66-bb1a-728321d7ec3a admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:43.664230 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bc844-2669-4a66-bb1a-728321d7ec3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:43.664782 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bc844-2669-4a66-bb1a-728321d7ec3a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:43.680170 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77bc844-2669-4a66-bb1a-728321d7ec3a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:43.683013 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77bc844-2669-4a66-bb1a-728321d7ec3a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:43.698352 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 249/499] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:43.704776 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695125d-6e50-41fd-bf5a-2c131f753de0 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:43.720821 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695125d-6e50-41fd-bf5a-2c131f753de0 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:43.729358 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e8cc1-2141-460a-9c3c-a9dcc0ad5591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:43.730574 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e8cc1-2141-460a-9c3c-a9dcc0ad5591 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:43.731098 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e8cc1-2141-460a-9c3c-a9dcc0ad5591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:43.731584 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e8cc1-2141-460a-9c3c-a9dcc0ad5591 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:43.747625 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e8cc1-2141-460a-9c3c-a9dcc0ad5591 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:43.747625 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e8cc1-2141-460a-9c3c-a9dcc0ad5591 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:43.770579 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-b55e8cc1-2141-460a-9c3c-a9dcc0ad5591 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:43.771817 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 251/500] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:43.778640 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77bc844-2669-4a66-bb1a-728321d7ec3a admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:43.789499 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77bc844-2669-4a66-bb1a-728321d7ec3a admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:43.798517 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76031a3-d7dc-4814-96df-4908e00d01ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:43.799503 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76031a3-d7dc-4814-96df-4908e00d01ae admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:43.800017 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76031a3-d7dc-4814-96df-4908e00d01ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:43.800513 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76031a3-d7dc-4814-96df-4908e00d01ae admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:43.801495 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76031a3-d7dc-4814-96df-4908e00d01ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:43.802048 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76031a3-d7dc-4814-96df-4908e00d01ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:43.803854 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76031a3-d7dc-4814-96df-4908e00d01ae admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:43.821267 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 250/501] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:43.827478 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e8cc1-2141-460a-9c3c-a9dcc0ad5591 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:43.846088 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e8cc1-2141-460a-9c3c-a9dcc0ad5591 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:43.850956 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308264c-beeb-4a0a-a7fd-94cf2823374b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:43.851751 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308264c-beeb-4a0a-a7fd-94cf2823374b admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:43.852039 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308264c-beeb-4a0a-a7fd-94cf2823374b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:43.852318 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308264c-beeb-4a0a-a7fd-94cf2823374b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:43.862696 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308264c-beeb-4a0a-a7fd-94cf2823374b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:43.864714 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308264c-beeb-4a0a-a7fd-94cf2823374b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:43.886934 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-a308264c-beeb-4a0a-a7fd-94cf2823374b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:26:43.888479 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 252/502] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:43.894751 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76031a3-d7dc-4814-96df-4908e00d01ae admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:43.908607 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76031a3-d7dc-4814-96df-4908e00d01ae admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:43.917207 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883ea49-8e2b-4312-9ed3-bf481357bd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:43.917832 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883ea49-8e2b-4312-9ed3-bf481357bd00 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:43.918113 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883ea49-8e2b-4312-9ed3-bf481357bd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:43.918441 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883ea49-8e2b-4312-9ed3-bf481357bd00 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:43.919247 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e883ea49-8e2b-4312-9ed3-bf481357bd00 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:43.919552 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e883ea49-8e2b-4312-9ed3-bf481357bd00 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:43.921419 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e883ea49-8e2b-4312-9ed3-bf481357bd00 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:43.941820 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 251/503] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:26:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:43.948876 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308264c-beeb-4a0a-a7fd-94cf2823374b admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:43.965283 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308264c-beeb-4a0a-a7fd-94cf2823374b admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:43.973937 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadd35c-c1a4-4549-9067-0d90fe838352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:43.974520 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadd35c-c1a4-4549-9067-0d90fe838352 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:43.974807 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadd35c-c1a4-4549-9067-0d90fe838352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:43.975082 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadd35c-c1a4-4549-9067-0d90fe838352 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:43.975943 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dadd35c-c1a4-4549-9067-0d90fe838352 admin admin] RBAC: Adding query filter params (role.id=04a530eb7b7e46d4a07b4c3b02cee3aa, scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user.id=dfdf0fb38dd04c75a1c874913ea1bf98) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:43.976254 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dadd35c-c1a4-4549-9067-0d90fe838352 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:43.978134 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dadd35c-c1a4-4549-9067-0d90fe838352 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:43.987963 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 253/504] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:43 2021] GET /identity/v3/role_assignments?user.id=dfdf0fb38dd04c75a1c874913ea1bf98&scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20&role.id=04a530eb7b7e46d4a07b4c3b02cee3aa => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:45.385257 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c769426-9e36-4222-89aa-e8221d74a364 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:45.386162 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c769426-9e36-4222-89aa-e8221d74a364 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:45.386162 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c769426-9e36-4222-89aa-e8221d74a364 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:45.387835 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 252/505] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:45.394067 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652db2a-b2bd-4167-b76a-15cfe78cbd54 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:45.394564 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652db2a-b2bd-4167-b76a-15cfe78cbd54 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:45.394719 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652db2a-b2bd-4167-b76a-15cfe78cbd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:45.420661 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-3652db2a-b2bd-4167-b76a-15cfe78cbd54 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:45.421857 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-3652db2a-b2bd-4167-b76a-15cfe78cbd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:45.429787 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 254/506] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:45.470177 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c769426-9e36-4222-89aa-e8221d74a364 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:45.485502 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c769426-9e36-4222-89aa-e8221d74a364 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:45.494331 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1964f80-1c05-4072-bb43-885ba9edac02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:45.495438 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1964f80-1c05-4072-bb43-885ba9edac02 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:45.495957 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1964f80-1c05-4072-bb43-885ba9edac02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:45.496428 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1964f80-1c05-4072-bb43-885ba9edac02 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:45.511982 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1964f80-1c05-4072-bb43-885ba9edac02 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:45.519161 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-e1964f80-1c05-4072-bb43-885ba9edac02 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 03:26:45.520615 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 253/507] 10.222.0.30 () {56 vars in 1123 bytes} [Fri Oct 15 03:26:45 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:45.527132 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652db2a-b2bd-4167-b76a-15cfe78cbd54 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:45.540809 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652db2a-b2bd-4167-b76a-15cfe78cbd54 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:45.552600 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97962077-19b2-42a8-ab69-28b74d7aa46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:45.553294 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97962077-19b2-42a8-ab69-28b74d7aa46b admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:45.553578 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97962077-19b2-42a8-ab69-28b74d7aa46b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:45.553859 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97962077-19b2-42a8-ab69-28b74d7aa46b admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:45.554638 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97962077-19b2-42a8-ab69-28b74d7aa46b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:45.554941 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97962077-19b2-42a8-ab69-28b74d7aa46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:45.557186 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97962077-19b2-42a8-ab69-28b74d7aa46b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:45.570175 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 255/508] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Oct 15 03:26:45 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:45.577164 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1964f80-1c05-4072-bb43-885ba9edac02 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:45.591959 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1964f80-1c05-4072-bb43-885ba9edac02 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:45.599742 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12b1c8-81fe-4cf4-808c-673add8d5ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:45.600881 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12b1c8-81fe-4cf4-808c-673add8d5ffe admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:45.601389 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12b1c8-81fe-4cf4-808c-673add8d5ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:45.601858 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12b1c8-81fe-4cf4-808c-673add8d5ffe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:45.619825 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12b1c8-81fe-4cf4-808c-673add8d5ffe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:45.621931 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12b1c8-81fe-4cf4-808c-673add8d5ffe admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:45.645766 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-3f12b1c8-81fe-4cf4-808c-673add8d5ffe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:45.647151 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 254/509] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:45.653762 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97962077-19b2-42a8-ab69-28b74d7aa46b admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:45.672883 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97962077-19b2-42a8-ab69-28b74d7aa46b admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:45.690068 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec2453-41e2-4e0a-8f10-6be15e99d084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:45.690745 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec2453-41e2-4e0a-8f10-6be15e99d084 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:45.691027 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec2453-41e2-4e0a-8f10-6be15e99d084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:45.691304 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec2453-41e2-4e0a-8f10-6be15e99d084 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:45.692077 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec2453-41e2-4e0a-8f10-6be15e99d084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:45.692378 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec2453-41e2-4e0a-8f10-6be15e99d084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:45.694013 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec2453-41e2-4e0a-8f10-6be15e99d084 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:45.718758 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 256/510] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:45.725140 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12b1c8-81fe-4cf4-808c-673add8d5ffe admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:45.734428 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da9990-d143-41e5-b755-90c25f29a492 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:45.735061 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da9990-d143-41e5-b755-90c25f29a492 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:45.735540 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da9990-d143-41e5-b755-90c25f29a492 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:45.738009 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 257/511] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:45 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:26:45.741836 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12b1c8-81fe-4cf4-808c-673add8d5ffe admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:45.745598 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93eace-7c1d-429d-955b-dc168d7ed7ac None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:45.746110 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93eace-7c1d-429d-955b-dc168d7ed7ac None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:45.746612 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93eace-7c1d-429d-955b-dc168d7ed7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:45.757346 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787aaae-1fa3-4ee6-8d9a-3263f0948170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:45.758146 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787aaae-1fa3-4ee6-8d9a-3263f0948170 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:45.758425 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787aaae-1fa3-4ee6-8d9a-3263f0948170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:45.758731 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787aaae-1fa3-4ee6-8d9a-3263f0948170 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:45.767232 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-1c93eace-7c1d-429d-955b-dc168d7ed7ac None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:45.768838 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-1c93eace-7c1d-429d-955b-dc168d7ed7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:45.777782 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787aaae-1fa3-4ee6-8d9a-3263f0948170 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:45.777782 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787aaae-1fa3-4ee6-8d9a-3263f0948170 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:45.788085 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 258/512] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:26:45.798989 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-b787aaae-1fa3-4ee6-8d9a-3263f0948170 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 15 03:26:45.803920 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 255/513] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:45 2021] GET /identity/v3/users/cinder => generated 84 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:45.806657 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93eace-7c1d-429d-955b-dc168d7ed7ac None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:45.820737 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93eace-7c1d-429d-955b-dc168d7ed7ac None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:45.830084 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49fea8-5d79-474a-bd5a-a94fe7591705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:45.830745 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49fea8-5d79-474a-bd5a-a94fe7591705 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:45.831026 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49fea8-5d79-474a-bd5a-a94fe7591705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:45.831302 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49fea8-5d79-474a-bd5a-a94fe7591705 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:45.832198 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49fea8-5d79-474a-bd5a-a94fe7591705 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:45.832506 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49fea8-5d79-474a-bd5a-a94fe7591705 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:45.834374 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49fea8-5d79-474a-bd5a-a94fe7591705 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:45.855037 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787aaae-1fa3-4ee6-8d9a-3263f0948170 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:45.869571 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787aaae-1fa3-4ee6-8d9a-3263f0948170 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:45.875589 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 259/514] 10.222.0.30 () {56 vars in 1158 bytes} [Fri Oct 15 03:26:45 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:45.880811 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839b856-2658-41ef-a330-3014a623127e None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:45.881648 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839b856-2658-41ef-a330-3014a623127e None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:45.881784 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb639c9-6fd5-4730-a34e-476313fa7793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:45.882275 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839b856-2658-41ef-a330-3014a623127e None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:45.882474 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb639c9-6fd5-4730-a34e-476313fa7793 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:45.882761 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb639c9-6fd5-4730-a34e-476313fa7793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:45.883033 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb639c9-6fd5-4730-a34e-476313fa7793 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:45.885748 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 260/515] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:45 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:26:45.886729 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839b856-2658-41ef-a330-3014a623127e None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:45.899119 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb639c9-6fd5-4730-a34e-476313fa7793 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:45.901918 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839b856-2658-41ef-a330-3014a623127e None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:45.906678 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-aeb639c9-6fd5-4730-a34e-476313fa7793 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 03:26:45.906911 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e02e2b-b401-4188-bb34-d511598a3df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:45.908030 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 256/516] 10.222.0.30 () {56 vars in 1123 bytes} [Fri Oct 15 03:26:45 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:45.911591 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55161f-1eec-46b3-b61d-1d86ea2a9876 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:45.911591 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55161f-1eec-46b3-b61d-1d86ea2a9876 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:45.911591 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55161f-1eec-46b3-b61d-1d86ea2a9876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:45.913663 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e02e2b-b401-4188-bb34-d511598a3df2 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:45.914176 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e02e2b-b401-4188-bb34-d511598a3df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:45.914609 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e02e2b-b401-4188-bb34-d511598a3df2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:45.925691 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e02e2b-b401-4188-bb34-d511598a3df2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:45.927664 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e02e2b-b401-4188-bb34-d511598a3df2 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:45.927865 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-2b55161f-1eec-46b3-b61d-1d86ea2a9876 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:45.929107 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-2b55161f-1eec-46b3-b61d-1d86ea2a9876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:45.937612 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 257/517] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:45.938392 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55161f-1eec-46b3-b61d-1d86ea2a9876 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:45.939167 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 261/518] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:45 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:45.947931 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e02e2b-b401-4188-bb34-d511598a3df2 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:45.953541 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55161f-1eec-46b3-b61d-1d86ea2a9876 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:45.961374 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e02e2b-b401-4188-bb34-d511598a3df2 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:45.963928 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d5668-0694-4b4d-82d7-24e82e050bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:45.964577 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d5668-0694-4b4d-82d7-24e82e050bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:45.964858 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d5668-0694-4b4d-82d7-24e82e050bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:45.965130 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d5668-0694-4b4d-82d7-24e82e050bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:45.965882 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d5668-0694-4b4d-82d7-24e82e050bc2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:45.966185 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d5668-0694-4b4d-82d7-24e82e050bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:45.967798 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d5668-0694-4b4d-82d7-24e82e050bc2 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:45.974247 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da645f-e392-4d28-84ff-dca1d2d82632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:45.975254 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da645f-e392-4d28-84ff-dca1d2d82632 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:45.975369 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da645f-e392-4d28-84ff-dca1d2d82632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:45.975560 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da645f-e392-4d28-84ff-dca1d2d82632 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:45.983125 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 258/519] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Oct 15 03:26:45 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:45.983880 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d5668-0694-4b4d-82d7-24e82e050bc2 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:45.997851 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da645f-e392-4d28-84ff-dca1d2d82632 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:45.999628 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da645f-e392-4d28-84ff-dca1d2d82632 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.006004 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d5668-0694-4b4d-82d7-24e82e050bc2 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.011831 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80e90a-a750-42bb-8aa9-a7dad0c59279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.012921 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80e90a-a750-42bb-8aa9-a7dad0c59279 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.013410 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80e90a-a750-42bb-8aa9-a7dad0c59279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.013931 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80e90a-a750-42bb-8aa9-a7dad0c59279 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.017110 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-d5da645f-e392-4d28-84ff-dca1d2d82632 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:46.018276 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 262/520] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:46.018887 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da645f-e392-4d28-84ff-dca1d2d82632 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.031554 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80e90a-a750-42bb-8aa9-a7dad0c59279 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:46.033408 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da645f-e392-4d28-84ff-dca1d2d82632 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.038144 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c16a6-c36f-4a8e-9b84-2072fd3f9f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.038945 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c16a6-c36f-4a8e-9b84-2072fd3f9f4b admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.039227 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c16a6-c36f-4a8e-9b84-2072fd3f9f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.039498 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c16a6-c36f-4a8e-9b84-2072fd3f9f4b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.040930 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-fc80e90a-a750-42bb-8aa9-a7dad0c59279 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 03:26:46.048097 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 259/521] 10.222.0.30 () {56 vars in 1123 bytes} [Fri Oct 15 03:26:45 2021] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:46.049028 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80e90a-a750-42bb-8aa9-a7dad0c59279 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.057194 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c16a6-c36f-4a8e-9b84-2072fd3f9f4b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.060171 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c16a6-c36f-4a8e-9b84-2072fd3f9f4b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.061626 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80e90a-a750-42bb-8aa9-a7dad0c59279 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.066234 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa02bfd-02e4-43b0-a6df-4a9bc189322a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.066930 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa02bfd-02e4-43b0-a6df-4a9bc189322a admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.067211 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa02bfd-02e4-43b0-a6df-4a9bc189322a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.067535 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa02bfd-02e4-43b0-a6df-4a9bc189322a admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.068301 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa02bfd-02e4-43b0-a6df-4a9bc189322a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:46.068601 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa02bfd-02e4-43b0-a6df-4a9bc189322a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.070276 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa02bfd-02e4-43b0-a6df-4a9bc189322a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.082288 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-5f5c16a6-c36f-4a8e-9b84-2072fd3f9f4b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:46.082862 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 260/522] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:46.089733 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa02bfd-02e4-43b0-a6df-4a9bc189322a admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.090099 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 263/523] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:46.091200 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c16a6-c36f-4a8e-9b84-2072fd3f9f4b admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.100865 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa02bfd-02e4-43b0-a6df-4a9bc189322a admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.103831 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c16a6-c36f-4a8e-9b84-2072fd3f9f4b admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.106257 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aea16b-4026-47e3-b85e-3dbd4a8ca7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.106914 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aea16b-4026-47e3-b85e-3dbd4a8ca7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.107197 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aea16b-4026-47e3-b85e-3dbd4a8ca7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.107471 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aea16b-4026-47e3-b85e-3dbd4a8ca7f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.108388 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aea16b-4026-47e3-b85e-3dbd4a8ca7f3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:46.108779 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aea16b-4026-47e3-b85e-3dbd4a8ca7f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.109965 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29c7a9-fd37-4313-8624-4a9e3bab26f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.110365 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aea16b-4026-47e3-b85e-3dbd4a8ca7f3 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.111107 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29c7a9-fd37-4313-8624-4a9e3bab26f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.111827 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29c7a9-fd37-4313-8624-4a9e3bab26f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.112304 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29c7a9-fd37-4313-8624-4a9e3bab26f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.113580 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29c7a9-fd37-4313-8624-4a9e3bab26f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:46.114101 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29c7a9-fd37-4313-8624-4a9e3bab26f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.116349 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29c7a9-fd37-4313-8624-4a9e3bab26f3 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.124834 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 261/524] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:46.124834 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aea16b-4026-47e3-b85e-3dbd4a8ca7f3 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.134141 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 264/525] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:46.134970 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29c7a9-fd37-4313-8624-4a9e3bab26f3 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.144229 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aea16b-4026-47e3-b85e-3dbd4a8ca7f3 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.146095 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29c7a9-fd37-4313-8624-4a9e3bab26f3 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.149755 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dafbbc-2ffe-4fc2-83b8-9ecb9e410430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.150897 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dafbbc-2ffe-4fc2-83b8-9ecb9e410430 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.151094 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc13efe-a6dd-48e0-801c-62c1352aa635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.151662 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dafbbc-2ffe-4fc2-83b8-9ecb9e410430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.151882 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc13efe-a6dd-48e0-801c-62c1352aa635 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.152169 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc13efe-a6dd-48e0-801c-62c1352aa635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.152447 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc13efe-a6dd-48e0-801c-62c1352aa635 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.152808 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dafbbc-2ffe-4fc2-83b8-9ecb9e410430 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.161923 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dafbbc-2ffe-4fc2-83b8-9ecb9e410430 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.163471 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc13efe-a6dd-48e0-801c-62c1352aa635 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.165404 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dafbbc-2ffe-4fc2-83b8-9ecb9e410430 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.165910 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc13efe-a6dd-48e0-801c-62c1352aa635 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.182463 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-46dafbbc-2ffe-4fc2-83b8-9ecb9e410430 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:26:46.182772 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-acc13efe-a6dd-48e0-801c-62c1352aa635 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:46.190083 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 262/527] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:46.190208 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 265/527] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:46.190208 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc13efe-a6dd-48e0-801c-62c1352aa635 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.192321 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dafbbc-2ffe-4fc2-83b8-9ecb9e410430 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.199842 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc13efe-a6dd-48e0-801c-62c1352aa635 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.203837 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dafbbc-2ffe-4fc2-83b8-9ecb9e410430 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.204245 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6840ae-1494-48d5-abe1-24afb552bd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.204998 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6840ae-1494-48d5-abe1-24afb552bd58 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.205281 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6840ae-1494-48d5-abe1-24afb552bd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.205556 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6840ae-1494-48d5-abe1-24afb552bd58 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.210652 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6d9b1-09a3-42c1-9add-12ffac42aeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.211599 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6d9b1-09a3-42c1-9add-12ffac42aeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.212712 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6d9b1-09a3-42c1-9add-12ffac42aeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.213309 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6d9b1-09a3-42c1-9add-12ffac42aeb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.214556 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6840ae-1494-48d5-abe1-24afb552bd58 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.214929 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6d9b1-09a3-42c1-9add-12ffac42aeb1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:46.215431 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6d9b1-09a3-42c1-9add-12ffac42aeb1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.216605 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6840ae-1494-48d5-abe1-24afb552bd58 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.217986 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6d9b1-09a3-42c1-9add-12ffac42aeb1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.230173 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-4d6840ae-1494-48d5-abe1-24afb552bd58 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 15 03:26:46.231371 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 266/528] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/users/nova => generated 82 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:46.232223 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6840ae-1494-48d5-abe1-24afb552bd58 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.233118 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 263/529] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:46.241045 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6d9b1-09a3-42c1-9add-12ffac42aeb1 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.244781 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6840ae-1494-48d5-abe1-24afb552bd58 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.252371 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fdac3-6fb2-4a40-9d08-2be1ccb1b1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.253290 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fdac3-6fb2-4a40-9d08-2be1ccb1b1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.253719 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fdac3-6fb2-4a40-9d08-2be1ccb1b1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.254163 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fdac3-6fb2-4a40-9d08-2be1ccb1b1c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.255082 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fdac3-6fb2-4a40-9d08-2be1ccb1b1c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:46.255549 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fdac3-6fb2-4a40-9d08-2be1ccb1b1c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.257417 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fdac3-6fb2-4a40-9d08-2be1ccb1b1c9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.260778 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6d9b1-09a3-42c1-9add-12ffac42aeb1 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.266544 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829f341-a08b-408b-972b-76fef49145cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.267211 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829f341-a08b-408b-972b-76fef49145cc admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.267580 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829f341-a08b-408b-972b-76fef49145cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.267888 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829f341-a08b-408b-972b-76fef49145cc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.270311 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829f341-a08b-408b-972b-76fef49145cc admin admin] RBAC: Adding query filter params (role.id=04a530eb7b7e46d4a07b4c3b02cee3aa, scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user.id=4edffc4b89f74ce590a2dd7b8fc904bf) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:46.271389 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829f341-a08b-408b-972b-76fef49145cc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.273885 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829f341-a08b-408b-972b-76fef49145cc admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.275156 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 267/530] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:46.280366 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fdac3-6fb2-4a40-9d08-2be1ccb1b1c9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.281118 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 264/531] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/role_assignments?user.id=4edffc4b89f74ce590a2dd7b8fc904bf&scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20&role.id=04a530eb7b7e46d4a07b4c3b02cee3aa => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:46.288773 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829f341-a08b-408b-972b-76fef49145cc admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.292403 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fdac3-6fb2-4a40-9d08-2be1ccb1b1c9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.298465 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70949388-35d7-46da-90dc-5b62da8affce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.299494 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70949388-35d7-46da-90dc-5b62da8affce admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.300061 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70949388-35d7-46da-90dc-5b62da8affce admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.300544 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70949388-35d7-46da-90dc-5b62da8affce admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.301619 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70949388-35d7-46da-90dc-5b62da8affce admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:46.302166 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70949388-35d7-46da-90dc-5b62da8affce admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.304319 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70949388-35d7-46da-90dc-5b62da8affce admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.308844 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829f341-a08b-408b-972b-76fef49145cc admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.316718 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3e6a4-ad2f-41c1-b58a-e7bb6ea056be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.322158 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3e6a4-ad2f-41c1-b58a-e7bb6ea056be admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.322771 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3e6a4-ad2f-41c1-b58a-e7bb6ea056be admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.323251 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3e6a4-ad2f-41c1-b58a-e7bb6ea056be admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.339456 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3e6a4-ad2f-41c1-b58a-e7bb6ea056be admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.342032 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3e6a4-ad2f-41c1-b58a-e7bb6ea056be admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.348792 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 268/532] 10.222.0.30 () {56 vars in 1154 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:46.353425 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70949388-35d7-46da-90dc-5b62da8affce admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.367549 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-49e3e6a4-ad2f-41c1-b58a-e7bb6ea056be admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 15 03:26:46.372346 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70949388-35d7-46da-90dc-5b62da8affce admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.373059 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 265/533] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/users/glance => generated 84 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:46.380191 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3e6a4-ad2f-41c1-b58a-e7bb6ea056be admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.383177 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0ae2f-96c6-4513-aeb3-ad244c93f923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.384960 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0ae2f-96c6-4513-aeb3-ad244c93f923 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.385488 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0ae2f-96c6-4513-aeb3-ad244c93f923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.385972 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0ae2f-96c6-4513-aeb3-ad244c93f923 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.395038 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0ae2f-96c6-4513-aeb3-ad244c93f923 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.397662 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0ae2f-96c6-4513-aeb3-ad244c93f923 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.402473 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3e6a4-ad2f-41c1-b58a-e7bb6ea056be admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.408832 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 269/534] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:26:46.411504 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effecd7-f179-4fed-8b99-335d4f9dcc3c None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.412073 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effecd7-f179-4fed-8b99-335d4f9dcc3c None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.412560 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effecd7-f179-4fed-8b99-335d4f9dcc3c None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.414556 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 270/535] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:26:46.415534 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effecd7-f179-4fed-8b99-335d4f9dcc3c None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.417301 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f8da8-6680-4839-a91f-7bce6dd76fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.417960 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f8da8-6680-4839-a91f-7bce6dd76fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.418241 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f8da8-6680-4839-a91f-7bce6dd76fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.418527 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f8da8-6680-4839-a91f-7bce6dd76fd9 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.419372 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f8da8-6680-4839-a91f-7bce6dd76fd9 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:46.419696 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f8da8-6680-4839-a91f-7bce6dd76fd9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.421539 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f8da8-6680-4839-a91f-7bce6dd76fd9 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.430075 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effecd7-f179-4fed-8b99-335d4f9dcc3c None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.436761 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f4d7e-8866-4fa3-bd37-e51214b869d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.437833 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f4d7e-8866-4fa3-bd37-e51214b869d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.438262 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f4d7e-8866-4fa3-bd37-e51214b869d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.438680 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f4d7e-8866-4fa3-bd37-e51214b869d7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.445214 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 266/536] 10.222.0.30 () {56 vars in 1158 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:46.452314 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee9ddf-1b23-4b75-adc5-2febb38e5c96 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.452314 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee9ddf-1b23-4b75-adc5-2febb38e5c96 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.452314 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee9ddf-1b23-4b75-adc5-2febb38e5c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.458916 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f4d7e-8866-4fa3-bd37-e51214b869d7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.461715 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f4d7e-8866-4fa3-bd37-e51214b869d7 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.466583 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-a9ee9ddf-1b23-4b75-adc5-2febb38e5c96 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:46.467804 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-a9ee9ddf-1b23-4b75-adc5-2febb38e5c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:46.476032 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 267/537] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:46.481784 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-941f4d7e-8866-4fa3-bd37-e51214b869d7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:46.483607 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 271/538] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:46.484533 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee9ddf-1b23-4b75-adc5-2febb38e5c96 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.489464 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f4d7e-8866-4fa3-bd37-e51214b869d7 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.502956 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee9ddf-1b23-4b75-adc5-2febb38e5c96 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.505676 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f4d7e-8866-4fa3-bd37-e51214b869d7 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.508213 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abf363-7868-4915-b11c-848ce928e497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.509639 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abf363-7868-4915-b11c-848ce928e497 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.510127 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abf363-7868-4915-b11c-848ce928e497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.510581 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abf363-7868-4915-b11c-848ce928e497 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.511070 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8353a9-5067-423e-8316-57ea2e2cb010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.511761 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8353a9-5067-423e-8316-57ea2e2cb010 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.512046 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8353a9-5067-423e-8316-57ea2e2cb010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.512366 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8353a9-5067-423e-8316-57ea2e2cb010 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.513110 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8353a9-5067-423e-8316-57ea2e2cb010 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:46.513460 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8353a9-5067-423e-8316-57ea2e2cb010 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.515198 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8353a9-5067-423e-8316-57ea2e2cb010 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.521589 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abf363-7868-4915-b11c-848ce928e497 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.525237 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abf363-7868-4915-b11c-848ce928e497 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.534036 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 272/539] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:46.534984 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8353a9-5067-423e-8316-57ea2e2cb010 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.539936 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 268/540] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:46.544358 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abf363-7868-4915-b11c-848ce928e497 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.551861 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8353a9-5067-423e-8316-57ea2e2cb010 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.555230 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abf363-7868-4915-b11c-848ce928e497 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.557339 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163eb90b-2f14-4426-b37f-067bda0810e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.558180 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163eb90b-2f14-4426-b37f-067bda0810e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.559203 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163eb90b-2f14-4426-b37f-067bda0810e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.559497 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163eb90b-2f14-4426-b37f-067bda0810e5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.561007 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba528d9-9326-469a-a2ab-f507343f9e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.562035 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba528d9-9326-469a-a2ab-f507343f9e69 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.562316 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba528d9-9326-469a-a2ab-f507343f9e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.562593 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba528d9-9326-469a-a2ab-f507343f9e69 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.570403 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba528d9-9326-469a-a2ab-f507343f9e69 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.572463 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba528d9-9326-469a-a2ab-f507343f9e69 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.572895 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163eb90b-2f14-4426-b37f-067bda0810e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:46.579807 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-163eb90b-2f14-4426-b37f-067bda0810e5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 03:26:46.581171 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 273/541] 10.222.0.30 () {56 vars in 1123 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:46.584414 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163eb90b-2f14-4426-b37f-067bda0810e5 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.586239 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-bba528d9-9326-469a-a2ab-f507343f9e69 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:26:46.588120 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 269/542] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:46.590309 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba528d9-9326-469a-a2ab-f507343f9e69 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.595553 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163eb90b-2f14-4426-b37f-067bda0810e5 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.600418 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eeeb4d-5531-4445-bde1-a35fa3d2d21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.601221 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eeeb4d-5531-4445-bde1-a35fa3d2d21a admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.601502 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eeeb4d-5531-4445-bde1-a35fa3d2d21a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.601690 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba528d9-9326-469a-a2ab-f507343f9e69 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.601846 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eeeb4d-5531-4445-bde1-a35fa3d2d21a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.607329 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667a3d2-c7e2-4c7f-9674-b292698a50fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.608279 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667a3d2-c7e2-4c7f-9674-b292698a50fe admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.608701 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667a3d2-c7e2-4c7f-9674-b292698a50fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.609119 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667a3d2-c7e2-4c7f-9674-b292698a50fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.610153 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667a3d2-c7e2-4c7f-9674-b292698a50fe admin admin] RBAC: Adding query filter params (name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:46.610536 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667a3d2-c7e2-4c7f-9674-b292698a50fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.612335 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667a3d2-c7e2-4c7f-9674-b292698a50fe admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.614526 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eeeb4d-5531-4445-bde1-a35fa3d2d21a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.616712 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eeeb4d-5531-4445-bde1-a35fa3d2d21a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.626485 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 270/543] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:46.627534 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667a3d2-c7e2-4c7f-9674-b292698a50fe admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.639292 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667a3d2-c7e2-4c7f-9674-b292698a50fe admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.644246 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc0eb8-e29f-476e-8c67-41c08a4a32e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.644467 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-07eeeb4d-5531-4445-bde1-a35fa3d2d21a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:46.645351 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc0eb8-e29f-476e-8c67-41c08a4a32e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.645665 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 274/544] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:46.645992 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc0eb8-e29f-476e-8c67-41c08a4a32e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.646423 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc0eb8-e29f-476e-8c67-41c08a4a32e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.646521 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eeeb4d-5531-4445-bde1-a35fa3d2d21a admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.647580 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc0eb8-e29f-476e-8c67-41c08a4a32e8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:46.648181 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc0eb8-e29f-476e-8c67-41c08a4a32e8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.650246 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc0eb8-e29f-476e-8c67-41c08a4a32e8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.656652 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eeeb4d-5531-4445-bde1-a35fa3d2d21a admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.661564 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e7af8-addb-4e10-a789-8d87a91bc522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.662320 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e7af8-addb-4e10-a789-8d87a91bc522 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.662821 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e7af8-addb-4e10-a789-8d87a91bc522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.662923 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 271/545] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:46.663006 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e7af8-addb-4e10-a789-8d87a91bc522 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.663447 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc0eb8-e29f-476e-8c67-41c08a4a32e8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.675151 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e7af8-addb-4e10-a789-8d87a91bc522 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.677084 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e7af8-addb-4e10-a789-8d87a91bc522 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.681977 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc0eb8-e29f-476e-8c67-41c08a4a32e8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.686440 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df31727-b883-4166-b9f0-220c72ece974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.687082 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df31727-b883-4166-b9f0-220c72ece974 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.687367 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df31727-b883-4166-b9f0-220c72ece974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.687643 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df31727-b883-4166-b9f0-220c72ece974 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.688425 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df31727-b883-4166-b9f0-220c72ece974 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:46.688731 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df31727-b883-4166-b9f0-220c72ece974 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.690315 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df31727-b883-4166-b9f0-220c72ece974 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.697860 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-846e7af8-addb-4e10-a789-8d87a91bc522 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:46.699337 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 275/546] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:46.704460 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 272/547] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:46.705361 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e7af8-addb-4e10-a789-8d87a91bc522 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.705701 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df31727-b883-4166-b9f0-220c72ece974 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.716777 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df31727-b883-4166-b9f0-220c72ece974 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.718178 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e7af8-addb-4e10-a789-8d87a91bc522 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.721723 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61364a57-f563-4f13-a067-ca39bce9770c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.722443 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61364a57-f563-4f13-a067-ca39bce9770c admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.722728 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61364a57-f563-4f13-a067-ca39bce9770c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.723001 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61364a57-f563-4f13-a067-ca39bce9770c admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.723148 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75d0e9-0fea-46c9-bad1-2040b8b9eee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.724027 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61364a57-f563-4f13-a067-ca39bce9770c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:46.724215 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75d0e9-0fea-46c9-bad1-2040b8b9eee8 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.724318 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61364a57-f563-4f13-a067-ca39bce9770c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.724506 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75d0e9-0fea-46c9-bad1-2040b8b9eee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.724735 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75d0e9-0fea-46c9-bad1-2040b8b9eee8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.725685 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75d0e9-0fea-46c9-bad1-2040b8b9eee8 admin admin] RBAC: Adding query filter params (role.id=04a530eb7b7e46d4a07b4c3b02cee3aa, scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user.id=3d71a1bd93b04249b2b8e6a054de44c7) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:46.725905 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61364a57-f563-4f13-a067-ca39bce9770c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.726073 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75d0e9-0fea-46c9-bad1-2040b8b9eee8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.728817 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75d0e9-0fea-46c9-bad1-2040b8b9eee8 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.736396 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 276/548] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/role_assignments?user.id=3d71a1bd93b04249b2b8e6a054de44c7&scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20&role.id=04a530eb7b7e46d4a07b4c3b02cee3aa => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:46.737186 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75d0e9-0fea-46c9-bad1-2040b8b9eee8 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.737843 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 273/549] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:46.743933 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61364a57-f563-4f13-a067-ca39bce9770c admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.757389 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61364a57-f563-4f13-a067-ca39bce9770c admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.757977 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75d0e9-0fea-46c9-bad1-2040b8b9eee8 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.762896 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544287dd-2101-48c0-936d-163eb7e84b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.763091 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6c488-8d50-4de6-b81d-a1326a9ee950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.763842 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6c488-8d50-4de6-b81d-a1326a9ee950 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.763949 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544287dd-2101-48c0-936d-163eb7e84b1a admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.764141 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544287dd-2101-48c0-936d-163eb7e84b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.764241 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6c488-8d50-4de6-b81d-a1326a9ee950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.764434 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544287dd-2101-48c0-936d-163eb7e84b1a admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.764590 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6c488-8d50-4de6-b81d-a1326a9ee950 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.773145 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6c488-8d50-4de6-b81d-a1326a9ee950 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.774215 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544287dd-2101-48c0-936d-163eb7e84b1a admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.775896 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6c488-8d50-4de6-b81d-a1326a9ee950 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.777007 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544287dd-2101-48c0-936d-163eb7e84b1a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.791217 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-bbb6c488-8d50-4de6-b81d-a1326a9ee950 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:26:46.791933 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-544287dd-2101-48c0-936d-163eb7e84b1a admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 15 03:26:46.792897 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 277/550] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:46.793405 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 274/551] 10.222.0.30 () {56 vars in 1123 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/users/neutron => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:46.799160 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758d098-81ad-4bdc-ad4a-3318a95725fd None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.799491 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758d098-81ad-4bdc-ad4a-3318a95725fd None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.799797 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758d098-81ad-4bdc-ad4a-3318a95725fd None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.800010 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544287dd-2101-48c0-936d-163eb7e84b1a admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.804110 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 278/552] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:46 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:46.805081 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758d098-81ad-4bdc-ad4a-3318a95725fd None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.811188 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544287dd-2101-48c0-936d-163eb7e84b1a admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.816044 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aec5e8-e26f-4787-9526-5948b4226c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.816819 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aec5e8-e26f-4787-9526-5948b4226c26 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.817192 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aec5e8-e26f-4787-9526-5948b4226c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.817545 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aec5e8-e26f-4787-9526-5948b4226c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.818427 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aec5e8-e26f-4787-9526-5948b4226c26 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:46.818816 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aec5e8-e26f-4787-9526-5948b4226c26 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.820799 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aec5e8-e26f-4787-9526-5948b4226c26 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.822756 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758d098-81ad-4bdc-ad4a-3318a95725fd None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.827802 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e3e68-b796-4702-a00b-472fb334eea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.828841 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e3e68-b796-4702-a00b-472fb334eea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.829340 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e3e68-b796-4702-a00b-472fb334eea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.829794 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e3e68-b796-4702-a00b-472fb334eea4 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.830928 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e3e68-b796-4702-a00b-472fb334eea4 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:46.831469 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e3e68-b796-4702-a00b-472fb334eea4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.833689 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e3e68-b796-4702-a00b-472fb334eea4 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.835149 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 275/553] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:46.836385 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954734ee-5293-4fd4-bea4-1d7cb66e6778 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.836784 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954734ee-5293-4fd4-bea4-1d7cb66e6778 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.837131 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954734ee-5293-4fd4-bea4-1d7cb66e6778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.855367 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 279/554] 10.222.0.30 () {56 vars in 1160 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:46.856753 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e3e68-b796-4702-a00b-472fb334eea4 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.856995 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-954734ee-5293-4fd4-bea4-1d7cb66e6778 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:46.858363 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-954734ee-5293-4fd4-bea4-1d7cb66e6778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:46.867006 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 276/555] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:46.871775 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954734ee-5293-4fd4-bea4-1d7cb66e6778 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.872856 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e3e68-b796-4702-a00b-472fb334eea4 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.879030 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954734ee-5293-4fd4-bea4-1d7cb66e6778 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.884370 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76877eb-d84b-454c-964d-1aeba21ac141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.884566 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a29fc0-077d-43da-8911-7449fdda95be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.885211 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76877eb-d84b-454c-964d-1aeba21ac141 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.885564 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76877eb-d84b-454c-964d-1aeba21ac141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.885913 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a29fc0-077d-43da-8911-7449fdda95be admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.886017 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76877eb-d84b-454c-964d-1aeba21ac141 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.886464 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a29fc0-077d-43da-8911-7449fdda95be admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.886927 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a29fc0-077d-43da-8911-7449fdda95be admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.888048 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a29fc0-077d-43da-8911-7449fdda95be admin admin] RBAC: Adding query filter params (role.id=04a530eb7b7e46d4a07b4c3b02cee3aa, scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user.id=456c83b8619847279927251ca48fca37) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:46.888624 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a29fc0-077d-43da-8911-7449fdda95be admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.895830 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76877eb-d84b-454c-964d-1aeba21ac141 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.896574 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a29fc0-077d-43da-8911-7449fdda95be admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.897904 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76877eb-d84b-454c-964d-1aeba21ac141 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.908482 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 277/556] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:46.911304 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 280/557] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/role_assignments?user.id=456c83b8619847279927251ca48fca37&scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20&role.id=04a530eb7b7e46d4a07b4c3b02cee3aa => generated 608 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:46.916840 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76877eb-d84b-454c-964d-1aeba21ac141 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.918725 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a29fc0-077d-43da-8911-7449fdda95be admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:46.927066 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76877eb-d84b-454c-964d-1aeba21ac141 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.937974 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98842ed-229d-4056-a5ed-a3b044e0aa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.938804 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98842ed-229d-4056-a5ed-a3b044e0aa39 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.940510 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98842ed-229d-4056-a5ed-a3b044e0aa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.940803 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98842ed-229d-4056-a5ed-a3b044e0aa39 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.941563 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a29fc0-077d-43da-8911-7449fdda95be admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:46.951324 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81563fc-5311-400a-a48e-5c2041ecd8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:46.956444 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81563fc-5311-400a-a48e-5c2041ecd8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:46.956767 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81563fc-5311-400a-a48e-5c2041ecd8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:46.957002 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81563fc-5311-400a-a48e-5c2041ecd8c3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:46.960319 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98842ed-229d-4056-a5ed-a3b044e0aa39 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:46.962930 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98842ed-229d-4056-a5ed-a3b044e0aa39 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:46.984704 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81563fc-5311-400a-a48e-5c2041ecd8c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:46.984899 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-d98842ed-229d-4056-a5ed-a3b044e0aa39 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:46.986021 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 278/558] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:46.992114 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-c81563fc-5311-400a-a48e-5c2041ecd8c3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 03:26:46.994269 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 281/559] 10.222.0.30 () {56 vars in 1123 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/roles/service => generated 85 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:46.997858 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98842ed-229d-4056-a5ed-a3b044e0aa39 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:47.004813 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81563fc-5311-400a-a48e-5c2041ecd8c3 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:47.009782 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98842ed-229d-4056-a5ed-a3b044e0aa39 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:47.015726 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81563fc-5311-400a-a48e-5c2041ecd8c3 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:47.020123 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054bfdc-12de-48a5-acac-420904f72545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:47.020826 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054bfdc-12de-48a5-acac-420904f72545 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:47.021105 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054bfdc-12de-48a5-acac-420904f72545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:47.021373 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054bfdc-12de-48a5-acac-420904f72545 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:47.022115 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054bfdc-12de-48a5-acac-420904f72545 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:47.022415 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054bfdc-12de-48a5-acac-420904f72545 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:47.024080 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054bfdc-12de-48a5-acac-420904f72545 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:47.027225 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cba01-b8ac-484a-8b4b-b2eb26708caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:47.028093 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cba01-b8ac-484a-8b4b-b2eb26708caa admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:47.028445 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cba01-b8ac-484a-8b4b-b2eb26708caa admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:47.028796 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cba01-b8ac-484a-8b4b-b2eb26708caa admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:47.029691 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793cba01-b8ac-484a-8b4b-b2eb26708caa admin admin] RBAC: Adding query filter params (name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:47.030066 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793cba01-b8ac-484a-8b4b-b2eb26708caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:47.031924 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793cba01-b8ac-484a-8b4b-b2eb26708caa admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:47.038193 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 279/560] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:47.042986 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 282/561] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Oct 15 03:26:47 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:47.047722 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054bfdc-12de-48a5-acac-420904f72545 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:47.049701 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cba01-b8ac-484a-8b4b-b2eb26708caa admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:47.059211 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054bfdc-12de-48a5-acac-420904f72545 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:47.060208 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cba01-b8ac-484a-8b4b-b2eb26708caa admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:47.064919 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bdf33-7153-4dea-ba1e-75dc448b1efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:47.065832 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bdf33-7153-4dea-ba1e-75dc448b1efb admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:47.066118 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bdf33-7153-4dea-ba1e-75dc448b1efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:47.066396 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bdf33-7153-4dea-ba1e-75dc448b1efb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:47.079222 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36a27b-2628-4a64-bcdf-a8e11fc90e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:47.080091 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36a27b-2628-4a64-bcdf-a8e11fc90e92 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:47.080378 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36a27b-2628-4a64-bcdf-a8e11fc90e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:47.080654 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36a27b-2628-4a64-bcdf-a8e11fc90e92 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:47.081732 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bdf33-7153-4dea-ba1e-75dc448b1efb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:47.084185 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bdf33-7153-4dea-ba1e-75dc448b1efb admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:47.089745 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36a27b-2628-4a64-bcdf-a8e11fc90e92 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:47.091847 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36a27b-2628-4a64-bcdf-a8e11fc90e92 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:47.107121 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-970bdf33-7153-4dea-ba1e-75dc448b1efb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:47.108539 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-eb36a27b-2628-4a64-bcdf-a8e11fc90e92 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:26:47.110027 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 283/563] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:47.110212 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 280/563] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:47.117084 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36a27b-2628-4a64-bcdf-a8e11fc90e92 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:47.118652 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bdf33-7153-4dea-ba1e-75dc448b1efb admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:47.129622 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bdf33-7153-4dea-ba1e-75dc448b1efb admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:47.129867 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36a27b-2628-4a64-bcdf-a8e11fc90e92 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:47.135493 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe953134-12c1-4ef0-948a-37ed0559d626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:47.135669 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bec64a-450a-4231-be20-9996d42ea8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:47.136361 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bec64a-450a-4231-be20-9996d42ea8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:47.136643 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bec64a-450a-4231-be20-9996d42ea8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:47.136919 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bec64a-450a-4231-be20-9996d42ea8c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:47.137393 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe953134-12c1-4ef0-948a-37ed0559d626 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:47.137669 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bec64a-450a-4231-be20-9996d42ea8c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:47.137975 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bec64a-450a-4231-be20-9996d42ea8c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:47.138287 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe953134-12c1-4ef0-948a-37ed0559d626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:47.138808 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe953134-12c1-4ef0-948a-37ed0559d626 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:47.139593 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bec64a-450a-4231-be20-9996d42ea8c9 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:47.140174 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe953134-12c1-4ef0-948a-37ed0559d626 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:47.140685 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe953134-12c1-4ef0-948a-37ed0559d626 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:47.142817 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe953134-12c1-4ef0-948a-37ed0559d626 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:47.152939 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 281/564] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:47.161261 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bec64a-450a-4231-be20-9996d42ea8c9 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:47.162561 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 284/565] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:26:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:47.169593 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe953134-12c1-4ef0-948a-37ed0559d626 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:47.173620 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bec64a-450a-4231-be20-9996d42ea8c9 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:47.181030 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0e108-b7f7-4411-a0cb-5cb5019c10e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:47.181197 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0e108-b7f7-4411-a0cb-5cb5019c10e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:47.181487 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0e108-b7f7-4411-a0cb-5cb5019c10e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:47.181763 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0e108-b7f7-4411-a0cb-5cb5019c10e4 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:47.183619 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe953134-12c1-4ef0-948a-37ed0559d626 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:47.189565 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adaff2-68f6-48ec-bf6f-45752289ad53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:47.190280 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adaff2-68f6-48ec-bf6f-45752289ad53 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:47.190635 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adaff2-68f6-48ec-bf6f-45752289ad53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:47.190998 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adaff2-68f6-48ec-bf6f-45752289ad53 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:47.191950 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51adaff2-68f6-48ec-bf6f-45752289ad53 admin admin] RBAC: Adding query filter params (role.id=04a530eb7b7e46d4a07b4c3b02cee3aa, scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user.id=3ea75b4f9132494388b223a309a40640) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:47.192055 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0e108-b7f7-4411-a0cb-5cb5019c10e4 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:47.192381 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51adaff2-68f6-48ec-bf6f-45752289ad53 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:47.194023 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0e108-b7f7-4411-a0cb-5cb5019c10e4 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:47.194324 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51adaff2-68f6-48ec-bf6f-45752289ad53 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:47.203278 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 285/566] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:47 2021] GET /identity/v3/role_assignments?user.id=3ea75b4f9132494388b223a309a40640&scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20&role.id=04a530eb7b7e46d4a07b4c3b02cee3aa => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:47.215833 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-8af0e108-b7f7-4411-a0cb-5cb5019c10e4 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 15 03:26:47.217745 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 282/567] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:26:47 2021] GET /identity/v3/users/swift => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:47.225680 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adaff2-68f6-48ec-bf6f-45752289ad53 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:47.245798 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adaff2-68f6-48ec-bf6f-45752289ad53 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:47.253366 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4a5e6-d822-40e3-ba99-31358224879f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:47.254487 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4a5e6-d822-40e3-ba99-31358224879f admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:47.254977 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4a5e6-d822-40e3-ba99-31358224879f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:47.255513 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4a5e6-d822-40e3-ba99-31358224879f admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:47.256640 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4a5e6-d822-40e3-ba99-31358224879f admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:47.257289 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4a5e6-d822-40e3-ba99-31358224879f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:47.260179 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4a5e6-d822-40e3-ba99-31358224879f admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:47.281807 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 286/568] 10.222.0.30 () {56 vars in 1156 bytes} [Fri Oct 15 03:26:47 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:47.287652 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0e108-b7f7-4411-a0cb-5cb5019c10e4 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:47.302504 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0e108-b7f7-4411-a0cb-5cb5019c10e4 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:47.307846 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489eb102-5505-4276-adb4-df6d02c4415e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:47.308646 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489eb102-5505-4276-adb4-df6d02c4415e admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:47.308926 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489eb102-5505-4276-adb4-df6d02c4415e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:47.309193 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489eb102-5505-4276-adb4-df6d02c4415e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:47.322394 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489eb102-5505-4276-adb4-df6d02c4415e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:47.326016 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489eb102-5505-4276-adb4-df6d02c4415e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:47.343755 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-489eb102-5505-4276-adb4-df6d02c4415e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:47.345347 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 283/569] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:47.351985 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4a5e6-d822-40e3-ba99-31358224879f admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:47.363446 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4a5e6-d822-40e3-ba99-31358224879f admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:47.368794 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9d92b-4d6a-4cbb-a657-7184c3237c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:47.369464 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9d92b-4d6a-4cbb-a657-7184c3237c84 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:47.369798 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9d92b-4d6a-4cbb-a657-7184c3237c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:47.370073 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9d92b-4d6a-4cbb-a657-7184c3237c84 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:47.370864 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9d92b-4d6a-4cbb-a657-7184c3237c84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:47.371173 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9d92b-4d6a-4cbb-a657-7184c3237c84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:47.372813 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9d92b-4d6a-4cbb-a657-7184c3237c84 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:47.388734 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 287/570] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:47.395335 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489eb102-5505-4276-adb4-df6d02c4415e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:47.405947 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489eb102-5505-4276-adb4-df6d02c4415e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:47.410844 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308fa88-418b-43e2-8c0f-731a7a8074c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:47.411644 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308fa88-418b-43e2-8c0f-731a7a8074c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:47.412071 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308fa88-418b-43e2-8c0f-731a7a8074c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:47.412343 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308fa88-418b-43e2-8c0f-731a7a8074c5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:47.421407 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308fa88-418b-43e2-8c0f-731a7a8074c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:47.423511 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308fa88-418b-43e2-8c0f-731a7a8074c5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:47.439123 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-2308fa88-418b-43e2-8c0f-731a7a8074c5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:26:47.440789 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 284/571] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:47.447430 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9d92b-4d6a-4cbb-a657-7184c3237c84 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:47.457433 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9d92b-4d6a-4cbb-a657-7184c3237c84 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:47.462152 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80902992-667f-4562-a3eb-f956f8ea62aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:47.462862 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80902992-667f-4562-a3eb-f956f8ea62aa admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:47.463143 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80902992-667f-4562-a3eb-f956f8ea62aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:47.463418 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80902992-667f-4562-a3eb-f956f8ea62aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:47.464317 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80902992-667f-4562-a3eb-f956f8ea62aa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:47.464623 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80902992-667f-4562-a3eb-f956f8ea62aa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:47.466585 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80902992-667f-4562-a3eb-f956f8ea62aa admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:47.482240 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 288/572] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:26:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:47.489020 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308fa88-418b-43e2-8c0f-731a7a8074c5 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:47.499971 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308fa88-418b-43e2-8c0f-731a7a8074c5 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:47.506379 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11c7b1-6465-4c46-9935-5ce6dd801518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:47.507309 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11c7b1-6465-4c46-9935-5ce6dd801518 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:47.507641 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11c7b1-6465-4c46-9935-5ce6dd801518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:47.507947 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11c7b1-6465-4c46-9935-5ce6dd801518 admin admin] PATH_INFO: `/v3/projects/9f95c04b0a7b4a2d8fbb4b547f70dc20/users/dfdf0fb38dd04c75a1c874913ea1bf98/roles/04a530eb7b7e46d4a07b4c3b02cee3aa` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:47.524562 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11c7b1-6465-4c46-9935-5ce6dd801518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user_id=dfdf0fb38dd04c75a1c874913ea1bf98, role_id=04a530eb7b7e46d4a07b4c3b02cee3aa)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:47.527215 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11c7b1-6465-4c46-9935-5ce6dd801518 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:47.548624 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 285/573] 10.222.0.30 () {58 vars in 1460 bytes} [Fri Oct 15 03:26:47 2021] PUT /identity/v3/projects/9f95c04b0a7b4a2d8fbb4b547f70dc20/users/dfdf0fb38dd04c75a1c874913ea1bf98/roles/04a530eb7b7e46d4a07b4c3b02cee3aa => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:26:49.051050 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdfa92-33b1-461e-9806-46372639d7a6 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:49.051784 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdfa92-33b1-461e-9806-46372639d7a6 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:49.051784 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdfa92-33b1-461e-9806-46372639d7a6 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:49.053731 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 289/574] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:49.060404 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f017f-08c1-41cd-97a3-b5638168052e None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:49.060879 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f017f-08c1-41cd-97a3-b5638168052e None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:49.061045 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f017f-08c1-41cd-97a3-b5638168052e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:49.079262 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-379f017f-08c1-41cd-97a3-b5638168052e None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:49.084491 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-379f017f-08c1-41cd-97a3-b5638168052e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:49.164071 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 286/575] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:49.203978 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdfa92-33b1-461e-9806-46372639d7a6 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:49.225913 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdfa92-33b1-461e-9806-46372639d7a6 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:49.235818 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173d21c-6216-4e11-86af-8e5566c2e091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:49.236621 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173d21c-6216-4e11-86af-8e5566c2e091 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:49.236894 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173d21c-6216-4e11-86af-8e5566c2e091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:49.237166 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173d21c-6216-4e11-86af-8e5566c2e091 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:49.238046 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173d21c-6216-4e11-86af-8e5566c2e091 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:49.238827 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING py.warnings [None req-d173d21c-6216-4e11-86af-8e5566c2e091 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:26:49.238827 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: warnings.warn(msg) Oct 15 03:26:49.238827 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: Oct 15 03:26:49.239744 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173d21c-6216-4e11-86af-8e5566c2e091 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:49.261041 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-d173d21c-6216-4e11-86af-8e5566c2e091 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 15 03:26:49.262614 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 290/576] 10.222.0.30 () {56 vars in 1150 bytes} [Fri Oct 15 03:26:49 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:49.269179 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f017f-08c1-41cd-97a3-b5638168052e None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:49.283260 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f017f-08c1-41cd-97a3-b5638168052e None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:49.294978 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57cf24-2c9a-411d-8ce3-96502aa4b4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:49.295642 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57cf24-2c9a-411d-8ce3-96502aa4b4fc admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:49.295947 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57cf24-2c9a-411d-8ce3-96502aa4b4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:49.296221 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57cf24-2c9a-411d-8ce3-96502aa4b4fc admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:49.296947 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57cf24-2c9a-411d-8ce3-96502aa4b4fc admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:49.297249 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57cf24-2c9a-411d-8ce3-96502aa4b4fc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:49.298259 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING py.warnings [None req-7a57cf24-2c9a-411d-8ce3-96502aa4b4fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:26:49.298259 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: warnings.warn(msg) Oct 15 03:26:49.298259 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: Oct 15 03:26:49.299149 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57cf24-2c9a-411d-8ce3-96502aa4b4fc admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:49.304528 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 287/577] 10.222.0.30 () {56 vars in 1145 bytes} [Fri Oct 15 03:26:49 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:49.310913 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173d21c-6216-4e11-86af-8e5566c2e091 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:49.325371 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173d21c-6216-4e11-86af-8e5566c2e091 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:49.335830 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483ad0a-2218-4084-83a3-c8310894a177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:49.336487 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483ad0a-2218-4084-83a3-c8310894a177 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:49.336820 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483ad0a-2218-4084-83a3-c8310894a177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:49.337093 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483ad0a-2218-4084-83a3-c8310894a177 admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:49.337806 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483ad0a-2218-4084-83a3-c8310894a177 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:49.338104 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483ad0a-2218-4084-83a3-c8310894a177 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:49.339115 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING py.warnings [None req-c483ad0a-2218-4084-83a3-c8310894a177 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:26:49.339115 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: warnings.warn(msg) Oct 15 03:26:49.339115 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: Oct 15 03:26:49.340018 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483ad0a-2218-4084-83a3-c8310894a177 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:49.348574 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 291/578] 10.222.0.30 () {56 vars in 1145 bytes} [Fri Oct 15 03:26:49 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:49.826179 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0e01d-d0cb-4122-85c2-36f4b2f21ab4 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:49.826633 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0e01d-d0cb-4122-85c2-36f4b2f21ab4 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:49.826895 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0e01d-d0cb-4122-85c2-36f4b2f21ab4 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:49.830040 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 288/579] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:49 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:49.835921 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ce7be-e9f9-47b6-9b7a-5a3aefd8c4e5 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:49.836221 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ce7be-e9f9-47b6-9b7a-5a3aefd8c4e5 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:49.836497 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ce7be-e9f9-47b6-9b7a-5a3aefd8c4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:49.861859 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-f48ce7be-e9f9-47b6-9b7a-5a3aefd8c4e5 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:49.863126 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-f48ce7be-e9f9-47b6-9b7a-5a3aefd8c4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:49.881015 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 292/580] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:49.922719 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0e01d-d0cb-4122-85c2-36f4b2f21ab4 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:49.941243 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0e01d-d0cb-4122-85c2-36f4b2f21ab4 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:49.945673 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d34e9-970a-4912-953e-47a8aaed53f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:49.946996 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d34e9-970a-4912-953e-47a8aaed53f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:49.947278 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d34e9-970a-4912-953e-47a8aaed53f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:49.947552 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d34e9-970a-4912-953e-47a8aaed53f9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:49.958661 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d34e9-970a-4912-953e-47a8aaed53f9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:49.969679 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-c07d34e9-970a-4912-953e-47a8aaed53f9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:26:49.970966 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 289/581] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:26:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:49.977634 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ce7be-e9f9-47b6-9b7a-5a3aefd8c4e5 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:49.986832 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ce7be-e9f9-47b6-9b7a-5a3aefd8c4e5 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:49.995933 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451572ac-641a-468a-b765-1bde430b3d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:49.996597 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451572ac-641a-468a-b765-1bde430b3d4a admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:49.996880 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451572ac-641a-468a-b765-1bde430b3d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:49.997159 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451572ac-641a-468a-b765-1bde430b3d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:49.997995 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451572ac-641a-468a-b765-1bde430b3d4a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:49.998301 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451572ac-641a-468a-b765-1bde430b3d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:49.999994 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451572ac-641a-468a-b765-1bde430b3d4a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:50.007316 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11edc4-c6a3-4156-9fd4-a42960917fd9 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.007585 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11edc4-c6a3-4156-9fd4-a42960917fd9 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.007880 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11edc4-c6a3-4156-9fd4-a42960917fd9 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.010407 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 290/582] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:26:50.011333 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302677f-168b-43a6-b7d4-fb53c4226fb8 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.011616 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302677f-168b-43a6-b7d4-fb53c4226fb8 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.011910 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302677f-168b-43a6-b7d4-fb53c4226fb8 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.012589 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 293/583] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:50.013690 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 291/584] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:50.018278 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451572ac-641a-468a-b765-1bde430b3d4a admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:50.019910 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9883dc8-40f4-4e0c-9c14-5a7e4faed8bc None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.020200 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9883dc8-40f4-4e0c-9c14-5a7e4faed8bc None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.020479 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9883dc8-40f4-4e0c-9c14-5a7e4faed8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.028712 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451572ac-641a-468a-b765-1bde430b3d4a admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:50.033207 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3b749-c8e3-44dd-a95f-c78d5804fdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:50.033970 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3b749-c8e3-44dd-a95f-c78d5804fdc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.034249 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3b749-c8e3-44dd-a95f-c78d5804fdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.034520 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3b749-c8e3-44dd-a95f-c78d5804fdc8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.039239 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-a9883dc8-40f4-4e0c-9c14-5a7e4faed8bc None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:50.041070 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-a9883dc8-40f4-4e0c-9c14-5a7e4faed8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:50.046156 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3b749-c8e3-44dd-a95f-c78d5804fdc8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:50.048140 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3b749-c8e3-44dd-a95f-c78d5804fdc8 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:50.048824 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 292/585] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:26:50.050141 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68825aed-5841-4b59-8618-f9023be4fb5e None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.050320 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68825aed-5841-4b59-8618-f9023be4fb5e None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.050575 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68825aed-5841-4b59-8618-f9023be4fb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.065858 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-8ac3b749-c8e3-44dd-a95f-c78d5804fdc8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:50.067337 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 294/586] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:50.073876 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3b749-c8e3-44dd-a95f-c78d5804fdc8 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:50.088311 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3b749-c8e3-44dd-a95f-c78d5804fdc8 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:50.089846 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-68825aed-5841-4b59-8618-f9023be4fb5e None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:50.091023 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-68825aed-5841-4b59-8618-f9023be4fb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:50.092889 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647f651-3c60-46b9-aa4a-7dc60aecf78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:50.093650 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647f651-3c60-46b9-aa4a-7dc60aecf78e admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.093931 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647f651-3c60-46b9-aa4a-7dc60aecf78e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.094204 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647f651-3c60-46b9-aa4a-7dc60aecf78e admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.094937 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647f651-3c60-46b9-aa4a-7dc60aecf78e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:50.095241 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647f651-3c60-46b9-aa4a-7dc60aecf78e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:50.096865 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647f651-3c60-46b9-aa4a-7dc60aecf78e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:50.099458 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 293/587] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:50.100273 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68825aed-5841-4b59-8618-f9023be4fb5e None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:50.109669 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68825aed-5841-4b59-8618-f9023be4fb5e None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:50.114103 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd8b1d-1635-490b-81d3-80a4defa8fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:50.114875 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd8b1d-1635-490b-81d3-80a4defa8fbb admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.115150 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd8b1d-1635-490b-81d3-80a4defa8fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.115419 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd8b1d-1635-490b-81d3-80a4defa8fbb admin admin] PATH_INFO: `/v3/services/network` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.116328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd8b1d-1635-490b-81d3-80a4defa8fbb admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:50.117619 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING py.warnings [None req-83cd8b1d-1635-490b-81d3-80a4defa8fbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:26:50.117619 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: warnings.warn(msg) Oct 15 03:26:50.117619 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: Oct 15 03:26:50.119709 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd8b1d-1635-490b-81d3-80a4defa8fbb admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:50.122726 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 295/588] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:50.127944 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647f651-3c60-46b9-aa4a-7dc60aecf78e admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:50.135715 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-83cd8b1d-1635-490b-81d3-80a4defa8fbb admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 15 03:26:50.137206 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 294/589] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:50 2021] GET /identity/v3/services/network => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:50.143649 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647f651-3c60-46b9-aa4a-7dc60aecf78e admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:50.144840 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd8b1d-1635-490b-81d3-80a4defa8fbb admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:50.148229 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c2fcc-615d-4479-9055-e6ae802948e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:50.149006 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c2fcc-615d-4479-9055-e6ae802948e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.149805 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c2fcc-615d-4479-9055-e6ae802948e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.150084 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c2fcc-615d-4479-9055-e6ae802948e5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.158853 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c2fcc-615d-4479-9055-e6ae802948e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:50.160934 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c2fcc-615d-4479-9055-e6ae802948e5 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:50.161658 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd8b1d-1635-490b-81d3-80a4defa8fbb admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:50.166954 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f75244-e7c7-4b52-92fa-f6968d857f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:50.167596 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f75244-e7c7-4b52-92fa-f6968d857f1b admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.167903 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f75244-e7c7-4b52-92fa-f6968d857f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.168231 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f75244-e7c7-4b52-92fa-f6968d857f1b admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.168998 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f75244-e7c7-4b52-92fa-f6968d857f1b admin admin] RBAC: Adding query filter params (name=network) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:50.169301 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f75244-e7c7-4b52-92fa-f6968d857f1b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:50.170867 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f75244-e7c7-4b52-92fa-f6968d857f1b admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:50.175648 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 295/590] 10.222.0.30 () {56 vars in 1133 bytes} [Fri Oct 15 03:26:50 2021] GET /identity/v3/services?name=network => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:50.176426 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f75244-e7c7-4b52-92fa-f6968d857f1b admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:50.180608 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-be9c2fcc-615d-4479-9055-e6ae802948e5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 15 03:26:50.182781 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 296/591] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Oct 15 03:26:50 2021] GET /identity/v3/users/nova => generated 82 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:50.185034 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c2fcc-615d-4479-9055-e6ae802948e5 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:50.186783 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f75244-e7c7-4b52-92fa-f6968d857f1b admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:50.191459 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29796e-4f64-4fb5-8eec-b4103746dd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:50.192365 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29796e-4f64-4fb5-8eec-b4103746dd46 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.192642 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29796e-4f64-4fb5-8eec-b4103746dd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.192914 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29796e-4f64-4fb5-8eec-b4103746dd46 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.195238 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c2fcc-615d-4479-9055-e6ae802948e5 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:50.200085 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658156de-8ea1-4685-9e04-323692fd6302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:50.200710 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658156de-8ea1-4685-9e04-323692fd6302 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.201427 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658156de-8ea1-4685-9e04-323692fd6302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.201710 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658156de-8ea1-4685-9e04-323692fd6302 admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.202431 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658156de-8ea1-4685-9e04-323692fd6302 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:50.203125 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658156de-8ea1-4685-9e04-323692fd6302 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:50.204593 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29796e-4f64-4fb5-8eec-b4103746dd46 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:50.205003 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658156de-8ea1-4685-9e04-323692fd6302 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:50.206532 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29796e-4f64-4fb5-8eec-b4103746dd46 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:50.210305 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 297/592] 10.222.0.30 () {56 vars in 1133 bytes} [Fri Oct 15 03:26:50 2021] GET /identity/v3/services?type=network => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:50.211077 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658156de-8ea1-4685-9e04-323692fd6302 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:50.235741 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-6f29796e-4f64-4fb5-8eec-b4103746dd46 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:50.238960 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658156de-8ea1-4685-9e04-323692fd6302 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:50.243969 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 296/593] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:50.255733 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a009dec-39d7-4ba6-9542-0936f802885c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:50.255733 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a009dec-39d7-4ba6-9542-0936f802885c admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.255733 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a009dec-39d7-4ba6-9542-0936f802885c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.255733 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a009dec-39d7-4ba6-9542-0936f802885c admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.256523 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a009dec-39d7-4ba6-9542-0936f802885c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:50.256523 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a009dec-39d7-4ba6-9542-0936f802885c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:50.256523 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a009dec-39d7-4ba6-9542-0936f802885c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:50.256976 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29796e-4f64-4fb5-8eec-b4103746dd46 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:50.277759 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29796e-4f64-4fb5-8eec-b4103746dd46 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:50.282885 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 298/594] 10.222.0.30 () {56 vars in 1154 bytes} [Fri Oct 15 03:26:50 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:50.286710 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31ea7f-7102-4cb0-b433-717ab7b032ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:50.287708 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31ea7f-7102-4cb0-b433-717ab7b032ff admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.288203 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31ea7f-7102-4cb0-b433-717ab7b032ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.289394 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a009dec-39d7-4ba6-9542-0936f802885c admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:50.290394 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31ea7f-7102-4cb0-b433-717ab7b032ff admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.291819 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31ea7f-7102-4cb0-b433-717ab7b032ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:50.296579 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31ea7f-7102-4cb0-b433-717ab7b032ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:50.298559 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31ea7f-7102-4cb0-b433-717ab7b032ff admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:50.310317 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a009dec-39d7-4ba6-9542-0936f802885c admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:50.318990 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 297/595] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:50.322013 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d006e26-4f67-4e0c-894c-21ee09403882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:50.322942 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d006e26-4f67-4e0c-894c-21ee09403882 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.323459 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d006e26-4f67-4e0c-894c-21ee09403882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.324000 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d006e26-4f67-4e0c-894c-21ee09403882 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.328268 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31ea7f-7102-4cb0-b433-717ab7b032ff admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:50.341408 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d006e26-4f67-4e0c-894c-21ee09403882 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:50.343893 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d006e26-4f67-4e0c-894c-21ee09403882 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:50.346396 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31ea7f-7102-4cb0-b433-717ab7b032ff admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:50.357884 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c84705-ddc4-4fc4-81da-47aba14f78be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:50.359053 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c84705-ddc4-4fc4-81da-47aba14f78be admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.359651 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c84705-ddc4-4fc4-81da-47aba14f78be admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.360725 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c84705-ddc4-4fc4-81da-47aba14f78be admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.361686 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c84705-ddc4-4fc4-81da-47aba14f78be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:50.366912 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c84705-ddc4-4fc4-81da-47aba14f78be admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:50.369520 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 299/596] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:50 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:50.375819 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d006e26-4f67-4e0c-894c-21ee09403882 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:50.386078 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d006e26-4f67-4e0c-894c-21ee09403882 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:50.391436 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea28477-c620-4ad7-b669-1c162431618e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:50.392933 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea28477-c620-4ad7-b669-1c162431618e admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.393434 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea28477-c620-4ad7-b669-1c162431618e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.394109 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea28477-c620-4ad7-b669-1c162431618e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.405272 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 298/597] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Oct 15 03:26:50 2021] POST /identity/v3/users => generated 254 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:26:50.407622 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea28477-c620-4ad7-b669-1c162431618e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:50.409969 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea28477-c620-4ad7-b669-1c162431618e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:50.431188 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-0ea28477-c620-4ad7-b669-1c162431618e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:50.433119 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 300/598] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:50.439764 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c84705-ddc4-4fc4-81da-47aba14f78be admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:50.457131 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c84705-ddc4-4fc4-81da-47aba14f78be admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:50.469154 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c852c6-1b47-4a5d-8785-f9ecff9b29a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:50.469892 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c852c6-1b47-4a5d-8785-f9ecff9b29a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.470175 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c852c6-1b47-4a5d-8785-f9ecff9b29a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.470504 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c852c6-1b47-4a5d-8785-f9ecff9b29a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.471263 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c852c6-1b47-4a5d-8785-f9ecff9b29a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:50.471629 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c852c6-1b47-4a5d-8785-f9ecff9b29a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:50.473697 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c852c6-1b47-4a5d-8785-f9ecff9b29a8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:50.489444 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 299/599] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:50.496429 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea28477-c620-4ad7-b669-1c162431618e admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:50.511878 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea28477-c620-4ad7-b669-1c162431618e admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:50.521097 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d4a15-0f81-41ac-acdd-3e86cdcd5f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:50.521903 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d4a15-0f81-41ac-acdd-3e86cdcd5f94 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.522190 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d4a15-0f81-41ac-acdd-3e86cdcd5f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.522515 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d4a15-0f81-41ac-acdd-3e86cdcd5f94 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.533844 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d4a15-0f81-41ac-acdd-3e86cdcd5f94 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:50.535868 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d4a15-0f81-41ac-acdd-3e86cdcd5f94 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:50.556151 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-f88d4a15-0f81-41ac-acdd-3e86cdcd5f94 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:26:50.557680 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 301/600] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:50.564105 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c852c6-1b47-4a5d-8785-f9ecff9b29a8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:50.576830 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c852c6-1b47-4a5d-8785-f9ecff9b29a8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:50.592668 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628871c-70b6-45af-bbf8-739f94672adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:50.593426 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628871c-70b6-45af-bbf8-739f94672adf admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.593762 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628871c-70b6-45af-bbf8-739f94672adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.594051 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628871c-70b6-45af-bbf8-739f94672adf admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.595058 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628871c-70b6-45af-bbf8-739f94672adf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:50.595375 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628871c-70b6-45af-bbf8-739f94672adf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:50.597409 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628871c-70b6-45af-bbf8-739f94672adf admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:50.612695 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 300/601] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:26:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:50.620067 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d4a15-0f81-41ac-acdd-3e86cdcd5f94 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:50.640421 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d4a15-0f81-41ac-acdd-3e86cdcd5f94 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:50.652553 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4223fe-7636-40f8-b1ce-5ce514f5dd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:50.653230 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4223fe-7636-40f8-b1ce-5ce514f5dd96 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.653512 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4223fe-7636-40f8-b1ce-5ce514f5dd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.653787 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4223fe-7636-40f8-b1ce-5ce514f5dd96 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.654634 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4223fe-7636-40f8-b1ce-5ce514f5dd96 admin admin] RBAC: Adding query filter params (role.id=15ba70b0cba04962a6d0b80b50c07004, scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user.id=3d71a1bd93b04249b2b8e6a054de44c7) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:50.654946 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4223fe-7636-40f8-b1ce-5ce514f5dd96 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:50.656855 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4223fe-7636-40f8-b1ce-5ce514f5dd96 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:50.663228 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 302/602] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:50 2021] GET /identity/v3/role_assignments?user.id=3d71a1bd93b04249b2b8e6a054de44c7&scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20&role.id=15ba70b0cba04962a6d0b80b50c07004 => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:50.664720 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c9cc0-ea8e-40e3-a77a-da9365c9c165 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.665522 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c9cc0-ea8e-40e3-a77a-da9365c9c165 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.665798 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c9cc0-ea8e-40e3-a77a-da9365c9c165 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.667652 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 301/603] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:26:50.688539 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e80dcb-06d4-4b30-a62d-708c585bdddc None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.688862 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e80dcb-06d4-4b30-a62d-708c585bdddc None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.689090 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e80dcb-06d4-4b30-a62d-708c585bdddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.720729 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-18e80dcb-06d4-4b30-a62d-708c585bdddc None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:50.721966 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-18e80dcb-06d4-4b30-a62d-708c585bdddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:50.730806 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 303/604] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:26:50.755958 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c9cc0-ea8e-40e3-a77a-da9365c9c165 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:50.769488 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c9cc0-ea8e-40e3-a77a-da9365c9c165 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:50.774325 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30248ba5-fc7d-4cee-9750-08a2d936b789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:50.775186 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30248ba5-fc7d-4cee-9750-08a2d936b789 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.775471 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30248ba5-fc7d-4cee-9750-08a2d936b789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.775864 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30248ba5-fc7d-4cee-9750-08a2d936b789 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.788122 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30248ba5-fc7d-4cee-9750-08a2d936b789 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:50.795581 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-30248ba5-fc7d-4cee-9750-08a2d936b789 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 03:26:50.797182 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 302/605] 10.222.0.30 () {56 vars in 1123 bytes} [Fri Oct 15 03:26:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:50.803975 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e80dcb-06d4-4b30-a62d-708c585bdddc None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:50.814614 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e80dcb-06d4-4b30-a62d-708c585bdddc None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:50.819474 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4225c-db66-4ded-a8c7-3b86b02ddb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:50.820217 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4225c-db66-4ded-a8c7-3b86b02ddb7c admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.820500 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4225c-db66-4ded-a8c7-3b86b02ddb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.820778 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4225c-db66-4ded-a8c7-3b86b02ddb7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.822203 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4225c-db66-4ded-a8c7-3b86b02ddb7c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:50.822517 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4225c-db66-4ded-a8c7-3b86b02ddb7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:50.824226 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4225c-db66-4ded-a8c7-3b86b02ddb7c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:50.833371 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 304/606] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Oct 15 03:26:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:50.839751 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30248ba5-fc7d-4cee-9750-08a2d936b789 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:50.850527 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30248ba5-fc7d-4cee-9750-08a2d936b789 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:50.855488 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739e2f1-3e86-4184-8b85-5f9cc6255d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:50.856432 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739e2f1-3e86-4184-8b85-5f9cc6255d77 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.856714 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739e2f1-3e86-4184-8b85-5f9cc6255d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.856997 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739e2f1-3e86-4184-8b85-5f9cc6255d77 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.869790 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739e2f1-3e86-4184-8b85-5f9cc6255d77 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:50.871749 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739e2f1-3e86-4184-8b85-5f9cc6255d77 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:50.890127 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-f739e2f1-3e86-4184-8b85-5f9cc6255d77 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:50.891617 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 303/607] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:50.897884 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4225c-db66-4ded-a8c7-3b86b02ddb7c admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:50.909010 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4225c-db66-4ded-a8c7-3b86b02ddb7c admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:50.913609 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd4a88-2ee5-45d4-8e27-e91b891a97c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:50.914358 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd4a88-2ee5-45d4-8e27-e91b891a97c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.914668 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd4a88-2ee5-45d4-8e27-e91b891a97c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.915527 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd4a88-2ee5-45d4-8e27-e91b891a97c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.916297 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd4a88-2ee5-45d4-8e27-e91b891a97c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:50.916707 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd4a88-2ee5-45d4-8e27-e91b891a97c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:50.918447 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd4a88-2ee5-45d4-8e27-e91b891a97c9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:50.931786 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 305/608] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:50.937927 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739e2f1-3e86-4184-8b85-5f9cc6255d77 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:50.948681 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739e2f1-3e86-4184-8b85-5f9cc6255d77 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:50.953898 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc6b68-25e2-4f51-ac45-4aa01bde8d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:50.954674 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc6b68-25e2-4f51-ac45-4aa01bde8d72 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:50.954954 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc6b68-25e2-4f51-ac45-4aa01bde8d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:50.955228 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc6b68-25e2-4f51-ac45-4aa01bde8d72 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:50.964513 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc6b68-25e2-4f51-ac45-4aa01bde8d72 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:50.966535 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc6b68-25e2-4f51-ac45-4aa01bde8d72 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:50.981248 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-87cc6b68-25e2-4f51-ac45-4aa01bde8d72 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 15 03:26:50.982796 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 304/609] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:26:50 2021] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:50.989056 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd4a88-2ee5-45d4-8e27-e91b891a97c9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:50.999017 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd4a88-2ee5-45d4-8e27-e91b891a97c9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:51.003667 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43ab7c-9feb-4a03-adf1-7c8d95e2a682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:51.004404 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43ab7c-9feb-4a03-adf1-7c8d95e2a682 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:51.004687 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43ab7c-9feb-4a03-adf1-7c8d95e2a682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:51.004963 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43ab7c-9feb-4a03-adf1-7c8d95e2a682 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:51.005860 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43ab7c-9feb-4a03-adf1-7c8d95e2a682 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:51.006173 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43ab7c-9feb-4a03-adf1-7c8d95e2a682 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:51.008218 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43ab7c-9feb-4a03-adf1-7c8d95e2a682 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:51.027012 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 306/610] 10.222.0.30 () {56 vars in 1156 bytes} [Fri Oct 15 03:26:50 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:51.033347 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc6b68-25e2-4f51-ac45-4aa01bde8d72 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:51.044328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc6b68-25e2-4f51-ac45-4aa01bde8d72 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:51.049754 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ee0d5-51e1-407b-b3bd-a5e678c121f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:51.050420 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ee0d5-51e1-407b-b3bd-a5e678c121f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:51.050753 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ee0d5-51e1-407b-b3bd-a5e678c121f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:51.051031 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ee0d5-51e1-407b-b3bd-a5e678c121f2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:51.062420 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ee0d5-51e1-407b-b3bd-a5e678c121f2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:51.064287 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ee0d5-51e1-407b-b3bd-a5e678c121f2 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:51.074493 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 305/611] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:51.080933 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43ab7c-9feb-4a03-adf1-7c8d95e2a682 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:51.091663 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43ab7c-9feb-4a03-adf1-7c8d95e2a682 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:51.096770 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a433943-7fe3-4e81-8b48-7cc0adde5ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:51.097654 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a433943-7fe3-4e81-8b48-7cc0adde5ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:51.097934 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a433943-7fe3-4e81-8b48-7cc0adde5ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:51.098520 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a433943-7fe3-4e81-8b48-7cc0adde5ca9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:51.109613 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a433943-7fe3-4e81-8b48-7cc0adde5ca9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:51.111501 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a433943-7fe3-4e81-8b48-7cc0adde5ca9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:51.129871 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-1a433943-7fe3-4e81-8b48-7cc0adde5ca9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:51.131436 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 307/612] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:51.138246 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ee0d5-51e1-407b-b3bd-a5e678c121f2 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:51.147366 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ee0d5-51e1-407b-b3bd-a5e678c121f2 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:51.153986 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d0556-7fc2-4a95-9d42-7f45712d7015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:51.154918 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d0556-7fc2-4a95-9d42-7f45712d7015 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:51.155206 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d0556-7fc2-4a95-9d42-7f45712d7015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:51.155483 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d0556-7fc2-4a95-9d42-7f45712d7015 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:51.156385 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d0556-7fc2-4a95-9d42-7f45712d7015 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:51.156699 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d0556-7fc2-4a95-9d42-7f45712d7015 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:51.159115 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d0556-7fc2-4a95-9d42-7f45712d7015 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:51.172594 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 306/613] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:51.178850 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a433943-7fe3-4e81-8b48-7cc0adde5ca9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:51.192514 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a433943-7fe3-4e81-8b48-7cc0adde5ca9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:51.197540 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6fd75-4aee-49b9-b5d7-145d27e4bf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:51.198321 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6fd75-4aee-49b9-b5d7-145d27e4bf07 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:51.198638 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6fd75-4aee-49b9-b5d7-145d27e4bf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:51.198928 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6fd75-4aee-49b9-b5d7-145d27e4bf07 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:51.210979 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6fd75-4aee-49b9-b5d7-145d27e4bf07 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:51.213055 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6fd75-4aee-49b9-b5d7-145d27e4bf07 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:51.233976 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-f8d6fd75-4aee-49b9-b5d7-145d27e4bf07 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:26:51.233976 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 308/614] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:51.237309 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d0556-7fc2-4a95-9d42-7f45712d7015 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:51.250256 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d0556-7fc2-4a95-9d42-7f45712d7015 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:51.254894 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371afe72-41aa-425b-b908-e0c0a73852f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:51.255595 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371afe72-41aa-425b-b908-e0c0a73852f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:51.255915 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371afe72-41aa-425b-b908-e0c0a73852f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:51.256242 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371afe72-41aa-425b-b908-e0c0a73852f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:51.257048 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371afe72-41aa-425b-b908-e0c0a73852f6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:51.257403 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371afe72-41aa-425b-b908-e0c0a73852f6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:51.259397 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371afe72-41aa-425b-b908-e0c0a73852f6 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:51.271859 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 307/615] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:26:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:51.278423 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6fd75-4aee-49b9-b5d7-145d27e4bf07 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:51.289153 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6fd75-4aee-49b9-b5d7-145d27e4bf07 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:51.294339 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d39476-6562-45d1-a737-622bd306eb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:51.295071 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d39476-6562-45d1-a737-622bd306eb22 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:51.295362 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d39476-6562-45d1-a737-622bd306eb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:51.295637 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d39476-6562-45d1-a737-622bd306eb22 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:51.296576 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d39476-6562-45d1-a737-622bd306eb22 admin admin] RBAC: Adding query filter params (role.id=04a530eb7b7e46d4a07b4c3b02cee3aa, scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user.id=dfdf0fb38dd04c75a1c874913ea1bf98) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:51.296996 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d39476-6562-45d1-a737-622bd306eb22 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:51.298905 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d39476-6562-45d1-a737-622bd306eb22 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:51.305233 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 309/616] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:51 2021] GET /identity/v3/role_assignments?user.id=dfdf0fb38dd04c75a1c874913ea1bf98&scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20&role.id=04a530eb7b7e46d4a07b4c3b02cee3aa => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:52.225328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f37437-986e-4ea6-a2fb-e5b01e5885b8 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:52.226022 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f37437-986e-4ea6-a2fb-e5b01e5885b8 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:52.226022 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f37437-986e-4ea6-a2fb-e5b01e5885b8 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:52.228572 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 308/617] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:52.238390 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d1cb7-7d46-402b-8887-48ad210953d3 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:52.238981 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d1cb7-7d46-402b-8887-48ad210953d3 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:52.238981 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d1cb7-7d46-402b-8887-48ad210953d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:52.258268 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-650d1cb7-7d46-402b-8887-48ad210953d3 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:52.259489 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-650d1cb7-7d46-402b-8887-48ad210953d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:52.276665 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 310/618] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:26:52.312372 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f37437-986e-4ea6-a2fb-e5b01e5885b8 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:52.329773 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f37437-986e-4ea6-a2fb-e5b01e5885b8 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:52.337938 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ee1f8-3a21-4adf-9882-441f4aa36cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:52.338603 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ee1f8-3a21-4adf-9882-441f4aa36cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:52.338883 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ee1f8-3a21-4adf-9882-441f4aa36cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:52.339159 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ee1f8-3a21-4adf-9882-441f4aa36cd4 admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:52.339940 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ee1f8-3a21-4adf-9882-441f4aa36cd4 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:52.341020 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING py.warnings [None req-b15ee1f8-3a21-4adf-9882-441f4aa36cd4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:26:52.341020 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: warnings.warn(msg) Oct 15 03:26:52.341020 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: Oct 15 03:26:52.341973 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ee1f8-3a21-4adf-9882-441f4aa36cd4 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:52.362072 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 309/619] 10.222.0.30 () {60 vars in 1162 bytes} [Fri Oct 15 03:26:52 2021] POST /identity/v3/services => generated 251 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:26:52.872468 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c883c-a3ea-4dd3-bfac-db00a0408269 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:52.872847 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c883c-a3ea-4dd3-bfac-db00a0408269 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:52.873045 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c883c-a3ea-4dd3-bfac-db00a0408269 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:52.875052 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 311/620] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:52.881129 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44d7b3-b2b4-4087-8b52-4f465211563a None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:52.881413 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44d7b3-b2b4-4087-8b52-4f465211563a None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:52.881690 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44d7b3-b2b4-4087-8b52-4f465211563a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:52.900931 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-bb44d7b3-b2b4-4087-8b52-4f465211563a None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:52.902117 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-bb44d7b3-b2b4-4087-8b52-4f465211563a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:52.923925 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 310/621] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:52 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:26:52.943905 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c883c-a3ea-4dd3-bfac-db00a0408269 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:52.957100 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c883c-a3ea-4dd3-bfac-db00a0408269 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:52.961422 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d5534-6e00-4d71-92ee-f62e271010df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:52.962677 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d5534-6e00-4d71-92ee-f62e271010df admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:52.962951 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d5534-6e00-4d71-92ee-f62e271010df admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:52.963223 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d5534-6e00-4d71-92ee-f62e271010df admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:52.964005 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d5534-6e00-4d71-92ee-f62e271010df admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:52.965014 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING py.warnings [None req-fc5d5534-6e00-4d71-92ee-f62e271010df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:26:52.965014 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: warnings.warn(msg) Oct 15 03:26:52.965014 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: Oct 15 03:26:52.965901 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d5534-6e00-4d71-92ee-f62e271010df admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:52.991552 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 312/622] 10.222.0.30 () {60 vars in 1162 bytes} [Fri Oct 15 03:26:52 2021] POST /identity/v3/services => generated 240 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:26:53.311404 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519c096-2d13-4dc5-9049-715217bd2bac None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:53.312088 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519c096-2d13-4dc5-9049-715217bd2bac None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:53.312088 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519c096-2d13-4dc5-9049-715217bd2bac None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:53.314096 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 311/623] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:53.320121 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da4e58-d27a-4eeb-8578-409340d45f31 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:53.320703 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da4e58-d27a-4eeb-8578-409340d45f31 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:53.320703 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da4e58-d27a-4eeb-8578-409340d45f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:53.346132 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-99da4e58-d27a-4eeb-8578-409340d45f31 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:53.347317 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-99da4e58-d27a-4eeb-8578-409340d45f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:53.380944 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 313/624] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:53 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:53.406999 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519c096-2d13-4dc5-9049-715217bd2bac None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:53.422227 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519c096-2d13-4dc5-9049-715217bd2bac None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:53.427838 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14926d-6148-47a5-a0b4-7069af67f6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:53.428626 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14926d-6148-47a5-a0b4-7069af67f6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:53.428911 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14926d-6148-47a5-a0b4-7069af67f6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:53.429184 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14926d-6148-47a5-a0b4-7069af67f6a8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:53.442394 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14926d-6148-47a5-a0b4-7069af67f6a8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:53.449502 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-0e14926d-6148-47a5-a0b4-7069af67f6a8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:26:53.451881 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 312/625] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:26:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:53.457385 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da4e58-d27a-4eeb-8578-409340d45f31 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:53.466597 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da4e58-d27a-4eeb-8578-409340d45f31 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:53.475131 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6a4fa-e72e-4cf9-9bd1-dbe0e24cf094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:53.475838 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6a4fa-e72e-4cf9-9bd1-dbe0e24cf094 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:53.476119 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6a4fa-e72e-4cf9-9bd1-dbe0e24cf094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:53.476393 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6a4fa-e72e-4cf9-9bd1-dbe0e24cf094 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:53.477714 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6a4fa-e72e-4cf9-9bd1-dbe0e24cf094 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:53.478023 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6a4fa-e72e-4cf9-9bd1-dbe0e24cf094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:53.479632 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6a4fa-e72e-4cf9-9bd1-dbe0e24cf094 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:53.488749 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 314/626] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:53.495872 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14926d-6148-47a5-a0b4-7069af67f6a8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:53.505977 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14926d-6148-47a5-a0b4-7069af67f6a8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:53.516069 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009136e1-85ac-4a64-a4ac-2c496d0440ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:53.516069 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009136e1-85ac-4a64-a4ac-2c496d0440ae admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:53.516069 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009136e1-85ac-4a64-a4ac-2c496d0440ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:53.516069 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009136e1-85ac-4a64-a4ac-2c496d0440ae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:53.535498 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009136e1-85ac-4a64-a4ac-2c496d0440ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:53.537721 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009136e1-85ac-4a64-a4ac-2c496d0440ae admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:53.565707 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-009136e1-85ac-4a64-a4ac-2c496d0440ae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:53.567235 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 313/627] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:53.573635 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6a4fa-e72e-4cf9-9bd1-dbe0e24cf094 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:53.576686 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621cfae-d8b8-4763-8ec7-f8d6f05cc6e4 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:53.577189 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621cfae-d8b8-4763-8ec7-f8d6f05cc6e4 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:53.577710 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621cfae-d8b8-4763-8ec7-f8d6f05cc6e4 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:53.579641 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 314/628] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:26:53.584623 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6a4fa-e72e-4cf9-9bd1-dbe0e24cf094 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:53.591273 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d5e7d-730f-40c9-8682-652fbe4a3df8 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:53.591826 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d5e7d-730f-40c9-8682-652fbe4a3df8 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:53.592331 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d5e7d-730f-40c9-8682-652fbe4a3df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:53.595292 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7158f2e-c429-475e-965c-424c4c881ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:53.596682 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7158f2e-c429-475e-965c-424c4c881ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:53.598173 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7158f2e-c429-475e-965c-424c4c881ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:53.600151 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7158f2e-c429-475e-965c-424c4c881ff5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:53.601106 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7158f2e-c429-475e-965c-424c4c881ff5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:53.603542 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7158f2e-c429-475e-965c-424c4c881ff5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:53.605393 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7158f2e-c429-475e-965c-424c4c881ff5 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:53.624905 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-784d5e7d-730f-40c9-8682-652fbe4a3df8 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:53.626401 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-784d5e7d-730f-40c9-8682-652fbe4a3df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:53.626944 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 315/629] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:53.633302 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7158f2e-c429-475e-965c-424c4c881ff5 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:53.635697 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 315/630] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:53 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:26:53.648537 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7158f2e-c429-475e-965c-424c4c881ff5 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:53.664400 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caecd6-b90d-43ce-89aa-25a82efb7b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:53.665230 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caecd6-b90d-43ce-89aa-25a82efb7b0a admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:53.665500 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caecd6-b90d-43ce-89aa-25a82efb7b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:53.665782 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caecd6-b90d-43ce-89aa-25a82efb7b0a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:53.680823 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37caecd6-b90d-43ce-89aa-25a82efb7b0a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:53.682848 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37caecd6-b90d-43ce-89aa-25a82efb7b0a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:53.686937 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d5e7d-730f-40c9-8682-652fbe4a3df8 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:53.697134 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d5e7d-730f-40c9-8682-652fbe4a3df8 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:53.703824 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-37caecd6-b90d-43ce-89aa-25a82efb7b0a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 15 03:26:53.705548 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 316/631] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Oct 15 03:26:53 2021] GET /identity/v3/users/nova => generated 82 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:53.711534 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caecd6-b90d-43ce-89aa-25a82efb7b0a admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:53.713921 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76836d-0727-45e8-b627-e1449069544f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:53.714989 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76836d-0727-45e8-b627-e1449069544f admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:53.715468 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76836d-0727-45e8-b627-e1449069544f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:53.715905 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76836d-0727-45e8-b627-e1449069544f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:53.722567 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caecd6-b90d-43ce-89aa-25a82efb7b0a admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:53.731724 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78989f-e416-49ab-ae87-b0fa791a1130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:53.731724 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78989f-e416-49ab-ae87-b0fa791a1130 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:53.731724 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78989f-e416-49ab-ae87-b0fa791a1130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:53.731724 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78989f-e416-49ab-ae87-b0fa791a1130 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:53.732082 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78989f-e416-49ab-ae87-b0fa791a1130 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:53.732082 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78989f-e416-49ab-ae87-b0fa791a1130 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:53.732082 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78989f-e416-49ab-ae87-b0fa791a1130 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:53.738442 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76836d-0727-45e8-b627-e1449069544f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:53.752292 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-4f76836d-0727-45e8-b627-e1449069544f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 03:26:53.755592 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 317/632] 10.222.0.30 () {56 vars in 1154 bytes} [Fri Oct 15 03:26:53 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:53.756644 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 316/633] 10.222.0.30 () {56 vars in 1123 bytes} [Fri Oct 15 03:26:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:53.762194 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78989f-e416-49ab-ae87-b0fa791a1130 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:53.765994 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76836d-0727-45e8-b627-e1449069544f admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:53.778951 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78989f-e416-49ab-ae87-b0fa791a1130 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:53.783652 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76836d-0727-45e8-b627-e1449069544f admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:53.788421 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ab1ed-e430-4e60-9c12-a232c6803696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:53.789719 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ab1ed-e430-4e60-9c12-a232c6803696 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:53.790986 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ab1ed-e430-4e60-9c12-a232c6803696 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:53.791263 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ab1ed-e430-4e60-9c12-a232c6803696 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:53.794726 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5915d20-ef7d-4a0b-abbe-12e3b0c779ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:53.795416 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5915d20-ef7d-4a0b-abbe-12e3b0c779ff admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:53.795712 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5915d20-ef7d-4a0b-abbe-12e3b0c779ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:53.796041 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5915d20-ef7d-4a0b-abbe-12e3b0c779ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:53.796803 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5915d20-ef7d-4a0b-abbe-12e3b0c779ff admin admin] RBAC: Adding query filter params (name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:53.797104 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5915d20-ef7d-4a0b-abbe-12e3b0c779ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:53.799721 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5915d20-ef7d-4a0b-abbe-12e3b0c779ff admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:53.807895 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ab1ed-e430-4e60-9c12-a232c6803696 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:53.810382 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ab1ed-e430-4e60-9c12-a232c6803696 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:53.817917 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 317/634] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Oct 15 03:26:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:53.827164 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5915d20-ef7d-4a0b-abbe-12e3b0c779ff admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:53.841846 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5915d20-ef7d-4a0b-abbe-12e3b0c779ff admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:53.846532 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-f61ab1ed-e430-4e60-9c12-a232c6803696 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:53.848096 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 318/635] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:53.851766 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a769c-5a79-48b1-bd05-a2b30405709c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:53.853134 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a769c-5a79-48b1-bd05-a2b30405709c admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:53.853408 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a769c-5a79-48b1-bd05-a2b30405709c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:53.853757 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a769c-5a79-48b1-bd05-a2b30405709c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:53.854814 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ab1ed-e430-4e60-9c12-a232c6803696 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:53.870521 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a769c-5a79-48b1-bd05-a2b30405709c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:53.872401 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a769c-5a79-48b1-bd05-a2b30405709c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:53.874275 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ab1ed-e430-4e60-9c12-a232c6803696 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:53.886435 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785bdb7-daee-4d24-9410-7aefe40be40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:53.887083 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785bdb7-daee-4d24-9410-7aefe40be40c admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:53.887361 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785bdb7-daee-4d24-9410-7aefe40be40c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:53.887634 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785bdb7-daee-4d24-9410-7aefe40be40c admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:53.888384 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785bdb7-daee-4d24-9410-7aefe40be40c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:53.888682 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785bdb7-daee-4d24-9410-7aefe40be40c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:53.890271 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785bdb7-daee-4d24-9410-7aefe40be40c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:53.899765 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-894a769c-5a79-48b1-bd05-a2b30405709c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:53.906670 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 318/636] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:53.911732 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 319/637] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:53.917815 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a769c-5a79-48b1-bd05-a2b30405709c admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:53.924229 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785bdb7-daee-4d24-9410-7aefe40be40c admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:53.933949 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a769c-5a79-48b1-bd05-a2b30405709c admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:53.942482 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbd755-765e-466c-a530-852912eb3cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:53.943714 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785bdb7-daee-4d24-9410-7aefe40be40c admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:53.944400 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbd755-765e-466c-a530-852912eb3cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:53.944683 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbd755-765e-466c-a530-852912eb3cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:53.944958 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbd755-765e-466c-a530-852912eb3cf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:53.945943 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbd755-765e-466c-a530-852912eb3cf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:53.946756 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbd755-765e-466c-a530-852912eb3cf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:53.951438 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbd755-765e-466c-a530-852912eb3cf5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:53.953334 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed440b8-8a7b-43bd-bd6a-4bbb5f0d7619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:53.954174 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed440b8-8a7b-43bd-bd6a-4bbb5f0d7619 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:53.954455 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed440b8-8a7b-43bd-bd6a-4bbb5f0d7619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:53.955521 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed440b8-8a7b-43bd-bd6a-4bbb5f0d7619 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:53.969314 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed440b8-8a7b-43bd-bd6a-4bbb5f0d7619 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:53.972161 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed440b8-8a7b-43bd-bd6a-4bbb5f0d7619 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:53.976399 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 319/638] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:53.983715 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbd755-765e-466c-a530-852912eb3cf5 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:54.003416 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbd755-765e-466c-a530-852912eb3cf5 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:54.008979 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-0ed440b8-8a7b-43bd-bd6a-4bbb5f0d7619 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:26:54.016341 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b6385-e276-466e-b714-237bc54a2518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:54.017144 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b6385-e276-466e-b714-237bc54a2518 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:54.017479 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b6385-e276-466e-b714-237bc54a2518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:54.017754 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b6385-e276-466e-b714-237bc54a2518 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:54.018563 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 320/639] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:54.023101 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed440b8-8a7b-43bd-bd6a-4bbb5f0d7619 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:54.038120 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed440b8-8a7b-43bd-bd6a-4bbb5f0d7619 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:54.039520 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b6385-e276-466e-b714-237bc54a2518 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:54.042425 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b6385-e276-466e-b714-237bc54a2518 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:54.048146 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f766c-097f-4ec0-84b7-1418b817f77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:54.049551 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f766c-097f-4ec0-84b7-1418b817f77e admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:54.049840 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f766c-097f-4ec0-84b7-1418b817f77e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:54.051524 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f766c-097f-4ec0-84b7-1418b817f77e admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:54.052407 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f766c-097f-4ec0-84b7-1418b817f77e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:54.052723 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f766c-097f-4ec0-84b7-1418b817f77e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:54.058642 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f766c-097f-4ec0-84b7-1418b817f77e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:54.065036 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-9a1b6385-e276-466e-b714-237bc54a2518 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 15 03:26:54.066726 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 320/640] 10.222.0.30 () {56 vars in 1138 bytes} [Fri Oct 15 03:26:53 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:54.074079 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b6385-e276-466e-b714-237bc54a2518 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:54.083763 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 321/641] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:26:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:54.085030 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b6385-e276-466e-b714-237bc54a2518 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:54.090476 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ca068-ecee-47bc-b683-4dc659a7ad98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:54.091379 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ca068-ecee-47bc-b683-4dc659a7ad98 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:54.091507 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f766c-097f-4ec0-84b7-1418b817f77e admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:54.092033 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ca068-ecee-47bc-b683-4dc659a7ad98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:54.092498 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ca068-ecee-47bc-b683-4dc659a7ad98 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:54.093535 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ca068-ecee-47bc-b683-4dc659a7ad98 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:54.094031 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ca068-ecee-47bc-b683-4dc659a7ad98 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:54.096121 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ca068-ecee-47bc-b683-4dc659a7ad98 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:54.110970 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f766c-097f-4ec0-84b7-1418b817f77e admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:54.116910 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 321/642] 10.222.0.30 () {56 vars in 1170 bytes} [Fri Oct 15 03:26:54 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:54.121611 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eeccd7-e264-41b8-bb68-49e8fec171b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:54.122551 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eeccd7-e264-41b8-bb68-49e8fec171b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:54.122839 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eeccd7-e264-41b8-bb68-49e8fec171b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:54.123115 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eeccd7-e264-41b8-bb68-49e8fec171b9 admin admin] PATH_INFO: `/v3/projects/9f95c04b0a7b4a2d8fbb4b547f70dc20/users/3d71a1bd93b04249b2b8e6a054de44c7/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:54.124070 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ca068-ecee-47bc-b683-4dc659a7ad98 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:54.125435 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eeccd7-e264-41b8-bb68-49e8fec171b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user_id=3d71a1bd93b04249b2b8e6a054de44c7, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:54.128315 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eeccd7-e264-41b8-bb68-49e8fec171b9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:54.134925 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ca068-ecee-47bc-b683-4dc659a7ad98 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:54.139889 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb2c59-311a-40ae-b22c-10838d4a6504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:54.141171 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb2c59-311a-40ae-b22c-10838d4a6504 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:54.141650 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb2c59-311a-40ae-b22c-10838d4a6504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:54.142131 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb2c59-311a-40ae-b22c-10838d4a6504 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:54.152891 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb2c59-311a-40ae-b22c-10838d4a6504 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:54.154940 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb2c59-311a-40ae-b22c-10838d4a6504 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:54.164211 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 322/643] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:54 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:54.169432 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 322/644] 10.222.0.30 () {58 vars in 1460 bytes} [Fri Oct 15 03:26:54 2021] PUT /identity/v3/projects/9f95c04b0a7b4a2d8fbb4b547f70dc20/users/3d71a1bd93b04249b2b8e6a054de44c7/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:26:54.170601 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb2c59-311a-40ae-b22c-10838d4a6504 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:54.180418 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb2c59-311a-40ae-b22c-10838d4a6504 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:54.278662 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154dc7d6-facd-476e-b101-850d015ea203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:54.279370 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154dc7d6-facd-476e-b101-850d015ea203 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:54.279654 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154dc7d6-facd-476e-b101-850d015ea203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:54.279955 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154dc7d6-facd-476e-b101-850d015ea203 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:54.296619 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154dc7d6-facd-476e-b101-850d015ea203 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:54.298507 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154dc7d6-facd-476e-b101-850d015ea203 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:54.320568 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-154dc7d6-facd-476e-b101-850d015ea203 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:54.322964 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 323/645] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:54.329564 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eeccd7-e264-41b8-bb68-49e8fec171b9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:54.340450 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eeccd7-e264-41b8-bb68-49e8fec171b9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:54.345431 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c153db-838a-4678-8ff7-f5c476d1550d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:54.346388 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c153db-838a-4678-8ff7-f5c476d1550d admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:54.346871 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c153db-838a-4678-8ff7-f5c476d1550d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:54.347372 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c153db-838a-4678-8ff7-f5c476d1550d admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:54.348631 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c153db-838a-4678-8ff7-f5c476d1550d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:54.349135 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c153db-838a-4678-8ff7-f5c476d1550d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:54.350930 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c153db-838a-4678-8ff7-f5c476d1550d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:54.369713 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 323/646] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:54.376210 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154dc7d6-facd-476e-b101-850d015ea203 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:54.388806 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154dc7d6-facd-476e-b101-850d015ea203 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:54.393634 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef3633-5a80-49f8-88e0-171ce2194646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:54.394649 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef3633-5a80-49f8-88e0-171ce2194646 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:54.395130 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef3633-5a80-49f8-88e0-171ce2194646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:54.395623 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef3633-5a80-49f8-88e0-171ce2194646 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:54.403418 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef3633-5a80-49f8-88e0-171ce2194646 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:54.405722 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef3633-5a80-49f8-88e0-171ce2194646 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:54.419467 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-13ef3633-5a80-49f8-88e0-171ce2194646 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:26:54.421355 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 324/647] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:54.427875 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c153db-838a-4678-8ff7-f5c476d1550d admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:54.438482 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c153db-838a-4678-8ff7-f5c476d1550d admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:54.443380 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54884a4b-0256-48a7-b6a8-7377f0ea87c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:54.444341 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54884a4b-0256-48a7-b6a8-7377f0ea87c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:54.444901 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54884a4b-0256-48a7-b6a8-7377f0ea87c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:54.445367 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54884a4b-0256-48a7-b6a8-7377f0ea87c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:54.446443 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54884a4b-0256-48a7-b6a8-7377f0ea87c1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:54.446961 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54884a4b-0256-48a7-b6a8-7377f0ea87c1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:54.449205 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54884a4b-0256-48a7-b6a8-7377f0ea87c1 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:54.462854 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 324/648] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:26:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:54.470136 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef3633-5a80-49f8-88e0-171ce2194646 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:54.482427 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef3633-5a80-49f8-88e0-171ce2194646 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:54.487826 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c6c99-7530-46c4-810f-e2ec5d8c64a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:54.488887 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c6c99-7530-46c4-810f-e2ec5d8c64a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:54.489389 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c6c99-7530-46c4-810f-e2ec5d8c64a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:54.489917 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c6c99-7530-46c4-810f-e2ec5d8c64a0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:54.491030 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c6c99-7530-46c4-810f-e2ec5d8c64a0 admin admin] RBAC: Adding query filter params (role.id=04a530eb7b7e46d4a07b4c3b02cee3aa, scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user.id=3f598b94a850413494da575188706cb1) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:54.491553 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c6c99-7530-46c4-810f-e2ec5d8c64a0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:54.494479 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c6c99-7530-46c4-810f-e2ec5d8c64a0 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:54.501420 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 325/649] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:54 2021] GET /identity/v3/role_assignments?user.id=3f598b94a850413494da575188706cb1&scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20&role.id=04a530eb7b7e46d4a07b4c3b02cee3aa => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:54.767517 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98584c16-4494-4cc2-b9b7-0210363ffb8e None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:54.767899 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98584c16-4494-4cc2-b9b7-0210363ffb8e None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:54.768107 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98584c16-4494-4cc2-b9b7-0210363ffb8e None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:54.770176 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 325/650] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:54.776412 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59061ce3-a8ae-49f5-9550-be9a41a4d2ed None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:54.776691 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59061ce3-a8ae-49f5-9550-be9a41a4d2ed None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:54.776961 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59061ce3-a8ae-49f5-9550-be9a41a4d2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:54.799495 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-59061ce3-a8ae-49f5-9550-be9a41a4d2ed None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:54.800705 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-59061ce3-a8ae-49f5-9550-be9a41a4d2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:54.814119 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 326/651] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:54 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:54.839298 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98584c16-4494-4cc2-b9b7-0210363ffb8e None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:54.857349 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98584c16-4494-4cc2-b9b7-0210363ffb8e None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:54.864123 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353703aa-aae4-4a93-b7ad-a7df80979df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:54.865217 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353703aa-aae4-4a93-b7ad-a7df80979df9 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:54.865712 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353703aa-aae4-4a93-b7ad-a7df80979df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:54.866174 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353703aa-aae4-4a93-b7ad-a7df80979df9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:54.880078 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353703aa-aae4-4a93-b7ad-a7df80979df9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:54.887702 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-353703aa-aae4-4a93-b7ad-a7df80979df9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:26:54.889430 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 326/652] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:26:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:54.895546 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59061ce3-a8ae-49f5-9550-be9a41a4d2ed None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:54.908645 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59061ce3-a8ae-49f5-9550-be9a41a4d2ed None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:54.915642 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75098c23-66fa-4eee-9600-96325c583b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:54.916319 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75098c23-66fa-4eee-9600-96325c583b1e admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:54.916596 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75098c23-66fa-4eee-9600-96325c583b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:54.916867 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75098c23-66fa-4eee-9600-96325c583b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:54.917620 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75098c23-66fa-4eee-9600-96325c583b1e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:54.917929 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75098c23-66fa-4eee-9600-96325c583b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:54.919514 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75098c23-66fa-4eee-9600-96325c583b1e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:54.934149 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 327/653] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:54.940021 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353703aa-aae4-4a93-b7ad-a7df80979df9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:54.952351 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353703aa-aae4-4a93-b7ad-a7df80979df9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:54.959903 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2d1cb-0d34-4652-ab84-f102956fd7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:54.960968 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2d1cb-0d34-4652-ab84-f102956fd7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:54.961468 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2d1cb-0d34-4652-ab84-f102956fd7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:54.962501 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2d1cb-0d34-4652-ab84-f102956fd7c5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:54.978283 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2d1cb-0d34-4652-ab84-f102956fd7c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:54.980169 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2d1cb-0d34-4652-ab84-f102956fd7c5 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:55.004503 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-22b2d1cb-0d34-4652-ab84-f102956fd7c5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:55.005908 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 327/654] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:55.012722 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75098c23-66fa-4eee-9600-96325c583b1e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:55.029229 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75098c23-66fa-4eee-9600-96325c583b1e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:55.041160 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e794c-8512-4462-b238-807401e5b916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:55.041813 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e794c-8512-4462-b238-807401e5b916 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:55.042093 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e794c-8512-4462-b238-807401e5b916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:55.042365 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e794c-8512-4462-b238-807401e5b916 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:55.043095 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e794c-8512-4462-b238-807401e5b916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:55.043397 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e794c-8512-4462-b238-807401e5b916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:55.045033 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e794c-8512-4462-b238-807401e5b916 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:55.065205 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 328/655] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:55.071528 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2d1cb-0d34-4652-ab84-f102956fd7c5 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:55.086267 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2d1cb-0d34-4652-ab84-f102956fd7c5 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:55.095192 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b3dcd-da23-4aaa-8ed3-c7a5c05a1d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:55.096258 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b3dcd-da23-4aaa-8ed3-c7a5c05a1d55 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:55.096732 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b3dcd-da23-4aaa-8ed3-c7a5c05a1d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:55.097302 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b3dcd-da23-4aaa-8ed3-c7a5c05a1d55 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:55.108345 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b3dcd-da23-4aaa-8ed3-c7a5c05a1d55 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:55.110632 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b3dcd-da23-4aaa-8ed3-c7a5c05a1d55 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:55.131129 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-da9b3dcd-da23-4aaa-8ed3-c7a5c05a1d55 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 15 03:26:55.132568 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 328/656] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:26:55 2021] GET /identity/v3/users/swift => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:55.139404 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e794c-8512-4462-b238-807401e5b916 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:55.156568 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e794c-8512-4462-b238-807401e5b916 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:55.166295 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c55028-ea98-4456-b989-70862fe6c00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:55.166956 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c55028-ea98-4456-b989-70862fe6c00f admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:55.167232 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c55028-ea98-4456-b989-70862fe6c00f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:55.167504 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c55028-ea98-4456-b989-70862fe6c00f admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:55.168387 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c55028-ea98-4456-b989-70862fe6c00f admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:55.168688 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c55028-ea98-4456-b989-70862fe6c00f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:55.170522 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c55028-ea98-4456-b989-70862fe6c00f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:55.199171 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 329/657] 10.222.0.30 () {56 vars in 1156 bytes} [Fri Oct 15 03:26:55 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:55.207189 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b3dcd-da23-4aaa-8ed3-c7a5c05a1d55 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:55.220683 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b3dcd-da23-4aaa-8ed3-c7a5c05a1d55 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:55.229128 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82067297-5f87-4f2c-b96a-2e735e27768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:55.230051 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82067297-5f87-4f2c-b96a-2e735e27768b admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:55.230539 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82067297-5f87-4f2c-b96a-2e735e27768b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:55.231051 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82067297-5f87-4f2c-b96a-2e735e27768b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:55.244195 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82067297-5f87-4f2c-b96a-2e735e27768b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:55.246355 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82067297-5f87-4f2c-b96a-2e735e27768b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:55.262403 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 329/658] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:55 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:55.268947 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c55028-ea98-4456-b989-70862fe6c00f admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:55.284732 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c55028-ea98-4456-b989-70862fe6c00f admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:55.297249 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1073f23-da21-4e45-ba60-4ead59fe4bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:55.298047 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1073f23-da21-4e45-ba60-4ead59fe4bfa admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:55.298328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1073f23-da21-4e45-ba60-4ead59fe4bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:55.298600 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1073f23-da21-4e45-ba60-4ead59fe4bfa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:55.315300 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1073f23-da21-4e45-ba60-4ead59fe4bfa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:55.317176 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1073f23-da21-4e45-ba60-4ead59fe4bfa admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:55.342854 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-f1073f23-da21-4e45-ba60-4ead59fe4bfa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:55.344386 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 330/659] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:55.350609 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82067297-5f87-4f2c-b96a-2e735e27768b admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:55.364573 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82067297-5f87-4f2c-b96a-2e735e27768b admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:55.373345 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed67644-15d9-46fd-8c99-e14b4343dcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:55.374360 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed67644-15d9-46fd-8c99-e14b4343dcec admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:55.374858 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed67644-15d9-46fd-8c99-e14b4343dcec admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:55.375346 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed67644-15d9-46fd-8c99-e14b4343dcec admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:55.376376 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed67644-15d9-46fd-8c99-e14b4343dcec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:55.376899 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed67644-15d9-46fd-8c99-e14b4343dcec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:55.378755 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed67644-15d9-46fd-8c99-e14b4343dcec admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:55.397520 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 330/660] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:55.404396 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1073f23-da21-4e45-ba60-4ead59fe4bfa admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:55.417641 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1073f23-da21-4e45-ba60-4ead59fe4bfa admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:55.428056 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b99fad-b287-48e2-bc8a-2c36e80079a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:55.428852 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b99fad-b287-48e2-bc8a-2c36e80079a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:55.429130 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b99fad-b287-48e2-bc8a-2c36e80079a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:55.429400 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b99fad-b287-48e2-bc8a-2c36e80079a5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:55.437904 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b99fad-b287-48e2-bc8a-2c36e80079a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:55.439999 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b99fad-b287-48e2-bc8a-2c36e80079a5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:55.465233 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-04b99fad-b287-48e2-bc8a-2c36e80079a5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:26:55.466839 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 331/661] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:55.472777 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed67644-15d9-46fd-8c99-e14b4343dcec admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:55.488635 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed67644-15d9-46fd-8c99-e14b4343dcec admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:55.504312 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe20a2-aa84-4b89-94e6-c0e2e01ac2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:55.505229 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe20a2-aa84-4b89-94e6-c0e2e01ac2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:55.505704 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe20a2-aa84-4b89-94e6-c0e2e01ac2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:55.506187 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe20a2-aa84-4b89-94e6-c0e2e01ac2c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:55.507169 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe20a2-aa84-4b89-94e6-c0e2e01ac2c3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:55.507664 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe20a2-aa84-4b89-94e6-c0e2e01ac2c3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:55.510279 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe20a2-aa84-4b89-94e6-c0e2e01ac2c3 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:55.528805 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 331/662] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:26:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:55.535468 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b99fad-b287-48e2-bc8a-2c36e80079a5 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:55.546428 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b99fad-b287-48e2-bc8a-2c36e80079a5 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:55.559135 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9b241-7498-4b19-9cf2-6e97c40656b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:55.559842 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9b241-7498-4b19-9cf2-6e97c40656b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:55.560128 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9b241-7498-4b19-9cf2-6e97c40656b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:55.560453 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9b241-7498-4b19-9cf2-6e97c40656b0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:55.561307 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9b241-7498-4b19-9cf2-6e97c40656b0 admin admin] RBAC: Adding query filter params (role.id=15ba70b0cba04962a6d0b80b50c07004, scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user.id=dfdf0fb38dd04c75a1c874913ea1bf98) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:55.561668 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9b241-7498-4b19-9cf2-6e97c40656b0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:55.563594 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9b241-7498-4b19-9cf2-6e97c40656b0 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:55.570217 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 332/663] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:55 2021] GET /identity/v3/role_assignments?user.id=dfdf0fb38dd04c75a1c874913ea1bf98&scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20&role.id=15ba70b0cba04962a6d0b80b50c07004 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:55.589733 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5419e-0ce7-47b4-bf46-20529f3eae67 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:55.590383 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5419e-0ce7-47b4-bf46-20529f3eae67 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:55.590855 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5419e-0ce7-47b4-bf46-20529f3eae67 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:55.592964 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 332/664] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:55.599650 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf234b5-83f2-4c83-bb6a-1194fd520b0a None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:55.599963 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf234b5-83f2-4c83-bb6a-1194fd520b0a None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:55.600244 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf234b5-83f2-4c83-bb6a-1194fd520b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:55.620928 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-edf234b5-83f2-4c83-bb6a-1194fd520b0a None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:55.622155 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-edf234b5-83f2-4c83-bb6a-1194fd520b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:55.636099 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 333/665] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:55 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:55.673577 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5419e-0ce7-47b4-bf46-20529f3eae67 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:55.693617 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5419e-0ce7-47b4-bf46-20529f3eae67 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:55.698768 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f226e-9f95-4e70-8c88-55647125b07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:55.699917 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f226e-9f95-4e70-8c88-55647125b07a admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:55.700421 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f226e-9f95-4e70-8c88-55647125b07a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:55.700881 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f226e-9f95-4e70-8c88-55647125b07a admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:55.701744 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f226e-9f95-4e70-8c88-55647125b07a admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:55.703620 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f226e-9f95-4e70-8c88-55647125b07a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:55.719508 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-fc6f226e-9f95-4e70-8c88-55647125b07a admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 15 03:26:55.721143 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 333/666] 10.222.0.30 () {56 vars in 1150 bytes} [Fri Oct 15 03:26:55 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:55.728921 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf234b5-83f2-4c83-bb6a-1194fd520b0a None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:55.738315 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf234b5-83f2-4c83-bb6a-1194fd520b0a None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:55.751853 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde6213-e363-41b2-8745-964ec688e2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:55.752885 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde6213-e363-41b2-8745-964ec688e2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:55.753391 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde6213-e363-41b2-8745-964ec688e2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:55.753855 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde6213-e363-41b2-8745-964ec688e2f3 admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:55.754799 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde6213-e363-41b2-8745-964ec688e2f3 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:55.755297 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde6213-e363-41b2-8745-964ec688e2f3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:55.757183 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde6213-e363-41b2-8745-964ec688e2f3 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:55.767158 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 334/667] 10.222.0.30 () {56 vars in 1145 bytes} [Fri Oct 15 03:26:55 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:55.773768 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f226e-9f95-4e70-8c88-55647125b07a admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:55.790089 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f226e-9f95-4e70-8c88-55647125b07a admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:55.799121 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22f745-f452-47c8-8d20-50f5dad49d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:55.800246 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22f745-f452-47c8-8d20-50f5dad49d90 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:55.800784 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22f745-f452-47c8-8d20-50f5dad49d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:55.801269 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22f745-f452-47c8-8d20-50f5dad49d90 admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:55.802238 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22f745-f452-47c8-8d20-50f5dad49d90 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:55.802749 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22f745-f452-47c8-8d20-50f5dad49d90 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:55.804713 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22f745-f452-47c8-8d20-50f5dad49d90 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:55.816804 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 334/668] 10.222.0.30 () {56 vars in 1145 bytes} [Fri Oct 15 03:26:55 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:55.823784 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde6213-e363-41b2-8745-964ec688e2f3 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:55.833877 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde6213-e363-41b2-8745-964ec688e2f3 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:55.843857 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e491b-e455-4f2b-9960-bf68ea289134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:55.844828 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e491b-e455-4f2b-9960-bf68ea289134 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:55.845325 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e491b-e455-4f2b-9960-bf68ea289134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:55.845787 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e491b-e455-4f2b-9960-bf68ea289134 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:55.846776 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e491b-e455-4f2b-9960-bf68ea289134 admin admin] RBAC: Adding query filter params (interface=public, service_id=191a181d29af4db3ac54b5d0c357f746, region_id=RegionOne) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:55.847275 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e491b-e455-4f2b-9960-bf68ea289134 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:55.848756 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING py.warnings [None req-883e491b-e455-4f2b-9960-bf68ea289134 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:26:55.848756 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: warnings.warn(msg) Oct 15 03:26:55.848756 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: Oct 15 03:26:55.849978 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e491b-e455-4f2b-9960-bf68ea289134 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:55.861820 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 335/669] 10.222.0.30 () {56 vars in 1272 bytes} [Fri Oct 15 03:26:55 2021] GET /identity/v3/endpoints?service_id=191a181d29af4db3ac54b5d0c357f746&interface=public®ion_id=RegionOne => generated 194 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:55.868352 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22f745-f452-47c8-8d20-50f5dad49d90 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:55.878515 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22f745-f452-47c8-8d20-50f5dad49d90 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:55.888374 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aec84b-f05c-4601-8d39-96de4784f383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:55.889412 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aec84b-f05c-4601-8d39-96de4784f383 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:55.889888 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aec84b-f05c-4601-8d39-96de4784f383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:55.890350 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aec84b-f05c-4601-8d39-96de4784f383 admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:55.891228 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aec84b-f05c-4601-8d39-96de4784f383 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:55.893075 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aec84b-f05c-4601-8d39-96de4784f383 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:55.904552 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 335/670] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Oct 15 03:26:55 2021] GET /identity/v3/services => generated 772 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:55.926511 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134e398-cc35-4680-bb7a-a15c0ae69a90 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:55.926511 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134e398-cc35-4680-bb7a-a15c0ae69a90 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:55.926511 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134e398-cc35-4680-bb7a-a15c0ae69a90 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:55.929623 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 336/671] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:55.935247 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016aa3e-4c3f-4810-9b79-fad79c3a913e None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:55.935537 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016aa3e-4c3f-4810-9b79-fad79c3a913e None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:55.935842 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016aa3e-4c3f-4810-9b79-fad79c3a913e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:55.955562 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-7016aa3e-4c3f-4810-9b79-fad79c3a913e None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:55.956805 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7016aa3e-4c3f-4810-9b79-fad79c3a913e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:55.965717 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 336/672] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:55 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:55.990263 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134e398-cc35-4680-bb7a-a15c0ae69a90 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:56.013476 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134e398-cc35-4680-bb7a-a15c0ae69a90 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:56.024651 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb6fe3-3737-4336-81d9-66f2182becff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:56.025465 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb6fe3-3737-4336-81d9-66f2182becff admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:56.025750 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb6fe3-3737-4336-81d9-66f2182becff admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:56.026015 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb6fe3-3737-4336-81d9-66f2182becff admin admin] PATH_INFO: `/v3/services/network` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:56.026688 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb6fe3-3737-4336-81d9-66f2182becff admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:56.028352 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb6fe3-3737-4336-81d9-66f2182becff admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:56.040003 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-89bb6fe3-3737-4336-81d9-66f2182becff admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 15 03:26:56.041544 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 337/673] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:55 2021] GET /identity/v3/services/network => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:56.048571 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016aa3e-4c3f-4810-9b79-fad79c3a913e None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:56.066381 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016aa3e-4c3f-4810-9b79-fad79c3a913e None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:56.075591 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd965f81-13d4-4c58-ae36-9308c5287c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:56.076674 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd965f81-13d4-4c58-ae36-9308c5287c8d admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:56.077166 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd965f81-13d4-4c58-ae36-9308c5287c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:56.077639 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd965f81-13d4-4c58-ae36-9308c5287c8d admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:56.078573 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd965f81-13d4-4c58-ae36-9308c5287c8d admin admin] RBAC: Adding query filter params (name=network) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:56.079080 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd965f81-13d4-4c58-ae36-9308c5287c8d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:56.081008 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd965f81-13d4-4c58-ae36-9308c5287c8d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:56.092430 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 337/674] 10.222.0.30 () {56 vars in 1133 bytes} [Fri Oct 15 03:26:56 2021] GET /identity/v3/services?name=network => generated 124 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:56.099444 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb6fe3-3737-4336-81d9-66f2182becff admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:56.113435 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb6fe3-3737-4336-81d9-66f2182becff admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:56.120515 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0dc85-25f3-431e-b24b-ab14f0406e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:56.121539 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0dc85-25f3-431e-b24b-ab14f0406e41 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:56.122015 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0dc85-25f3-431e-b24b-ab14f0406e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:56.122482 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0dc85-25f3-431e-b24b-ab14f0406e41 admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:56.123426 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0dc85-25f3-431e-b24b-ab14f0406e41 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:56.123957 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0dc85-25f3-431e-b24b-ab14f0406e41 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:56.125849 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0dc85-25f3-431e-b24b-ab14f0406e41 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:56.137868 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 338/675] 10.222.0.30 () {56 vars in 1133 bytes} [Fri Oct 15 03:26:56 2021] GET /identity/v3/services?type=network => generated 350 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:56.144386 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd965f81-13d4-4c58-ae36-9308c5287c8d admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:56.156603 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd965f81-13d4-4c58-ae36-9308c5287c8d admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:56.161722 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53a74f-7855-4cdd-ba63-f1a0bddfd8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:56.162375 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53a74f-7855-4cdd-ba63-f1a0bddfd8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:56.162661 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53a74f-7855-4cdd-ba63-f1a0bddfd8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:56.162994 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53a74f-7855-4cdd-ba63-f1a0bddfd8e2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:56.164397 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53a74f-7855-4cdd-ba63-f1a0bddfd8e2 admin admin] RBAC: Adding query filter params (interface=public, service_id=4b1db549ef634ba1b55a63a474944a49, region_id=RegionOne) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:56.164397 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53a74f-7855-4cdd-ba63-f1a0bddfd8e2 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:56.165798 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING py.warnings [None req-ed53a74f-7855-4cdd-ba63-f1a0bddfd8e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:26:56.165798 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: warnings.warn(msg) Oct 15 03:26:56.165798 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: Oct 15 03:26:56.166783 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53a74f-7855-4cdd-ba63-f1a0bddfd8e2 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:56.175484 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 338/676] 10.222.0.30 () {56 vars in 1272 bytes} [Fri Oct 15 03:26:56 2021] GET /identity/v3/endpoints?service_id=4b1db549ef634ba1b55a63a474944a49&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:56.181616 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0dc85-25f3-431e-b24b-ab14f0406e41 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:56.192716 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0dc85-25f3-431e-b24b-ab14f0406e41 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:56.197600 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9e809-5a0b-4e7f-9cef-0decb44e733a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:56.198521 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9e809-5a0b-4e7f-9cef-0decb44e733a admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:56.198995 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9e809-5a0b-4e7f-9cef-0decb44e733a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:56.199473 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9e809-5a0b-4e7f-9cef-0decb44e733a admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:56.200399 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9e809-5a0b-4e7f-9cef-0decb44e733a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:56.202242 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9e809-5a0b-4e7f-9cef-0decb44e733a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:56.208177 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 339/677] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Oct 15 03:26:56 2021] GET /identity/v3/services => generated 772 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:57.030156 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642334e-0752-4c2a-93db-6ac7535c4783 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:57.030699 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642334e-0752-4c2a-93db-6ac7535c4783 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:57.030699 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642334e-0752-4c2a-93db-6ac7535c4783 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:57.032792 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 339/678] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:57.038661 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e66f7-b701-4ded-a358-491a1fdd7749 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:57.039068 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e66f7-b701-4ded-a358-491a1fdd7749 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:57.039252 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e66f7-b701-4ded-a358-491a1fdd7749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:57.068686 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-0a7e66f7-b701-4ded-a358-491a1fdd7749 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:57.069897 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-0a7e66f7-b701-4ded-a358-491a1fdd7749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:57.078836 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 340/679] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:57 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:57.121169 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642334e-0752-4c2a-93db-6ac7535c4783 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:57.137283 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642334e-0752-4c2a-93db-6ac7535c4783 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:57.141851 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a0e7c-9f85-46ad-94f3-bbc44f4e17f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:57.142626 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a0e7c-9f85-46ad-94f3-bbc44f4e17f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:57.142911 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a0e7c-9f85-46ad-94f3-bbc44f4e17f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:57.143186 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a0e7c-9f85-46ad-94f3-bbc44f4e17f0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:57.157079 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a0e7c-9f85-46ad-94f3-bbc44f4e17f0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:57.163907 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-142a0e7c-9f85-46ad-94f3-bbc44f4e17f0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:26:57.165618 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 340/680] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:26:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:57.172247 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e66f7-b701-4ded-a358-491a1fdd7749 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:57.182045 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e66f7-b701-4ded-a358-491a1fdd7749 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:57.191837 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fed573-0323-45a6-a863-96ab1a68d7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:57.192501 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fed573-0323-45a6-a863-96ab1a68d7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:57.192785 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fed573-0323-45a6-a863-96ab1a68d7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:57.193061 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fed573-0323-45a6-a863-96ab1a68d7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:57.193825 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fed573-0323-45a6-a863-96ab1a68d7b6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:57.194157 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fed573-0323-45a6-a863-96ab1a68d7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:57.195785 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fed573-0323-45a6-a863-96ab1a68d7b6 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:57.207320 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 341/681] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:57.214321 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a0e7c-9f85-46ad-94f3-bbc44f4e17f0 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:57.225169 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a0e7c-9f85-46ad-94f3-bbc44f4e17f0 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:57.249647 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55285e9-9f48-4454-802c-ca7b608d2ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:57.250467 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55285e9-9f48-4454-802c-ca7b608d2ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:57.250748 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55285e9-9f48-4454-802c-ca7b608d2ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:57.251027 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55285e9-9f48-4454-802c-ca7b608d2ed2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:57.262887 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55285e9-9f48-4454-802c-ca7b608d2ed2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:57.264772 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55285e9-9f48-4454-802c-ca7b608d2ed2 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:57.289962 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-e55285e9-9f48-4454-802c-ca7b608d2ed2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:57.295787 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 341/682] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:57.297709 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fed573-0323-45a6-a863-96ab1a68d7b6 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:57.322617 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fed573-0323-45a6-a863-96ab1a68d7b6 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:57.344598 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217543d-b424-490d-aa0a-3d77ab8a2c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:57.345297 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217543d-b424-490d-aa0a-3d77ab8a2c56 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:57.345584 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217543d-b424-490d-aa0a-3d77ab8a2c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:57.345898 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217543d-b424-490d-aa0a-3d77ab8a2c56 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:57.346626 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217543d-b424-490d-aa0a-3d77ab8a2c56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:57.346934 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217543d-b424-490d-aa0a-3d77ab8a2c56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:57.348937 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217543d-b424-490d-aa0a-3d77ab8a2c56 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:57.364726 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 342/683] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:57.371228 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55285e9-9f48-4454-802c-ca7b608d2ed2 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:57.388881 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55285e9-9f48-4454-802c-ca7b608d2ed2 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:57.404338 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55128372-0183-43c5-ad29-9f1825248f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:57.405132 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55128372-0183-43c5-ad29-9f1825248f68 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:57.405414 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55128372-0183-43c5-ad29-9f1825248f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:57.405694 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55128372-0183-43c5-ad29-9f1825248f68 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:57.416746 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55128372-0183-43c5-ad29-9f1825248f68 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:57.418774 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55128372-0183-43c5-ad29-9f1825248f68 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:57.430551 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbe2a2-b112-4d9a-9e7a-7668e090f529 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:57.430822 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbe2a2-b112-4d9a-9e7a-7668e090f529 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:57.431103 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbe2a2-b112-4d9a-9e7a-7668e090f529 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:57.432957 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 343/684] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:57.437638 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-55128372-0183-43c5-ad29-9f1825248f68 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 15 03:26:57.438745 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88617b-6edf-4bae-bab1-940d51ea0bf3 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:57.439058 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 342/685] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Oct 15 03:26:57 2021] GET /identity/v3/users/nova => generated 82 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:57.439170 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88617b-6edf-4bae-bab1-940d51ea0bf3 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:57.439363 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88617b-6edf-4bae-bab1-940d51ea0bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:57.452992 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55128372-0183-43c5-ad29-9f1825248f68 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:57.463155 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55128372-0183-43c5-ad29-9f1825248f68 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:57.467653 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3476d66-c02a-482f-8265-c947694cf796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:57.468333 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3476d66-c02a-482f-8265-c947694cf796 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:57.468615 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3476d66-c02a-482f-8265-c947694cf796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:57.468888 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3476d66-c02a-482f-8265-c947694cf796 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:57.469131 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-df88617b-6edf-4bae-bab1-940d51ea0bf3 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:57.469722 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3476d66-c02a-482f-8265-c947694cf796 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:57.470028 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3476d66-c02a-482f-8265-c947694cf796 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:57.470315 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-df88617b-6edf-4bae-bab1-940d51ea0bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:57.471872 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3476d66-c02a-482f-8265-c947694cf796 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:57.490741 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 343/686] 10.222.0.30 () {56 vars in 1154 bytes} [Fri Oct 15 03:26:57 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:57.493618 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 344/687] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:57 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:57.499851 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3476d66-c02a-482f-8265-c947694cf796 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:57.509571 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3476d66-c02a-482f-8265-c947694cf796 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:57.517376 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88617b-6edf-4bae-bab1-940d51ea0bf3 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:57.519300 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b157a0-75d0-425d-b598-a33b9accce99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:57.519982 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b157a0-75d0-425d-b598-a33b9accce99 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:57.520268 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b157a0-75d0-425d-b598-a33b9accce99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:57.520550 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b157a0-75d0-425d-b598-a33b9accce99 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:57.531119 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88617b-6edf-4bae-bab1-940d51ea0bf3 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:57.536818 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b157a0-75d0-425d-b598-a33b9accce99 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:57.540882 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7760e-3780-45d2-b810-dbe0fe9a547e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:57.541611 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7760e-3780-45d2-b810-dbe0fe9a547e admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:57.542256 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b157a0-75d0-425d-b598-a33b9accce99 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:57.543298 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7760e-3780-45d2-b810-dbe0fe9a547e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:57.543581 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7760e-3780-45d2-b810-dbe0fe9a547e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:57.565627 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 344/688] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:26:57 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:26:57.566469 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7760e-3780-45d2-b810-dbe0fe9a547e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:57.573700 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-c2b7760e-3780-45d2-b810-dbe0fe9a547e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 03:26:57.576490 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 345/689] 10.222.0.30 () {56 vars in 1123 bytes} [Fri Oct 15 03:26:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:57.577447 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b157a0-75d0-425d-b598-a33b9accce99 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:57.582219 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7760e-3780-45d2-b810-dbe0fe9a547e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:57.592211 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7760e-3780-45d2-b810-dbe0fe9a547e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:57.596612 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b157a0-75d0-425d-b598-a33b9accce99 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:57.603155 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845abbbc-010c-4144-8fee-c3439f5079bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:57.604494 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845abbbc-010c-4144-8fee-c3439f5079bc admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:57.604811 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caaf798-96f8-4ded-9405-6e536a30eca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:57.605648 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caaf798-96f8-4ded-9405-6e536a30eca9 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:57.606073 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845abbbc-010c-4144-8fee-c3439f5079bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:57.606628 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845abbbc-010c-4144-8fee-c3439f5079bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:57.606952 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caaf798-96f8-4ded-9405-6e536a30eca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:57.607363 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caaf798-96f8-4ded-9405-6e536a30eca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:57.608949 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caaf798-96f8-4ded-9405-6e536a30eca9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:57.609626 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caaf798-96f8-4ded-9405-6e536a30eca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:57.612531 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caaf798-96f8-4ded-9405-6e536a30eca9 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:57.627052 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845abbbc-010c-4144-8fee-c3439f5079bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:57.629315 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 346/690] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Oct 15 03:26:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:57.631180 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845abbbc-010c-4144-8fee-c3439f5079bc admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:57.640611 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caaf798-96f8-4ded-9405-6e536a30eca9 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:57.653324 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-845abbbc-010c-4144-8fee-c3439f5079bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:57.655171 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 345/691] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:57.657319 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caaf798-96f8-4ded-9405-6e536a30eca9 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:57.665984 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845abbbc-010c-4144-8fee-c3439f5079bc admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:57.673009 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c4a58-0a3f-485c-85bc-f0d9b4881d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:57.673804 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c4a58-0a3f-485c-85bc-f0d9b4881d50 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:57.674088 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c4a58-0a3f-485c-85bc-f0d9b4881d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:57.674363 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c4a58-0a3f-485c-85bc-f0d9b4881d50 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:57.684275 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845abbbc-010c-4144-8fee-c3439f5079bc admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:57.697508 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cc17d-577d-42db-a205-62afa58e4c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:57.698783 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cc17d-577d-42db-a205-62afa58e4c18 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:57.699923 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c4a58-0a3f-485c-85bc-f0d9b4881d50 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:57.700402 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cc17d-577d-42db-a205-62afa58e4c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:57.700918 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cc17d-577d-42db-a205-62afa58e4c18 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:57.702928 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2cc17d-577d-42db-a205-62afa58e4c18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:57.704161 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c4a58-0a3f-485c-85bc-f0d9b4881d50 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:57.704590 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2cc17d-577d-42db-a205-62afa58e4c18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:57.706423 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2cc17d-577d-42db-a205-62afa58e4c18 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:57.733312 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 346/692] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:57.736360 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-600c4a58-0a3f-485c-85bc-f0d9b4881d50 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:57.738015 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 347/693] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:57.744633 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cc17d-577d-42db-a205-62afa58e4c18 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:57.750574 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c4a58-0a3f-485c-85bc-f0d9b4881d50 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:57.762150 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cc17d-577d-42db-a205-62afa58e4c18 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:57.766703 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c4a58-0a3f-485c-85bc-f0d9b4881d50 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:57.771520 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0f6c6-3005-454b-a473-1f58b2f2f93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:57.772667 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0f6c6-3005-454b-a473-1f58b2f2f93b admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:57.773257 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0f6c6-3005-454b-a473-1f58b2f2f93b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:57.773741 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0f6c6-3005-454b-a473-1f58b2f2f93b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:57.780847 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507f728-b02f-488b-9876-1cb248840a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:57.781515 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507f728-b02f-488b-9876-1cb248840a35 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:57.781798 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507f728-b02f-488b-9876-1cb248840a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:57.782075 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507f728-b02f-488b-9876-1cb248840a35 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:57.782647 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0f6c6-3005-454b-a473-1f58b2f2f93b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:57.782848 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507f728-b02f-488b-9876-1cb248840a35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:57.783106 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507f728-b02f-488b-9876-1cb248840a35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:57.784731 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507f728-b02f-488b-9876-1cb248840a35 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:57.785520 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0f6c6-3005-454b-a473-1f58b2f2f93b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:57.804046 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 348/694] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:57.804513 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-a4d0f6c6-3005-454b-a473-1f58b2f2f93b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:26:57.806702 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 347/695] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:57.812762 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507f728-b02f-488b-9876-1cb248840a35 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:57.818802 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0f6c6-3005-454b-a473-1f58b2f2f93b admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:57.830922 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507f728-b02f-488b-9876-1cb248840a35 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:57.834572 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0f6c6-3005-454b-a473-1f58b2f2f93b admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:57.842672 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2032785-a4c7-49b1-803a-8562cdafb9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:57.843598 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2032785-a4c7-49b1-803a-8562cdafb9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:57.844107 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2032785-a4c7-49b1-803a-8562cdafb9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:57.844601 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2032785-a4c7-49b1-803a-8562cdafb9e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:57.845330 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72660b96-b59d-4d75-b28c-945d759b8369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:57.846354 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2032785-a4c7-49b1-803a-8562cdafb9e0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:57.847337 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72660b96-b59d-4d75-b28c-945d759b8369 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:57.847882 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2032785-a4c7-49b1-803a-8562cdafb9e0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:57.850219 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2032785-a4c7-49b1-803a-8562cdafb9e0 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:57.850739 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72660b96-b59d-4d75-b28c-945d759b8369 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:57.851216 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72660b96-b59d-4d75-b28c-945d759b8369 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:57.867465 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72660b96-b59d-4d75-b28c-945d759b8369 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:57.870383 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72660b96-b59d-4d75-b28c-945d759b8369 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:57.883943 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 349/696] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:26:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:57.885113 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2032785-a4c7-49b1-803a-8562cdafb9e0 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:57.894015 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-72660b96-b59d-4d75-b28c-945d759b8369 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 15 03:26:57.903257 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2032785-a4c7-49b1-803a-8562cdafb9e0 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:57.905980 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 348/697] 10.222.0.30 () {56 vars in 1138 bytes} [Fri Oct 15 03:26:57 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:57.908587 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967363e3-1816-4208-bb81-76f67e6bfc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:57.909482 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967363e3-1816-4208-bb81-76f67e6bfc3b admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:57.909990 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967363e3-1816-4208-bb81-76f67e6bfc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:57.910472 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967363e3-1816-4208-bb81-76f67e6bfc3b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:57.911861 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967363e3-1816-4208-bb81-76f67e6bfc3b admin admin] RBAC: Adding query filter params (role.id=15ba70b0cba04962a6d0b80b50c07004, scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user.id=3d71a1bd93b04249b2b8e6a054de44c7) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:57.912401 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967363e3-1816-4208-bb81-76f67e6bfc3b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:57.912506 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72660b96-b59d-4d75-b28c-945d759b8369 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:57.915131 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967363e3-1816-4208-bb81-76f67e6bfc3b admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:57.922180 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 350/698] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:26:57 2021] GET /identity/v3/role_assignments?user.id=3d71a1bd93b04249b2b8e6a054de44c7&scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20&role.id=15ba70b0cba04962a6d0b80b50c07004 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:57.929111 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72660b96-b59d-4d75-b28c-945d759b8369 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:57.935071 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc612e7-84dc-4018-9b2b-f2106dcf0659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:57.936184 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc612e7-84dc-4018-9b2b-f2106dcf0659 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:57.936684 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc612e7-84dc-4018-9b2b-f2106dcf0659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:57.937266 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc612e7-84dc-4018-9b2b-f2106dcf0659 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:57.938352 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc612e7-84dc-4018-9b2b-f2106dcf0659 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:57.938939 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc612e7-84dc-4018-9b2b-f2106dcf0659 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:57.941280 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc612e7-84dc-4018-9b2b-f2106dcf0659 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:57.968032 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 349/699] 10.222.0.30 () {56 vars in 1170 bytes} [Fri Oct 15 03:26:57 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:57.976812 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967363e3-1816-4208-bb81-76f67e6bfc3b admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:57.987916 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967363e3-1816-4208-bb81-76f67e6bfc3b admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:58.000328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d60c7c-00c3-4ce2-bb6c-d3f8beb60776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:58.001565 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d60c7c-00c3-4ce2-bb6c-d3f8beb60776 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:58.002101 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d60c7c-00c3-4ce2-bb6c-d3f8beb60776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:58.002597 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d60c7c-00c3-4ce2-bb6c-d3f8beb60776 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:58.016703 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d60c7c-00c3-4ce2-bb6c-d3f8beb60776 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:58.019027 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d60c7c-00c3-4ce2-bb6c-d3f8beb60776 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:58.048069 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-f1d60c7c-00c3-4ce2-bb6c-d3f8beb60776 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:58.050471 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 351/700] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:58.056669 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc612e7-84dc-4018-9b2b-f2106dcf0659 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:58.068282 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc612e7-84dc-4018-9b2b-f2106dcf0659 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:58.080309 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36d057-9877-4f51-b0ec-c1beb209f797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:58.081403 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36d057-9877-4f51-b0ec-c1beb209f797 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:58.081990 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36d057-9877-4f51-b0ec-c1beb209f797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:58.082492 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36d057-9877-4f51-b0ec-c1beb209f797 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:58.083513 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36d057-9877-4f51-b0ec-c1beb209f797 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:58.084059 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36d057-9877-4f51-b0ec-c1beb209f797 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:58.085929 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36d057-9877-4f51-b0ec-c1beb209f797 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:58.105077 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 350/701] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:58.110998 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d60c7c-00c3-4ce2-bb6c-d3f8beb60776 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:58.121901 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d60c7c-00c3-4ce2-bb6c-d3f8beb60776 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:58.132214 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20094c7-15e3-4b88-81e2-8f79e15b9773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:58.133955 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20094c7-15e3-4b88-81e2-8f79e15b9773 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:58.134483 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20094c7-15e3-4b88-81e2-8f79e15b9773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:58.135011 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20094c7-15e3-4b88-81e2-8f79e15b9773 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:58.143264 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20094c7-15e3-4b88-81e2-8f79e15b9773 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:58.145551 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20094c7-15e3-4b88-81e2-8f79e15b9773 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:58.165957 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-f20094c7-15e3-4b88-81e2-8f79e15b9773 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:26:58.167951 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 352/702] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:58.174155 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36d057-9877-4f51-b0ec-c1beb209f797 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:58.184800 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36d057-9877-4f51-b0ec-c1beb209f797 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:58.192107 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68463714-c2a1-4a4e-9fce-0b365406bb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:58.192838 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68463714-c2a1-4a4e-9fce-0b365406bb2c admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:58.193118 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68463714-c2a1-4a4e-9fce-0b365406bb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:58.193447 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68463714-c2a1-4a4e-9fce-0b365406bb2c admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:58.194363 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68463714-c2a1-4a4e-9fce-0b365406bb2c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:58.194669 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68463714-c2a1-4a4e-9fce-0b365406bb2c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:58.197257 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68463714-c2a1-4a4e-9fce-0b365406bb2c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:58.211029 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 351/703] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:26:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:58.218454 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20094c7-15e3-4b88-81e2-8f79e15b9773 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:58.230703 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20094c7-15e3-4b88-81e2-8f79e15b9773 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:58.235626 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86976ab-0cd5-438c-8764-b608ce4cf185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:58.239583 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86976ab-0cd5-438c-8764-b608ce4cf185 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:58.239583 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86976ab-0cd5-438c-8764-b608ce4cf185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:58.239583 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86976ab-0cd5-438c-8764-b608ce4cf185 admin admin] PATH_INFO: `/v3/projects/9f95c04b0a7b4a2d8fbb4b547f70dc20/users/3f598b94a850413494da575188706cb1/roles/04a530eb7b7e46d4a07b4c3b02cee3aa` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:58.266596 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86976ab-0cd5-438c-8764-b608ce4cf185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user_id=3f598b94a850413494da575188706cb1, role_id=04a530eb7b7e46d4a07b4c3b02cee3aa)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:58.269296 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86976ab-0cd5-438c-8764-b608ce4cf185 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:58.294117 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 353/704] 10.222.0.30 () {58 vars in 1460 bytes} [Fri Oct 15 03:26:58 2021] PUT /identity/v3/projects/9f95c04b0a7b4a2d8fbb4b547f70dc20/users/3f598b94a850413494da575188706cb1/roles/04a530eb7b7e46d4a07b4c3b02cee3aa => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:26:58.411577 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644b92f-a61f-41e0-bc6e-a2ab1e3811b4 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:58.411931 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644b92f-a61f-41e0-bc6e-a2ab1e3811b4 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:58.412114 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644b92f-a61f-41e0-bc6e-a2ab1e3811b4 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:58.414234 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 352/705] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:26:58.421438 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3dcf8-5f5c-4588-bf60-10b91b6fe096 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:58.421721 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3dcf8-5f5c-4588-bf60-10b91b6fe096 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:58.421997 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3dcf8-5f5c-4588-bf60-10b91b6fe096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:58.441594 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-39a3dcf8-5f5c-4588-bf60-10b91b6fe096 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:58.442806 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-39a3dcf8-5f5c-4588-bf60-10b91b6fe096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:58.507360 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 354/706] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:58 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:58.517372 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edfa9f-76c2-43a6-88dc-63faaefd8754 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:58.517662 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edfa9f-76c2-43a6-88dc-63faaefd8754 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:58.517937 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edfa9f-76c2-43a6-88dc-63faaefd8754 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:58.519841 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 353/707] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:26:58.526588 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e640df-41fc-40ca-89fe-30c43cf458eb None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:58.526875 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e640df-41fc-40ca-89fe-30c43cf458eb None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:58.527161 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e640df-41fc-40ca-89fe-30c43cf458eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:58.533781 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edfa9f-76c2-43a6-88dc-63faaefd8754 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:58.549297 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edfa9f-76c2-43a6-88dc-63faaefd8754 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:58.554412 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49f5a1-6289-46c7-b5a4-c3fe1cb5d7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:58.556057 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49f5a1-6289-46c7-b5a4-c3fe1cb5d7fe admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:58.556565 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49f5a1-6289-46c7-b5a4-c3fe1cb5d7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:58.557038 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49f5a1-6289-46c7-b5a4-c3fe1cb5d7fe admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:58.557280 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-70e640df-41fc-40ca-89fe-30c43cf458eb None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:58.558685 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-70e640df-41fc-40ca-89fe-30c43cf458eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:58.568648 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49f5a1-6289-46c7-b5a4-c3fe1cb5d7fe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:26:58.569048 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 355/708] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:58 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:58.577539 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-3b49f5a1-6289-46c7-b5a4-c3fe1cb5d7fe admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:26:58.579210 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 354/709] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:26:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:58.585873 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e640df-41fc-40ca-89fe-30c43cf458eb None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:58.594907 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49f5a1-6289-46c7-b5a4-c3fe1cb5d7fe admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:58.597362 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e640df-41fc-40ca-89fe-30c43cf458eb None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:58.602465 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14f870-0522-413d-b098-927e1ea10b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:58.603361 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14f870-0522-413d-b098-927e1ea10b44 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:58.603872 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14f870-0522-413d-b098-927e1ea10b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:58.604345 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14f870-0522-413d-b098-927e1ea10b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:58.605303 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14f870-0522-413d-b098-927e1ea10b44 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:58.605690 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49f5a1-6289-46c7-b5a4-c3fe1cb5d7fe admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:58.606121 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14f870-0522-413d-b098-927e1ea10b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:58.607965 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14f870-0522-413d-b098-927e1ea10b44 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:58.611712 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c4c16-6445-4c73-ac52-0e72dd498218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:58.612529 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c4c16-6445-4c73-ac52-0e72dd498218 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:58.612811 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c4c16-6445-4c73-ac52-0e72dd498218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:58.613087 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c4c16-6445-4c73-ac52-0e72dd498218 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:58.613754 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c4c16-6445-4c73-ac52-0e72dd498218 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:58.615343 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c4c16-6445-4c73-ac52-0e72dd498218 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:58.619129 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 356/710] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:26:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:58.627986 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14f870-0522-413d-b098-927e1ea10b44 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:58.635396 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-0b3c4c16-6445-4c73-ac52-0e72dd498218 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 15 03:26:58.636992 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 355/711] 10.222.0.30 () {56 vars in 1150 bytes} [Fri Oct 15 03:26:58 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:58.646192 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14f870-0522-413d-b098-927e1ea10b44 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:58.647234 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c4c16-6445-4c73-ac52-0e72dd498218 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:58.651255 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc81838-705e-403f-a71d-9e450e1352d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:58.652262 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc81838-705e-403f-a71d-9e450e1352d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:58.652739 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc81838-705e-403f-a71d-9e450e1352d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:58.653157 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc81838-705e-403f-a71d-9e450e1352d5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:58.665676 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc81838-705e-403f-a71d-9e450e1352d5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:58.667847 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc81838-705e-403f-a71d-9e450e1352d5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:58.668150 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c4c16-6445-4c73-ac52-0e72dd498218 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:58.690029 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-0fc81838-705e-403f-a71d-9e450e1352d5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:58.691561 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 357/712] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:26:58.692948 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351833c-86b2-4f94-8679-f7a56a1cd6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:58.693690 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351833c-86b2-4f94-8679-f7a56a1cd6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:58.694045 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351833c-86b2-4f94-8679-f7a56a1cd6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:58.694409 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351833c-86b2-4f94-8679-f7a56a1cd6b8 admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:58.695208 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351833c-86b2-4f94-8679-f7a56a1cd6b8 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:58.695585 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351833c-86b2-4f94-8679-f7a56a1cd6b8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:58.697343 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351833c-86b2-4f94-8679-f7a56a1cd6b8 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:58.697928 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc81838-705e-403f-a71d-9e450e1352d5 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:58.708336 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc81838-705e-403f-a71d-9e450e1352d5 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:58.709008 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 356/713] 10.222.0.30 () {56 vars in 1145 bytes} [Fri Oct 15 03:26:58 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:58.716303 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351833c-86b2-4f94-8679-f7a56a1cd6b8 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:58.722731 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee6771-dadd-4cb5-b64b-a47fa604529e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:58.724024 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee6771-dadd-4cb5-b64b-a47fa604529e admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:58.724507 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee6771-dadd-4cb5-b64b-a47fa604529e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:58.725007 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee6771-dadd-4cb5-b64b-a47fa604529e admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:58.726119 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee6771-dadd-4cb5-b64b-a47fa604529e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:58.726647 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee6771-dadd-4cb5-b64b-a47fa604529e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:58.729160 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee6771-dadd-4cb5-b64b-a47fa604529e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:58.742328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 358/714] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:26:58.742477 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351833c-86b2-4f94-8679-f7a56a1cd6b8 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:58.749465 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee6771-dadd-4cb5-b64b-a47fa604529e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:58.755939 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf962d9c-6e4b-4300-8bf7-454bf5f6d8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:58.756521 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf962d9c-6e4b-4300-8bf7-454bf5f6d8df admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:58.756801 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf962d9c-6e4b-4300-8bf7-454bf5f6d8df admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:58.757073 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf962d9c-6e4b-4300-8bf7-454bf5f6d8df admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:58.759486 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf962d9c-6e4b-4300-8bf7-454bf5f6d8df admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:58.759821 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf962d9c-6e4b-4300-8bf7-454bf5f6d8df admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:58.763817 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf962d9c-6e4b-4300-8bf7-454bf5f6d8df admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:58.768045 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee6771-dadd-4cb5-b64b-a47fa604529e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:58.773903 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 357/715] 10.222.0.30 () {56 vars in 1145 bytes} [Fri Oct 15 03:26:58 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:58.779943 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf962d9c-6e4b-4300-8bf7-454bf5f6d8df admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:58.780730 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b9db7-590f-460a-8f1d-b1aa74ab05de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:58.781732 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b9db7-590f-460a-8f1d-b1aa74ab05de admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:58.782188 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b9db7-590f-460a-8f1d-b1aa74ab05de admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:58.782635 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b9db7-590f-460a-8f1d-b1aa74ab05de admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:58.791330 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b9db7-590f-460a-8f1d-b1aa74ab05de admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:58.793639 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b9db7-590f-460a-8f1d-b1aa74ab05de admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:58.806450 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf962d9c-6e4b-4300-8bf7-454bf5f6d8df admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:58.809370 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-891b9db7-590f-460a-8f1d-b1aa74ab05de admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 15 03:26:58.811025 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 359/716] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:26:58 2021] GET /identity/v3/users/swift => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:58.823708 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2db02-53f2-438f-a1f4-c5ad73aba64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:58.823708 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2db02-53f2-438f-a1f4-c5ad73aba64d admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:58.823708 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2db02-53f2-438f-a1f4-c5ad73aba64d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:58.823708 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2db02-53f2-438f-a1f4-c5ad73aba64d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:58.824047 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2db02-53f2-438f-a1f4-c5ad73aba64d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:58.824047 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING py.warnings [None req-07a2db02-53f2-438f-a1f4-c5ad73aba64d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:26:58.824047 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: warnings.warn(msg) Oct 15 03:26:58.824047 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: Oct 15 03:26:58.824047 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2db02-53f2-438f-a1f4-c5ad73aba64d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:58.825366 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b9db7-590f-460a-8f1d-b1aa74ab05de admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:58.837606 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b9db7-590f-460a-8f1d-b1aa74ab05de admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:58.844049 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 358/717] 10.222.0.30 () {60 vars in 1165 bytes} [Fri Oct 15 03:26:58 2021] POST /identity/v3/endpoints => generated 346 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:26:58.873966 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a506f-e8d4-49dc-96d4-bf584f98ffbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:58.874936 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a506f-e8d4-49dc-96d4-bf584f98ffbb admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:58.875405 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a506f-e8d4-49dc-96d4-bf584f98ffbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:58.875853 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a506f-e8d4-49dc-96d4-bf584f98ffbb admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:58.876901 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a506f-e8d4-49dc-96d4-bf584f98ffbb admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:58.877381 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a506f-e8d4-49dc-96d4-bf584f98ffbb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:58.879401 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a506f-e8d4-49dc-96d4-bf584f98ffbb admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:58.907346 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 360/718] 10.222.0.30 () {56 vars in 1156 bytes} [Fri Oct 15 03:26:58 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:58.913841 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2db02-53f2-438f-a1f4-c5ad73aba64d admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:58.930387 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2db02-53f2-438f-a1f4-c5ad73aba64d admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:58.939863 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9614f-ce67-4c9a-ad69-8eb9d46dc03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:58.940732 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9614f-ce67-4c9a-ad69-8eb9d46dc03e admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:58.941013 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9614f-ce67-4c9a-ad69-8eb9d46dc03e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:58.941287 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9614f-ce67-4c9a-ad69-8eb9d46dc03e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:58.961670 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9614f-ce67-4c9a-ad69-8eb9d46dc03e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:58.964135 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9614f-ce67-4c9a-ad69-8eb9d46dc03e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:58.988868 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-07d9614f-ce67-4c9a-ad69-8eb9d46dc03e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:26:58.996141 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 359/719] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:26:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:58.997377 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a506f-e8d4-49dc-96d4-bf584f98ffbb admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:59.026449 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a506f-e8d4-49dc-96d4-bf584f98ffbb admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:59.041279 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d5d0c-f95e-4d94-8636-82da8c8d3cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:59.042250 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d5d0c-f95e-4d94-8636-82da8c8d3cbf admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:59.042711 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d5d0c-f95e-4d94-8636-82da8c8d3cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:59.043161 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d5d0c-f95e-4d94-8636-82da8c8d3cbf admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:59.044129 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d5d0c-f95e-4d94-8636-82da8c8d3cbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:59.044610 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d5d0c-f95e-4d94-8636-82da8c8d3cbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:59.046396 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d5d0c-f95e-4d94-8636-82da8c8d3cbf admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:59.069295 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 361/720] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:26:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:59.076204 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9614f-ce67-4c9a-ad69-8eb9d46dc03e admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:59.088256 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9614f-ce67-4c9a-ad69-8eb9d46dc03e admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:59.100122 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e8209-938a-4976-8f21-11f2deb470a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:59.100979 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e8209-938a-4976-8f21-11f2deb470a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:59.101257 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e8209-938a-4976-8f21-11f2deb470a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:59.101527 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e8209-938a-4976-8f21-11f2deb470a5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:59.109630 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e8209-938a-4976-8f21-11f2deb470a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:59.115794 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e8209-938a-4976-8f21-11f2deb470a5 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:59.131219 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-8e9e8209-938a-4976-8f21-11f2deb470a5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:26:59.132769 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 360/721] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:59.139752 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d5d0c-f95e-4d94-8636-82da8c8d3cbf admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:59.150482 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d5d0c-f95e-4d94-8636-82da8c8d3cbf admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:59.154976 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fea988-6dff-4462-92da-757a95d41759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:59.155672 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fea988-6dff-4462-92da-757a95d41759 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:59.155974 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fea988-6dff-4462-92da-757a95d41759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:59.156247 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fea988-6dff-4462-92da-757a95d41759 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:59.157095 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fea988-6dff-4462-92da-757a95d41759 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:59.157399 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fea988-6dff-4462-92da-757a95d41759 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:59.159348 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fea988-6dff-4462-92da-757a95d41759 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:59.173004 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 362/722] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:26:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:59.179471 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e8209-938a-4976-8f21-11f2deb470a5 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:59.189552 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e8209-938a-4976-8f21-11f2deb470a5 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:59.194005 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3656a25-1966-4ab1-8ee7-7740cb48ff18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:59.194913 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3656a25-1966-4ab1-8ee7-7740cb48ff18 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:59.195193 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3656a25-1966-4ab1-8ee7-7740cb48ff18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:59.195463 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3656a25-1966-4ab1-8ee7-7740cb48ff18 admin admin] PATH_INFO: `/v3/projects/9f95c04b0a7b4a2d8fbb4b547f70dc20/users/dfdf0fb38dd04c75a1c874913ea1bf98/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:59.197486 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3656a25-1966-4ab1-8ee7-7740cb48ff18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user_id=dfdf0fb38dd04c75a1c874913ea1bf98, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:59.200135 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3656a25-1966-4ab1-8ee7-7740cb48ff18 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:59.215393 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 361/723] 10.222.0.30 () {58 vars in 1460 bytes} [Fri Oct 15 03:26:59 2021] PUT /identity/v3/projects/9f95c04b0a7b4a2d8fbb4b547f70dc20/users/dfdf0fb38dd04c75a1c874913ea1bf98/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:26:59.463214 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2fa0f-46ec-4c45-a596-8bf27514b58c None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:59.463400 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2fa0f-46ec-4c45-a596-8bf27514b58c None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:59.463729 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2fa0f-46ec-4c45-a596-8bf27514b58c None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:59.465763 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 363/724] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:26:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:26:59.471669 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517b495-53ad-4b87-b317-87a020ef358e None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:59.471997 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517b495-53ad-4b87-b317-87a020ef358e None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:59.472281 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517b495-53ad-4b87-b317-87a020ef358e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:59.492259 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-c517b495-53ad-4b87-b317-87a020ef358e None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:26:59.493509 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c517b495-53ad-4b87-b317-87a020ef358e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:26:59.553168 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 362/725] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:26:59 2021] POST /identity/v3/auth/tokens => generated 1456 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:26:59.577710 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2fa0f-46ec-4c45-a596-8bf27514b58c None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:59.590067 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2fa0f-46ec-4c45-a596-8bf27514b58c None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:59.594477 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fb9f4-3eb0-473c-b368-5bb524450382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:59.595251 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fb9f4-3eb0-473c-b368-5bb524450382 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:59.595535 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fb9f4-3eb0-473c-b368-5bb524450382 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:59.595843 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fb9f4-3eb0-473c-b368-5bb524450382 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:59.596506 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2fb9f4-3eb0-473c-b368-5bb524450382 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:59.598097 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2fb9f4-3eb0-473c-b368-5bb524450382 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:59.610187 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-ce2fb9f4-3eb0-473c-b368-5bb524450382 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 15 03:26:59.615792 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 364/726] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:26:59 2021] GET /identity/v3/services/network => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:26:59.619015 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517b495-53ad-4b87-b317-87a020ef358e None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:59.628192 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517b495-53ad-4b87-b317-87a020ef358e None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:59.632732 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd0758-d5fb-48de-963c-ec0938c27605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:59.633455 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd0758-d5fb-48de-963c-ec0938c27605 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:59.633741 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd0758-d5fb-48de-963c-ec0938c27605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:59.634016 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd0758-d5fb-48de-963c-ec0938c27605 admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:59.634736 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd0758-d5fb-48de-963c-ec0938c27605 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:59.635045 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd0758-d5fb-48de-963c-ec0938c27605 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:59.636745 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd0758-d5fb-48de-963c-ec0938c27605 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:59.646692 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 363/727] 10.222.0.30 () {56 vars in 1133 bytes} [Fri Oct 15 03:26:59 2021] GET /identity/v3/services?name=network => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:59.648065 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fb9f4-3eb0-473c-b368-5bb524450382 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:59.660995 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fb9f4-3eb0-473c-b368-5bb524450382 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:59.669119 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d02ec-c16e-4bfb-b9da-24e72bd87ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:59.669862 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d02ec-c16e-4bfb-b9da-24e72bd87ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:59.670149 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d02ec-c16e-4bfb-b9da-24e72bd87ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:59.670480 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d02ec-c16e-4bfb-b9da-24e72bd87ae3 admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:59.671287 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d02ec-c16e-4bfb-b9da-24e72bd87ae3 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:26:59.671647 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d02ec-c16e-4bfb-b9da-24e72bd87ae3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:59.673476 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d02ec-c16e-4bfb-b9da-24e72bd87ae3 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:59.681757 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 365/728] 10.222.0.30 () {56 vars in 1133 bytes} [Fri Oct 15 03:26:59 2021] GET /identity/v3/services?type=network => generated 350 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:26:59.688353 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd0758-d5fb-48de-963c-ec0938c27605 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:26:59.700506 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd0758-d5fb-48de-963c-ec0938c27605 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:26:59.705871 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae7c46-f61c-4c5c-822c-867bc39339d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:26:59.706567 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae7c46-f61c-4c5c-822c-867bc39339d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:26:59.706851 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae7c46-f61c-4c5c-822c-867bc39339d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:26:59.707181 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae7c46-f61c-4c5c-822c-867bc39339d6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:26:59.707979 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae7c46-f61c-4c5c-822c-867bc39339d6 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:26:59.709690 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae7c46-f61c-4c5c-822c-867bc39339d6 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:26:59.735921 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 364/729] 10.222.0.30 () {60 vars in 1165 bytes} [Fri Oct 15 03:26:59 2021] POST /identity/v3/endpoints => generated 327 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:27:00.829908 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf8d81-1618-45ee-b635-9c674e805d69 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:00.830611 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf8d81-1618-45ee-b635-9c674e805d69 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:00.830611 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf8d81-1618-45ee-b635-9c674e805d69 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:00.832495 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 366/730] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:00.838468 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0afd1-1d15-480b-ba95-984bf03f5295 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:00.839017 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0afd1-1d15-480b-ba95-984bf03f5295 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:00.839017 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0afd1-1d15-480b-ba95-984bf03f5295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:00.856711 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-76c0afd1-1d15-480b-ba95-984bf03f5295 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:00.857884 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-76c0afd1-1d15-480b-ba95-984bf03f5295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:00.878250 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 365/731] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:00 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:00.901187 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf8d81-1618-45ee-b635-9c674e805d69 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:00.913339 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf8d81-1618-45ee-b635-9c674e805d69 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:00.918187 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70800595-d0ec-4f24-b2e3-e1f29f7dfebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:00.918963 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70800595-d0ec-4f24-b2e3-e1f29f7dfebf admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:00.919237 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70800595-d0ec-4f24-b2e3-e1f29f7dfebf admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:00.919496 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70800595-d0ec-4f24-b2e3-e1f29f7dfebf admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:00.920284 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70800595-d0ec-4f24-b2e3-e1f29f7dfebf admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:00.922008 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70800595-d0ec-4f24-b2e3-e1f29f7dfebf admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:00.927703 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a134517-03e8-4120-8e37-f9750052c2ae None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:00.927984 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a134517-03e8-4120-8e37-f9750052c2ae None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:00.928262 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a134517-03e8-4120-8e37-f9750052c2ae None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:00.930840 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 366/732] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:27:00.933921 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-70800595-d0ec-4f24-b2e3-e1f29f7dfebf admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 15 03:27:00.935504 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 367/733] 10.222.0.30 () {56 vars in 1153 bytes} [Fri Oct 15 03:27:00 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:00.937602 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e8692-cf3b-4601-9f36-6b027b9f9291 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:00.937602 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e8692-cf3b-4601-9f36-6b027b9f9291 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:00.937602 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e8692-cf3b-4601-9f36-6b027b9f9291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:00.941495 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70800595-d0ec-4f24-b2e3-e1f29f7dfebf admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:00.950772 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70800595-d0ec-4f24-b2e3-e1f29f7dfebf admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:00.955405 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de63dcc-fb5e-4805-82dd-bb57e01c7024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:00.956073 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de63dcc-fb5e-4805-82dd-bb57e01c7024 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:00.956349 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de63dcc-fb5e-4805-82dd-bb57e01c7024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:00.956621 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de63dcc-fb5e-4805-82dd-bb57e01c7024 admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:00.957192 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-737e8692-cf3b-4601-9f36-6b027b9f9291 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:00.957306 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de63dcc-fb5e-4805-82dd-bb57e01c7024 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:00.957610 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de63dcc-fb5e-4805-82dd-bb57e01c7024 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:00.958896 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-737e8692-cf3b-4601-9f36-6b027b9f9291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:00.959174 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de63dcc-fb5e-4805-82dd-bb57e01c7024 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:00.964559 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 368/734] 10.222.0.30 () {56 vars in 1147 bytes} [Fri Oct 15 03:27:00 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:27:00.967639 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 367/735] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:00 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:27:00.976537 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de63dcc-fb5e-4805-82dd-bb57e01c7024 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:00.988563 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de63dcc-fb5e-4805-82dd-bb57e01c7024 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:00.993806 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e8692-cf3b-4601-9f36-6b027b9f9291 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:00.993923 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bcb03-1fa9-4fd2-9491-108498ae99d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:00.994419 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bcb03-1fa9-4fd2-9491-108498ae99d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:00.994694 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bcb03-1fa9-4fd2-9491-108498ae99d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:00.994962 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bcb03-1fa9-4fd2-9491-108498ae99d5 admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:00.995732 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bcb03-1fa9-4fd2-9491-108498ae99d5 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:00.996035 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bcb03-1fa9-4fd2-9491-108498ae99d5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:00.997574 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bcb03-1fa9-4fd2-9491-108498ae99d5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:01.003506 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 369/736] 10.222.0.30 () {56 vars in 1147 bytes} [Fri Oct 15 03:27:00 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:01.009503 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e8692-cf3b-4601-9f36-6b027b9f9291 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:01.014856 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7719c-25a8-466c-92d6-cbd469a3f66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:01.016068 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7719c-25a8-466c-92d6-cbd469a3f66d admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:01.016561 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7719c-25a8-466c-92d6-cbd469a3f66d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:01.017076 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7719c-25a8-466c-92d6-cbd469a3f66d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:01.029751 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7719c-25a8-466c-92d6-cbd469a3f66d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:27:01.037300 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-c8c7719c-25a8-466c-92d6-cbd469a3f66d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 03:27:01.039260 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 368/737] 10.222.0.30 () {56 vars in 1123 bytes} [Fri Oct 15 03:27:00 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:27:01.046701 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bcb03-1fa9-4fd2-9491-108498ae99d5 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:01.057641 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bcb03-1fa9-4fd2-9491-108498ae99d5 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:01.062930 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df53e5e-eb33-4fcd-af07-ea38ead15d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:01.064007 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df53e5e-eb33-4fcd-af07-ea38ead15d24 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:01.064493 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df53e5e-eb33-4fcd-af07-ea38ead15d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:01.064967 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df53e5e-eb33-4fcd-af07-ea38ead15d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:01.065979 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df53e5e-eb33-4fcd-af07-ea38ead15d24 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:01.066498 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df53e5e-eb33-4fcd-af07-ea38ead15d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:01.068419 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df53e5e-eb33-4fcd-af07-ea38ead15d24 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:01.078382 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 370/738] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Oct 15 03:27:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:01.085296 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7719c-25a8-466c-92d6-cbd469a3f66d admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:01.096361 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7719c-25a8-466c-92d6-cbd469a3f66d admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:01.101751 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95882f8-1e6b-419f-a0a9-110a14be739c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:01.102921 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95882f8-1e6b-419f-a0a9-110a14be739c admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:01.103409 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95882f8-1e6b-419f-a0a9-110a14be739c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:01.103924 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95882f8-1e6b-419f-a0a9-110a14be739c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:01.115812 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95882f8-1e6b-419f-a0a9-110a14be739c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:01.118204 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95882f8-1e6b-419f-a0a9-110a14be739c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:01.136881 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-a95882f8-1e6b-419f-a0a9-110a14be739c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:27:01.138844 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 369/739] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:01.145448 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df53e5e-eb33-4fcd-af07-ea38ead15d24 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:01.156614 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df53e5e-eb33-4fcd-af07-ea38ead15d24 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:01.161816 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34d81d-9ca0-42ab-9185-f9a99906f55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:01.162832 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34d81d-9ca0-42ab-9185-f9a99906f55f admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:01.163323 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34d81d-9ca0-42ab-9185-f9a99906f55f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:01.163865 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34d81d-9ca0-42ab-9185-f9a99906f55f admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:01.164907 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34d81d-9ca0-42ab-9185-f9a99906f55f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:01.165448 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34d81d-9ca0-42ab-9185-f9a99906f55f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:01.167294 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34d81d-9ca0-42ab-9185-f9a99906f55f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:01.180582 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 371/740] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:27:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:01.187284 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95882f8-1e6b-419f-a0a9-110a14be739c admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:01.198312 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95882f8-1e6b-419f-a0a9-110a14be739c admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:01.203363 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d4708-8ef6-4215-b91e-4cc65d2abc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:01.204496 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d4708-8ef6-4215-b91e-4cc65d2abc6e admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:01.205010 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d4708-8ef6-4215-b91e-4cc65d2abc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:01.205504 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d4708-8ef6-4215-b91e-4cc65d2abc6e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:01.215782 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d4708-8ef6-4215-b91e-4cc65d2abc6e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:01.218154 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d4708-8ef6-4215-b91e-4cc65d2abc6e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:01.234685 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-c93d4708-8ef6-4215-b91e-4cc65d2abc6e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 15 03:27:01.239424 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 370/741] 10.222.0.30 () {56 vars in 1138 bytes} [Fri Oct 15 03:27:01 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:01.244063 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34d81d-9ca0-42ab-9185-f9a99906f55f admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:01.254931 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34d81d-9ca0-42ab-9185-f9a99906f55f admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:01.261396 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f12cd-1dfc-445b-bd35-bf6a9e77d079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:01.262051 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f12cd-1dfc-445b-bd35-bf6a9e77d079 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:01.262327 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f12cd-1dfc-445b-bd35-bf6a9e77d079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:01.262601 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f12cd-1dfc-445b-bd35-bf6a9e77d079 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:01.263444 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f12cd-1dfc-445b-bd35-bf6a9e77d079 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:01.263780 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f12cd-1dfc-445b-bd35-bf6a9e77d079 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:01.265617 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f12cd-1dfc-445b-bd35-bf6a9e77d079 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:01.283848 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 372/742] 10.222.0.30 () {56 vars in 1170 bytes} [Fri Oct 15 03:27:01 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:01.290103 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d4708-8ef6-4215-b91e-4cc65d2abc6e admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:01.304760 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d4708-8ef6-4215-b91e-4cc65d2abc6e admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:01.310172 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effadc1-a4c7-4f2b-b48f-f71c64d44836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:01.310954 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effadc1-a4c7-4f2b-b48f-f71c64d44836 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:01.311316 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effadc1-a4c7-4f2b-b48f-f71c64d44836 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:01.311731 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effadc1-a4c7-4f2b-b48f-f71c64d44836 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:01.321446 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effadc1-a4c7-4f2b-b48f-f71c64d44836 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:01.323222 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effadc1-a4c7-4f2b-b48f-f71c64d44836 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:01.333063 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 371/743] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:27:01 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:27:01.339349 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f12cd-1dfc-445b-bd35-bf6a9e77d079 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:01.349657 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f12cd-1dfc-445b-bd35-bf6a9e77d079 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:01.354386 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a0e63-f677-402b-b2ec-78f71d14fd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:01.355205 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a0e63-f677-402b-b2ec-78f71d14fd0f admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:01.355575 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a0e63-f677-402b-b2ec-78f71d14fd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:01.355892 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a0e63-f677-402b-b2ec-78f71d14fd0f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:01.366725 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a0e63-f677-402b-b2ec-78f71d14fd0f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:01.369202 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a0e63-f677-402b-b2ec-78f71d14fd0f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:01.387346 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-1e1a0e63-f677-402b-b2ec-78f71d14fd0f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:27:01.388949 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 373/744] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:01.395198 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effadc1-a4c7-4f2b-b48f-f71c64d44836 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:01.404877 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effadc1-a4c7-4f2b-b48f-f71c64d44836 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:01.409515 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31c874-202e-4a31-b6c8-8966b226f88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:01.410164 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31c874-202e-4a31-b6c8-8966b226f88e admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:01.410449 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31c874-202e-4a31-b6c8-8966b226f88e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:01.410729 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31c874-202e-4a31-b6c8-8966b226f88e admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:01.411463 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31c874-202e-4a31-b6c8-8966b226f88e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:01.411792 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31c874-202e-4a31-b6c8-8966b226f88e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:01.413392 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31c874-202e-4a31-b6c8-8966b226f88e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:01.426971 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 372/745] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:27:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:01.433258 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a0e63-f677-402b-b2ec-78f71d14fd0f admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:01.443339 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a0e63-f677-402b-b2ec-78f71d14fd0f admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:01.448083 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fde31-1515-4c3f-8bf7-d714b7bc8918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:01.448926 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fde31-1515-4c3f-8bf7-d714b7bc8918 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:01.449209 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fde31-1515-4c3f-8bf7-d714b7bc8918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:01.449488 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fde31-1515-4c3f-8bf7-d714b7bc8918 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:01.456962 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9fde31-1515-4c3f-8bf7-d714b7bc8918 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:01.458991 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9fde31-1515-4c3f-8bf7-d714b7bc8918 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:01.472679 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-6f9fde31-1515-4c3f-8bf7-d714b7bc8918 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:27:01.474397 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 374/746] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:27:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:01.481427 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31c874-202e-4a31-b6c8-8966b226f88e admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:01.491494 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31c874-202e-4a31-b6c8-8966b226f88e admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:01.496234 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff70fc5-3fb1-4f93-bf44-55a9050cb8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:01.496935 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff70fc5-3fb1-4f93-bf44-55a9050cb8af admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:01.497220 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff70fc5-3fb1-4f93-bf44-55a9050cb8af admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:01.497550 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff70fc5-3fb1-4f93-bf44-55a9050cb8af admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:01.498353 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff70fc5-3fb1-4f93-bf44-55a9050cb8af admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:01.498700 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff70fc5-3fb1-4f93-bf44-55a9050cb8af admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:01.500666 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff70fc5-3fb1-4f93-bf44-55a9050cb8af admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:01.513151 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 373/747] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:27:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:01.519630 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fde31-1515-4c3f-8bf7-d714b7bc8918 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:01.530954 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fde31-1515-4c3f-8bf7-d714b7bc8918 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:01.535555 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46493a8-58af-4e02-9352-bdadab8b60ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:01.536288 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46493a8-58af-4e02-9352-bdadab8b60ef admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:01.536570 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46493a8-58af-4e02-9352-bdadab8b60ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:01.536901 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46493a8-58af-4e02-9352-bdadab8b60ef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:01.537744 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46493a8-58af-4e02-9352-bdadab8b60ef admin admin] RBAC: Adding query filter params (role.id=04a530eb7b7e46d4a07b4c3b02cee3aa, scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user.id=3f598b94a850413494da575188706cb1) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:01.538108 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46493a8-58af-4e02-9352-bdadab8b60ef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:01.540691 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46493a8-58af-4e02-9352-bdadab8b60ef admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:01.547164 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 375/748] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:27:01 2021] GET /identity/v3/role_assignments?user.id=3f598b94a850413494da575188706cb1&scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20&role.id=04a530eb7b7e46d4a07b4c3b02cee3aa => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:01.788633 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7cb38-fdac-4597-a68f-edb98d22a12e None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:01.789994 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7cb38-fdac-4597-a68f-edb98d22a12e None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:01.790504 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7cb38-fdac-4597-a68f-edb98d22a12e None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:01.792747 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 374/749] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:01 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:01.799235 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdaafb4-e816-44bb-99c1-3a8151792f7a None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:01.799527 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdaafb4-e816-44bb-99c1-3a8151792f7a None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:01.799880 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdaafb4-e816-44bb-99c1-3a8151792f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:01.819911 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-9cdaafb4-e816-44bb-99c1-3a8151792f7a None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:01.821141 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-9cdaafb4-e816-44bb-99c1-3a8151792f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:01.829554 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 376/750] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:01 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:01.852897 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7cb38-fdac-4597-a68f-edb98d22a12e None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:01.866386 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7cb38-fdac-4597-a68f-edb98d22a12e None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:01.871489 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed991c6-8093-4c30-b02e-fecf69094926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:01.872451 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed991c6-8093-4c30-b02e-fecf69094926 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:01.872872 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed991c6-8093-4c30-b02e-fecf69094926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:01.873284 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed991c6-8093-4c30-b02e-fecf69094926 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:01.874110 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed991c6-8093-4c30-b02e-fecf69094926 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:01.875924 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed991c6-8093-4c30-b02e-fecf69094926 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:01.887288 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-7ed991c6-8093-4c30-b02e-fecf69094926 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 15 03:27:01.889115 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 375/751] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Oct 15 03:27:01 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:01.895436 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424a15a-b3e3-4df1-960b-4e36ee7153f9 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:01.895941 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424a15a-b3e3-4df1-960b-4e36ee7153f9 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:01.896046 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424a15a-b3e3-4df1-960b-4e36ee7153f9 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:01.896569 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed991c6-8093-4c30-b02e-fecf69094926 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:01.898059 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 377/752] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:01.903943 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c2ddb-76b6-4a81-98a3-0a95a48c5df7 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:01.904232 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c2ddb-76b6-4a81-98a3-0a95a48c5df7 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:01.904511 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c2ddb-76b6-4a81-98a3-0a95a48c5df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:01.907379 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed991c6-8093-4c30-b02e-fecf69094926 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:01.913223 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4707a-abb4-4bcd-9251-571e4e55bb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:01.914045 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4707a-abb4-4bcd-9251-571e4e55bb02 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:01.915030 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4707a-abb4-4bcd-9251-571e4e55bb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:01.915445 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4707a-abb4-4bcd-9251-571e4e55bb02 admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:01.916316 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4707a-abb4-4bcd-9251-571e4e55bb02 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:01.916756 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4707a-abb4-4bcd-9251-571e4e55bb02 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:01.918633 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4707a-abb4-4bcd-9251-571e4e55bb02 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:01.925767 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 376/753] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Oct 15 03:27:01 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:27:01.928818 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-fc4c2ddb-76b6-4a81-98a3-0a95a48c5df7 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:01.930932 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-fc4c2ddb-76b6-4a81-98a3-0a95a48c5df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:01.933421 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4707a-abb4-4bcd-9251-571e4e55bb02 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:01.943571 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 378/754] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:01 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:27:01.949199 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4707a-abb4-4bcd-9251-571e4e55bb02 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:01.953902 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db7992-36bc-4ba9-b154-e59c14de031a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:01.954709 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db7992-36bc-4ba9-b154-e59c14de031a admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:01.955135 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db7992-36bc-4ba9-b154-e59c14de031a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:01.955576 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db7992-36bc-4ba9-b154-e59c14de031a admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:01.956475 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db7992-36bc-4ba9-b154-e59c14de031a admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:01.956922 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db7992-36bc-4ba9-b154-e59c14de031a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:01.958651 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db7992-36bc-4ba9-b154-e59c14de031a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:01.964548 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 377/755] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Oct 15 03:27:01 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:27:01.974411 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c2ddb-76b6-4a81-98a3-0a95a48c5df7 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:01.984363 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c2ddb-76b6-4a81-98a3-0a95a48c5df7 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:01.989655 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8f2cd-aad7-417e-a90f-f27812ccc944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:01.990721 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8f2cd-aad7-417e-a90f-f27812ccc944 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:01.991149 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8f2cd-aad7-417e-a90f-f27812ccc944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:01.991567 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8f2cd-aad7-417e-a90f-f27812ccc944 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:02.006685 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8f2cd-aad7-417e-a90f-f27812ccc944 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:27:02.015515 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-51d8f2cd-aad7-417e-a90f-f27812ccc944 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:27:02.017753 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 379/756] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:27:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:02.024722 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db7992-36bc-4ba9-b154-e59c14de031a admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:02.035379 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db7992-36bc-4ba9-b154-e59c14de031a admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:02.040541 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e8a3f-f177-4055-8407-4ce9f411f1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:02.041448 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e8a3f-f177-4055-8407-4ce9f411f1dc admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:02.041875 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e8a3f-f177-4055-8407-4ce9f411f1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:02.042291 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e8a3f-f177-4055-8407-4ce9f411f1dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:02.043202 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e8a3f-f177-4055-8407-4ce9f411f1dc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:02.043715 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e8a3f-f177-4055-8407-4ce9f411f1dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:02.045520 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e8a3f-f177-4055-8407-4ce9f411f1dc admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:02.056685 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 378/757] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:27:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:02.063230 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8f2cd-aad7-417e-a90f-f27812ccc944 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:02.074035 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8f2cd-aad7-417e-a90f-f27812ccc944 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:02.078900 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30708179-84b2-44a4-85e7-f40dd76dce6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:02.079910 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30708179-84b2-44a4-85e7-f40dd76dce6c admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:02.080339 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30708179-84b2-44a4-85e7-f40dd76dce6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:02.080756 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30708179-84b2-44a4-85e7-f40dd76dce6c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:02.092560 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30708179-84b2-44a4-85e7-f40dd76dce6c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:02.094776 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30708179-84b2-44a4-85e7-f40dd76dce6c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:02.113026 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-30708179-84b2-44a4-85e7-f40dd76dce6c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:27:02.114834 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 380/758] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:02.122002 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e8a3f-f177-4055-8407-4ce9f411f1dc admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:02.132526 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e8a3f-f177-4055-8407-4ce9f411f1dc admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:02.138114 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89364e-1054-4c71-bded-276d8676a8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:02.138992 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89364e-1054-4c71-bded-276d8676a8cc admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:02.139420 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89364e-1054-4c71-bded-276d8676a8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:02.139896 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89364e-1054-4c71-bded-276d8676a8cc admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:02.140807 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89364e-1054-4c71-bded-276d8676a8cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:02.141263 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89364e-1054-4c71-bded-276d8676a8cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:02.143035 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89364e-1054-4c71-bded-276d8676a8cc admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:02.156030 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 379/759] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:27:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:27:02.162556 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30708179-84b2-44a4-85e7-f40dd76dce6c admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:02.172757 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30708179-84b2-44a4-85e7-f40dd76dce6c admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:02.177600 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928dd4b-ac13-4315-a0ef-826406a9676e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:02.178550 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928dd4b-ac13-4315-a0ef-826406a9676e admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:02.178987 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928dd4b-ac13-4315-a0ef-826406a9676e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:02.179261 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928dd4b-ac13-4315-a0ef-826406a9676e admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:02.188046 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928dd4b-ac13-4315-a0ef-826406a9676e admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:02.190066 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928dd4b-ac13-4315-a0ef-826406a9676e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:02.204539 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-a928dd4b-ac13-4315-a0ef-826406a9676e admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 15 03:27:02.206015 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 381/760] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:27:02 2021] GET /identity/v3/users/swift => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:02.212977 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89364e-1054-4c71-bded-276d8676a8cc admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:02.223765 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89364e-1054-4c71-bded-276d8676a8cc admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:02.228557 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8fb11-9337-4fa6-a3a4-54270874e837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:02.229269 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8fb11-9337-4fa6-a3a4-54270874e837 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:02.229551 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8fb11-9337-4fa6-a3a4-54270874e837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:02.229827 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8fb11-9337-4fa6-a3a4-54270874e837 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:02.230730 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8fb11-9337-4fa6-a3a4-54270874e837 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:02.231090 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8fb11-9337-4fa6-a3a4-54270874e837 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:02.233036 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8fb11-9337-4fa6-a3a4-54270874e837 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:02.252284 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 380/761] 10.222.0.30 () {56 vars in 1156 bytes} [Fri Oct 15 03:27:02 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:02.259192 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928dd4b-ac13-4315-a0ef-826406a9676e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:02.269078 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928dd4b-ac13-4315-a0ef-826406a9676e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:02.273590 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425751dc-4aa6-4624-a5e0-6b60945a75e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:02.274780 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425751dc-4aa6-4624-a5e0-6b60945a75e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:02.275064 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425751dc-4aa6-4624-a5e0-6b60945a75e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:02.275342 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425751dc-4aa6-4624-a5e0-6b60945a75e7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:02.284228 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425751dc-4aa6-4624-a5e0-6b60945a75e7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:02.286110 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425751dc-4aa6-4624-a5e0-6b60945a75e7 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:02.302441 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 382/762] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:27:02 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:27:02.303888 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8fb11-9337-4fa6-a3a4-54270874e837 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:02.314645 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8fb11-9337-4fa6-a3a4-54270874e837 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:02.319393 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f09bf7-b53a-4877-a812-8607caed112a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:02.320307 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f09bf7-b53a-4877-a812-8607caed112a admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:02.321255 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f09bf7-b53a-4877-a812-8607caed112a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:02.321633 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f09bf7-b53a-4877-a812-8607caed112a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:02.334544 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f09bf7-b53a-4877-a812-8607caed112a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:02.338108 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f09bf7-b53a-4877-a812-8607caed112a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:02.357649 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-25f09bf7-b53a-4877-a812-8607caed112a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:27:02.363784 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 381/763] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:02.365631 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425751dc-4aa6-4624-a5e0-6b60945a75e7 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:02.375245 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425751dc-4aa6-4624-a5e0-6b60945a75e7 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:02.379882 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60f509-5066-4e37-af1e-437e86993647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:02.380531 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60f509-5066-4e37-af1e-437e86993647 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:02.380821 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60f509-5066-4e37-af1e-437e86993647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:02.381097 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60f509-5066-4e37-af1e-437e86993647 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:02.381834 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60f509-5066-4e37-af1e-437e86993647 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:02.382138 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60f509-5066-4e37-af1e-437e86993647 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:02.384427 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60f509-5066-4e37-af1e-437e86993647 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:02.403497 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 383/764] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:27:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:02.404902 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f09bf7-b53a-4877-a812-8607caed112a admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:02.415634 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f09bf7-b53a-4877-a812-8607caed112a admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:02.420415 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0add0d-c035-4daa-8c50-8d333c38df9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:02.421282 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0add0d-c035-4daa-8c50-8d333c38df9f admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:02.421628 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0add0d-c035-4daa-8c50-8d333c38df9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:02.421910 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0add0d-c035-4daa-8c50-8d333c38df9f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:02.429363 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0add0d-c035-4daa-8c50-8d333c38df9f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:02.432028 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0add0d-c035-4daa-8c50-8d333c38df9f admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:02.445446 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-0e0add0d-c035-4daa-8c50-8d333c38df9f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:27:02.451845 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 382/765] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:27:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:02.453522 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60f509-5066-4e37-af1e-437e86993647 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:02.463371 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60f509-5066-4e37-af1e-437e86993647 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:02.468075 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb276a-b10b-4689-b071-99a077bff8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:02.468767 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb276a-b10b-4689-b071-99a077bff8ca admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:02.469110 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb276a-b10b-4689-b071-99a077bff8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:02.469392 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb276a-b10b-4689-b071-99a077bff8ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:02.470237 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb276a-b10b-4689-b071-99a077bff8ca admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:02.470548 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb276a-b10b-4689-b071-99a077bff8ca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:02.472489 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb276a-b10b-4689-b071-99a077bff8ca admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:02.491046 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 384/766] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:27:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:02.492396 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0add0d-c035-4daa-8c50-8d333c38df9f admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:02.503731 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0add0d-c035-4daa-8c50-8d333c38df9f admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:02.508429 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295b98d-37f3-4478-be71-3a1a470cc388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:02.509283 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295b98d-37f3-4478-be71-3a1a470cc388 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:02.509790 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295b98d-37f3-4478-be71-3a1a470cc388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:02.510277 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295b98d-37f3-4478-be71-3a1a470cc388 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:02.511296 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295b98d-37f3-4478-be71-3a1a470cc388 admin admin] RBAC: Adding query filter params (role.id=15ba70b0cba04962a6d0b80b50c07004, scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user.id=dfdf0fb38dd04c75a1c874913ea1bf98) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:02.511824 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295b98d-37f3-4478-be71-3a1a470cc388 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:02.513854 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295b98d-37f3-4478-be71-3a1a470cc388 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:02.520222 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 383/767] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:27:02 2021] GET /identity/v3/role_assignments?user.id=dfdf0fb38dd04c75a1c874913ea1bf98&scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20&role.id=15ba70b0cba04962a6d0b80b50c07004 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:03.402214 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedd3f7-5ae5-4a0e-8696-03c37b782174 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:03.403220 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedd3f7-5ae5-4a0e-8696-03c37b782174 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:03.403718 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedd3f7-5ae5-4a0e-8696-03c37b782174 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:03.405921 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 385/768] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:03.412179 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f481b4-20ca-4037-978a-90e5fd0052e5 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:03.412968 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f481b4-20ca-4037-978a-90e5fd0052e5 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:03.413439 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f481b4-20ca-4037-978a-90e5fd0052e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:03.432637 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-60f481b4-20ca-4037-978a-90e5fd0052e5 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:03.433831 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-60f481b4-20ca-4037-978a-90e5fd0052e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:03.441940 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 384/769] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:03 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:27:03.464979 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedd3f7-5ae5-4a0e-8696-03c37b782174 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:03.478601 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedd3f7-5ae5-4a0e-8696-03c37b782174 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:03.482689 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e7b6c-951f-4814-aff0-505464e98850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:03.483340 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e7b6c-951f-4814-aff0-505464e98850 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:03.483618 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e7b6c-951f-4814-aff0-505464e98850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:03.483959 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e7b6c-951f-4814-aff0-505464e98850 admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:03.484693 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e7b6c-951f-4814-aff0-505464e98850 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:03.486274 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e7b6c-951f-4814-aff0-505464e98850 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:03.503521 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 386/770] 10.222.0.30 () {60 vars in 1162 bytes} [Fri Oct 15 03:27:03 2021] POST /identity/v3/services => generated 269 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:27:03.993112 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244e829-80f8-4142-982c-b31811b21acc None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:03.993464 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244e829-80f8-4142-982c-b31811b21acc None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:03.993666 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244e829-80f8-4142-982c-b31811b21acc None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:03.995740 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 385/771] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:04.001515 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8990f0-60ef-4089-b335-698c62aa9e01 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:04.001805 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8990f0-60ef-4089-b335-698c62aa9e01 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:04.002085 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8990f0-60ef-4089-b335-698c62aa9e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:04.021044 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-ff8990f0-60ef-4089-b335-698c62aa9e01 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:04.022540 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-ff8990f0-60ef-4089-b335-698c62aa9e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:04.041033 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 387/772] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:04 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:04.064861 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244e829-80f8-4142-982c-b31811b21acc None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:04.077591 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244e829-80f8-4142-982c-b31811b21acc None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:04.081998 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53c8f7-4feb-42d0-a28f-45e239c2c635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:04.082782 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53c8f7-4feb-42d0-a28f-45e239c2c635 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:04.083065 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53c8f7-4feb-42d0-a28f-45e239c2c635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:04.083340 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53c8f7-4feb-42d0-a28f-45e239c2c635 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:04.094181 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53c8f7-4feb-42d0-a28f-45e239c2c635 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:27:04.101705 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-7f53c8f7-4feb-42d0-a28f-45e239c2c635 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 15 03:27:04.103235 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 386/773] 10.222.0.30 () {56 vars in 1141 bytes} [Fri Oct 15 03:27:04 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:04.109255 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8990f0-60ef-4089-b335-698c62aa9e01 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:04.118114 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8990f0-60ef-4089-b335-698c62aa9e01 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:04.122602 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3d3f4-6c76-45a4-888a-c9220c3153f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:04.123252 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3d3f4-6c76-45a4-888a-c9220c3153f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:04.123534 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3d3f4-6c76-45a4-888a-c9220c3153f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:04.123862 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3d3f4-6c76-45a4-888a-c9220c3153f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:04.124621 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe3d3f4-6c76-45a4-888a-c9220c3153f7 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:04.124927 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe3d3f4-6c76-45a4-888a-c9220c3153f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:04.126526 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe3d3f4-6c76-45a4-888a-c9220c3153f7 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:04.135413 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 388/774] 10.222.0.30 () {56 vars in 1136 bytes} [Fri Oct 15 03:27:04 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:04.141678 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53c8f7-4feb-42d0-a28f-45e239c2c635 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:04.151952 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53c8f7-4feb-42d0-a28f-45e239c2c635 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:04.156516 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb20670-77d7-4843-93b4-9a100584fd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:04.157282 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb20670-77d7-4843-93b4-9a100584fd91 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:04.157564 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb20670-77d7-4843-93b4-9a100584fd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:04.157842 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb20670-77d7-4843-93b4-9a100584fd91 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:04.168897 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb20670-77d7-4843-93b4-9a100584fd91 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:04.170771 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb20670-77d7-4843-93b4-9a100584fd91 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:04.188808 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-5eb20670-77d7-4843-93b4-9a100584fd91 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:27:04.190467 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 387/775] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:04.197307 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3d3f4-6c76-45a4-888a-c9220c3153f7 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:04.207901 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3d3f4-6c76-45a4-888a-c9220c3153f7 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:04.213524 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528c21c-b4c5-4532-9542-0674b5c5a245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:04.214404 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528c21c-b4c5-4532-9542-0674b5c5a245 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:04.214886 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528c21c-b4c5-4532-9542-0674b5c5a245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:04.215357 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528c21c-b4c5-4532-9542-0674b5c5a245 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:04.216360 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528c21c-b4c5-4532-9542-0674b5c5a245 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:04.216862 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528c21c-b4c5-4532-9542-0674b5c5a245 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:04.218720 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528c21c-b4c5-4532-9542-0674b5c5a245 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:04.234997 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 389/776] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:27:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:04.244555 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb20670-77d7-4843-93b4-9a100584fd91 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:04.257273 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb20670-77d7-4843-93b4-9a100584fd91 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:04.264053 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747e10b-559b-4677-a65f-00a92b4a03b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:04.265096 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747e10b-559b-4677-a65f-00a92b4a03b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:04.265600 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747e10b-559b-4677-a65f-00a92b4a03b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:04.266079 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747e10b-559b-4677-a65f-00a92b4a03b8 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:04.274948 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747e10b-559b-4677-a65f-00a92b4a03b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:04.277294 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747e10b-559b-4677-a65f-00a92b4a03b8 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:04.291801 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-9747e10b-559b-4677-a65f-00a92b4a03b8 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 15 03:27:04.293532 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 388/777] 10.222.0.30 () {56 vars in 1138 bytes} [Fri Oct 15 03:27:04 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:04.300087 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528c21c-b4c5-4532-9542-0674b5c5a245 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:04.310718 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528c21c-b4c5-4532-9542-0674b5c5a245 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:04.315572 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3c631-0d0e-4e14-81e1-244a434005bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:04.316459 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3c631-0d0e-4e14-81e1-244a434005bd admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:04.316886 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3c631-0d0e-4e14-81e1-244a434005bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:04.317330 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3c631-0d0e-4e14-81e1-244a434005bd admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:04.318320 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3c631-0d0e-4e14-81e1-244a434005bd admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:04.318768 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3c631-0d0e-4e14-81e1-244a434005bd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:04.321432 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3c631-0d0e-4e14-81e1-244a434005bd admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:04.331718 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a8d9b-8a4e-426b-b268-355541f41e2e None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:04.332011 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a8d9b-8a4e-426b-b268-355541f41e2e None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:04.332284 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a8d9b-8a4e-426b-b268-355541f41e2e None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:04.334292 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 389/778] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:27:04.340252 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8533c7b-c725-4723-a4a7-ba388101a511 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:04.340654 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8533c7b-c725-4723-a4a7-ba388101a511 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:04.341054 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8533c7b-c725-4723-a4a7-ba388101a511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:04.344165 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 390/779] 10.222.0.30 () {56 vars in 1170 bytes} [Fri Oct 15 03:27:04 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:04.350579 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3c631-0d0e-4e14-81e1-244a434005bd admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:04.360111 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3c631-0d0e-4e14-81e1-244a434005bd admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:04.360308 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-e8533c7b-c725-4723-a4a7-ba388101a511 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:04.361703 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e8533c7b-c725-4723-a4a7-ba388101a511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:04.365346 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55ffe4-4061-4ee7-823c-1818ec3b73b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:04.366240 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55ffe4-4061-4ee7-823c-1818ec3b73b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:04.366776 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55ffe4-4061-4ee7-823c-1818ec3b73b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:04.367194 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55ffe4-4061-4ee7-823c-1818ec3b73b1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:04.376242 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55ffe4-4061-4ee7-823c-1818ec3b73b1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:04.378259 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55ffe4-4061-4ee7-823c-1818ec3b73b1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:04.379810 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 390/780] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:04 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:27:04.388426 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 391/781] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:27:04 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:27:04.394861 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8533c7b-c725-4723-a4a7-ba388101a511 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:04.401185 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55ffe4-4061-4ee7-823c-1818ec3b73b1 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:04.405254 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8533c7b-c725-4723-a4a7-ba388101a511 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:04.409968 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945bddd-0754-41e2-a665-9e8f1a577976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:04.410889 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945bddd-0754-41e2-a665-9e8f1a577976 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:04.411278 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945bddd-0754-41e2-a665-9e8f1a577976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:04.411617 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945bddd-0754-41e2-a665-9e8f1a577976 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:04.412191 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55ffe4-4061-4ee7-823c-1818ec3b73b1 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:04.417358 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959da59f-b3fb-4f8c-a8cf-f51119bc8848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:04.418185 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959da59f-b3fb-4f8c-a8cf-f51119bc8848 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:04.418611 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959da59f-b3fb-4f8c-a8cf-f51119bc8848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:04.419041 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959da59f-b3fb-4f8c-a8cf-f51119bc8848 admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:04.419950 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959da59f-b3fb-4f8c-a8cf-f51119bc8848 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:04.421678 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959da59f-b3fb-4f8c-a8cf-f51119bc8848 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:04.424443 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6945bddd-0754-41e2-a665-9e8f1a577976 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:04.426455 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6945bddd-0754-41e2-a665-9e8f1a577976 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:04.443752 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 392/782] 10.222.0.30 () {60 vars in 1162 bytes} [Fri Oct 15 03:27:04 2021] POST /identity/v3/services => generated 251 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:27:04.445292 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-6945bddd-0754-41e2-a665-9e8f1a577976 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:27:04.447519 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 391/783] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:04.454218 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959da59f-b3fb-4f8c-a8cf-f51119bc8848 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:04.478396 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959da59f-b3fb-4f8c-a8cf-f51119bc8848 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:04.483636 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e166b39-27cd-4014-9088-76d666c8c7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:04.484722 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e166b39-27cd-4014-9088-76d666c8c7dd admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:04.485241 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e166b39-27cd-4014-9088-76d666c8c7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:04.485712 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e166b39-27cd-4014-9088-76d666c8c7dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:04.486662 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e166b39-27cd-4014-9088-76d666c8c7dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:04.487298 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e166b39-27cd-4014-9088-76d666c8c7dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:04.489352 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e166b39-27cd-4014-9088-76d666c8c7dd admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:04.504170 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 393/784] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:27:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:04.512831 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945bddd-0754-41e2-a665-9e8f1a577976 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:04.524212 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945bddd-0754-41e2-a665-9e8f1a577976 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:04.529511 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a36d8-7083-4ff5-a17d-55fbab7839df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:04.530640 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a36d8-7083-4ff5-a17d-55fbab7839df admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:04.531142 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a36d8-7083-4ff5-a17d-55fbab7839df admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:04.531607 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a36d8-7083-4ff5-a17d-55fbab7839df admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:04.540501 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a36d8-7083-4ff5-a17d-55fbab7839df admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:04.542965 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a36d8-7083-4ff5-a17d-55fbab7839df admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:04.557313 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-d98a36d8-7083-4ff5-a17d-55fbab7839df admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:27:04.559276 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 392/785] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:27:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:04.566201 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e166b39-27cd-4014-9088-76d666c8c7dd admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:04.576967 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e166b39-27cd-4014-9088-76d666c8c7dd admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:04.582092 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7cfb2-3ef4-4ee7-8b21-706d1d999f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:04.583117 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7cfb2-3ef4-4ee7-8b21-706d1d999f6d admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:04.583600 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7cfb2-3ef4-4ee7-8b21-706d1d999f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:04.584103 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7cfb2-3ef4-4ee7-8b21-706d1d999f6d admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:04.585117 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7cfb2-3ef4-4ee7-8b21-706d1d999f6d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:04.585650 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7cfb2-3ef4-4ee7-8b21-706d1d999f6d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:04.588333 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7cfb2-3ef4-4ee7-8b21-706d1d999f6d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:04.603591 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 394/786] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:27:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:04.613093 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a36d8-7083-4ff5-a17d-55fbab7839df admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:04.625669 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a36d8-7083-4ff5-a17d-55fbab7839df admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:04.630968 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10558b26-d4a0-4e93-a2fe-b1b76a6c086e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:04.632026 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10558b26-d4a0-4e93-a2fe-b1b76a6c086e admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:04.632565 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10558b26-d4a0-4e93-a2fe-b1b76a6c086e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:04.633584 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10558b26-d4a0-4e93-a2fe-b1b76a6c086e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:04.634726 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10558b26-d4a0-4e93-a2fe-b1b76a6c086e admin admin] RBAC: Adding query filter params (role.id=9ac52cb6a0744b1797edbae9fd88349b, scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user.id=3f598b94a850413494da575188706cb1) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:04.635297 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10558b26-d4a0-4e93-a2fe-b1b76a6c086e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:04.637495 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10558b26-d4a0-4e93-a2fe-b1b76a6c086e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:04.649483 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 393/787] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:27:04 2021] GET /identity/v3/role_assignments?user.id=3f598b94a850413494da575188706cb1&scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20&role.id=9ac52cb6a0744b1797edbae9fd88349b => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:04.878374 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858a2e9-e81a-4c13-a42c-874db7627b24 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:04.878561 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858a2e9-e81a-4c13-a42c-874db7627b24 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:04.878843 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858a2e9-e81a-4c13-a42c-874db7627b24 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:04.880803 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 395/788] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:04.887093 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8981be9-57b4-417b-9d7e-a9f227748bcb None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:04.887623 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8981be9-57b4-417b-9d7e-a9f227748bcb None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:04.888126 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8981be9-57b4-417b-9d7e-a9f227748bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:04.906871 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-a8981be9-57b4-417b-9d7e-a9f227748bcb None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:04.908090 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-a8981be9-57b4-417b-9d7e-a9f227748bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:04.916672 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 394/789] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:04 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:27:04.939970 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858a2e9-e81a-4c13-a42c-874db7627b24 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:04.952443 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858a2e9-e81a-4c13-a42c-874db7627b24 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:04.957059 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cdea0-aebd-4d47-a9ee-189e6d6abcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:04.958061 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cdea0-aebd-4d47-a9ee-189e6d6abcb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:04.958533 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cdea0-aebd-4d47-a9ee-189e6d6abcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:04.959010 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cdea0-aebd-4d47-a9ee-189e6d6abcb7 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:04.959914 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cdea0-aebd-4d47-a9ee-189e6d6abcb7 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:04.961735 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cdea0-aebd-4d47-a9ee-189e6d6abcb7 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:04.973634 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-f86cdea0-aebd-4d47-a9ee-189e6d6abcb7 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 15 03:27:04.975327 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 396/790] 10.222.0.30 () {56 vars in 1147 bytes} [Fri Oct 15 03:27:04 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:04.982851 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8981be9-57b4-417b-9d7e-a9f227748bcb None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:04.991925 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8981be9-57b4-417b-9d7e-a9f227748bcb None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:04.997251 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b364119-6ea6-4240-aa32-297a7fa05bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:04.998123 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b364119-6ea6-4240-aa32-297a7fa05bdb admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:04.998597 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b364119-6ea6-4240-aa32-297a7fa05bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:04.999059 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b364119-6ea6-4240-aa32-297a7fa05bdb admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:05.000015 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b364119-6ea6-4240-aa32-297a7fa05bdb admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:05.000671 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b364119-6ea6-4240-aa32-297a7fa05bdb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:05.002444 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b364119-6ea6-4240-aa32-297a7fa05bdb admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:05.007435 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 395/791] 10.222.0.30 () {56 vars in 1143 bytes} [Fri Oct 15 03:27:04 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:05.013757 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cdea0-aebd-4d47-a9ee-189e6d6abcb7 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:05.023452 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cdea0-aebd-4d47-a9ee-189e6d6abcb7 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:05.028719 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af29be2-7023-4b09-8ddd-b77cbef26893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:05.029587 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af29be2-7023-4b09-8ddd-b77cbef26893 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:05.030061 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af29be2-7023-4b09-8ddd-b77cbef26893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:05.030523 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af29be2-7023-4b09-8ddd-b77cbef26893 admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:05.031434 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af29be2-7023-4b09-8ddd-b77cbef26893 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:05.031962 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af29be2-7023-4b09-8ddd-b77cbef26893 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:05.033728 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af29be2-7023-4b09-8ddd-b77cbef26893 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:05.038537 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 397/792] 10.222.0.30 () {56 vars in 1143 bytes} [Fri Oct 15 03:27:05 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:05.883923 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fd6be-027c-4e05-83da-45ce38c14a38 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:05.884469 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fd6be-027c-4e05-83da-45ce38c14a38 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:05.884469 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fd6be-027c-4e05-83da-45ce38c14a38 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:05.886476 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 396/793] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:05.892535 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdba400-1ae9-4c23-aa43-5034ac7ff0d6 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:05.893315 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdba400-1ae9-4c23-aa43-5034ac7ff0d6 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:05.893801 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdba400-1ae9-4c23-aa43-5034ac7ff0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:05.912066 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-2fdba400-1ae9-4c23-aa43-5034ac7ff0d6 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:05.913536 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-2fdba400-1ae9-4c23-aa43-5034ac7ff0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:05.922541 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 398/794] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:05 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:05.945450 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fd6be-027c-4e05-83da-45ce38c14a38 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:05.958276 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fd6be-027c-4e05-83da-45ce38c14a38 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:05.963659 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7859de-3738-4c5d-b7ce-7bd6760d1496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:05.964484 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7859de-3738-4c5d-b7ce-7bd6760d1496 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:05.964765 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7859de-3738-4c5d-b7ce-7bd6760d1496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:05.965043 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7859de-3738-4c5d-b7ce-7bd6760d1496 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:05.965700 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7859de-3738-4c5d-b7ce-7bd6760d1496 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:05.967371 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7859de-3738-4c5d-b7ce-7bd6760d1496 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:05.979937 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-6e7859de-3738-4c5d-b7ce-7bd6760d1496 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 15 03:27:05.981397 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 397/795] 10.222.0.30 () {56 vars in 1153 bytes} [Fri Oct 15 03:27:05 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:05.987899 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdba400-1ae9-4c23-aa43-5034ac7ff0d6 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:05.997463 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdba400-1ae9-4c23-aa43-5034ac7ff0d6 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:06.002048 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ffc46c-9054-46ec-acce-c8c5c186a0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:06.002695 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffc46c-9054-46ec-acce-c8c5c186a0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:06.002979 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffc46c-9054-46ec-acce-c8c5c186a0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:06.003258 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffc46c-9054-46ec-acce-c8c5c186a0b2 admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:06.004013 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ffc46c-9054-46ec-acce-c8c5c186a0b2 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:06.004323 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ffc46c-9054-46ec-acce-c8c5c186a0b2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:06.005909 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ffc46c-9054-46ec-acce-c8c5c186a0b2 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:06.011405 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 399/796] 10.222.0.30 () {56 vars in 1147 bytes} [Fri Oct 15 03:27:05 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:06.017596 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7859de-3738-4c5d-b7ce-7bd6760d1496 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:06.027416 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7859de-3738-4c5d-b7ce-7bd6760d1496 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:06.031997 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747efec-47a1-4e04-bcb8-1d485495f6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:06.032640 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747efec-47a1-4e04-bcb8-1d485495f6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:06.032924 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747efec-47a1-4e04-bcb8-1d485495f6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:06.033202 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747efec-47a1-4e04-bcb8-1d485495f6a4 admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:06.033913 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747efec-47a1-4e04-bcb8-1d485495f6a4 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:06.034218 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747efec-47a1-4e04-bcb8-1d485495f6a4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:06.035836 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747efec-47a1-4e04-bcb8-1d485495f6a4 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:06.040792 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 398/797] 10.222.0.30 () {56 vars in 1147 bytes} [Fri Oct 15 03:27:06 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:06.046933 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ffc46c-9054-46ec-acce-c8c5c186a0b2 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:06.056913 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ffc46c-9054-46ec-acce-c8c5c186a0b2 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:06.062635 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acbde6-99c6-4b6f-b77b-a6147679224d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:06.063292 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acbde6-99c6-4b6f-b77b-a6147679224d admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:06.063579 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acbde6-99c6-4b6f-b77b-a6147679224d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:06.063890 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acbde6-99c6-4b6f-b77b-a6147679224d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:06.064700 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acbde6-99c6-4b6f-b77b-a6147679224d admin admin] RBAC: Adding query filter params (interface=public, service_id=02d5a96dc3c84a66b3c3dfffd6cc7043, region_id=RegionOne) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:06.065012 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acbde6-99c6-4b6f-b77b-a6147679224d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:06.066617 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acbde6-99c6-4b6f-b77b-a6147679224d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:06.073123 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 400/798] 10.222.0.30 () {56 vars in 1272 bytes} [Fri Oct 15 03:27:06 2021] GET /identity/v3/endpoints?service_id=02d5a96dc3c84a66b3c3dfffd6cc7043&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:06.079163 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747efec-47a1-4e04-bcb8-1d485495f6a4 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:06.088862 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747efec-47a1-4e04-bcb8-1d485495f6a4 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:06.093424 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd51a4-05ba-4782-b49d-c1aa0b5ffeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:06.094068 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd51a4-05ba-4782-b49d-c1aa0b5ffeda admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:06.094354 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd51a4-05ba-4782-b49d-c1aa0b5ffeda admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:06.094633 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd51a4-05ba-4782-b49d-c1aa0b5ffeda admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:06.095321 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd51a4-05ba-4782-b49d-c1aa0b5ffeda admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:06.096951 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd51a4-05ba-4782-b49d-c1aa0b5ffeda admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:06.103219 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 399/799] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Oct 15 03:27:06 2021] GET /identity/v3/services => generated 1268 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:27:06.803709 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9972e-57da-4186-9e4d-9f75da18d025 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:06.804131 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9972e-57da-4186-9e4d-9f75da18d025 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:06.804304 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9972e-57da-4186-9e4d-9f75da18d025 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:06.806628 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 401/800] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:06.813229 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e446e-dbbe-4c61-9954-97d847732e5b None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:06.813562 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e446e-dbbe-4c61-9954-97d847732e5b None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:06.813779 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e446e-dbbe-4c61-9954-97d847732e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:06.832820 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-581e446e-dbbe-4c61-9954-97d847732e5b None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:06.834021 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-581e446e-dbbe-4c61-9954-97d847732e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:06.842596 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 400/801] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:06 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:06.866886 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9972e-57da-4186-9e4d-9f75da18d025 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:06.880132 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9972e-57da-4186-9e4d-9f75da18d025 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:06.885076 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fffedf-fdf1-4edc-9299-0f16d7bc3afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:06.885852 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fffedf-fdf1-4edc-9299-0f16d7bc3afe admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:06.886131 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fffedf-fdf1-4edc-9299-0f16d7bc3afe admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:06.886404 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fffedf-fdf1-4edc-9299-0f16d7bc3afe admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:06.887058 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fffedf-fdf1-4edc-9299-0f16d7bc3afe admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:06.888680 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fffedf-fdf1-4edc-9299-0f16d7bc3afe admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:06.899869 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-32fffedf-fdf1-4edc-9299-0f16d7bc3afe admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 15 03:27:06.901343 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 402/802] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Oct 15 03:27:06 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:06.908201 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e446e-dbbe-4c61-9954-97d847732e5b None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:06.917837 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e446e-dbbe-4c61-9954-97d847732e5b None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:06.922555 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de588c05-0d5d-4db6-bd03-d359fd12e375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:06.923204 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de588c05-0d5d-4db6-bd03-d359fd12e375 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:06.923486 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de588c05-0d5d-4db6-bd03-d359fd12e375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:06.923798 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de588c05-0d5d-4db6-bd03-d359fd12e375 admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:06.924512 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de588c05-0d5d-4db6-bd03-d359fd12e375 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:06.924812 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de588c05-0d5d-4db6-bd03-d359fd12e375 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:06.926429 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de588c05-0d5d-4db6-bd03-d359fd12e375 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:06.932311 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 401/803] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Oct 15 03:27:06 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:06.938569 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fffedf-fdf1-4edc-9299-0f16d7bc3afe admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:06.945238 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29aff7-8a4d-4ec2-aa4c-dfb20e488147 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:06.946061 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29aff7-8a4d-4ec2-aa4c-dfb20e488147 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:06.946345 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29aff7-8a4d-4ec2-aa4c-dfb20e488147 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:06.948448 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 402/804] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:06.949245 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fffedf-fdf1-4edc-9299-0f16d7bc3afe admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:06.954194 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34c327-a034-47e6-a147-6e2532925ff7 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:06.954397 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae274fcc-a1a4-42d7-9623-786f8f96c32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:06.954569 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34c327-a034-47e6-a147-6e2532925ff7 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:06.954748 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34c327-a034-47e6-a147-6e2532925ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:06.954964 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae274fcc-a1a4-42d7-9623-786f8f96c32e admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:06.955249 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae274fcc-a1a4-42d7-9623-786f8f96c32e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:06.955525 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae274fcc-a1a4-42d7-9623-786f8f96c32e admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:06.956285 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae274fcc-a1a4-42d7-9623-786f8f96c32e admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:06.956590 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae274fcc-a1a4-42d7-9623-786f8f96c32e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:06.958191 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae274fcc-a1a4-42d7-9623-786f8f96c32e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:06.965398 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 403/805] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Oct 15 03:27:06 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:06.971719 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae274fcc-a1a4-42d7-9623-786f8f96c32e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:06.976528 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-6a34c327-a034-47e6-a147-6e2532925ff7 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:06.978960 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-6a34c327-a034-47e6-a147-6e2532925ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:06.982246 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae274fcc-a1a4-42d7-9623-786f8f96c32e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:06.986836 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dcc0d0-2424-418f-a374-4a4e6415d7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:06.987535 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 403/806] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:06 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:27:06.991990 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcc0d0-2424-418f-a374-4a4e6415d7aa admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:06.992315 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcc0d0-2424-418f-a374-4a4e6415d7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:06.993133 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcc0d0-2424-418f-a374-4a4e6415d7aa admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:06.993952 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dcc0d0-2424-418f-a374-4a4e6415d7aa admin admin] RBAC: Adding query filter params (interface=public, service_id=306a114b6f7c4541a455b435c6b4fe38, region_id=RegionOne) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:06.994262 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dcc0d0-2424-418f-a374-4a4e6415d7aa admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:06.995883 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dcc0d0-2424-418f-a374-4a4e6415d7aa admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:07.001535 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 404/807] 10.222.0.30 () {56 vars in 1272 bytes} [Fri Oct 15 03:27:06 2021] GET /identity/v3/endpoints?service_id=306a114b6f7c4541a455b435c6b4fe38&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:27:07.007479 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34c327-a034-47e6-a147-6e2532925ff7 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:07.017304 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34c327-a034-47e6-a147-6e2532925ff7 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:07.018014 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dcc0d0-2424-418f-a374-4a4e6415d7aa admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:07.022610 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b189cf7-ebf1-40b0-9f8c-7dfe6c8c7e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:07.023560 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b189cf7-ebf1-40b0-9f8c-7dfe6c8c7e0a admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:07.024151 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b189cf7-ebf1-40b0-9f8c-7dfe6c8c7e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:07.024629 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b189cf7-ebf1-40b0-9f8c-7dfe6c8c7e0a admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:07.025534 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b189cf7-ebf1-40b0-9f8c-7dfe6c8c7e0a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:07.027388 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b189cf7-ebf1-40b0-9f8c-7dfe6c8c7e0a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:07.028258 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dcc0d0-2424-418f-a374-4a4e6415d7aa admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:07.033572 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07d5d3-a103-4b0b-ae90-43dc059b815d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:07.039714 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07d5d3-a103-4b0b-ae90-43dc059b815d admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:07.039714 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07d5d3-a103-4b0b-ae90-43dc059b815d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:07.039714 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07d5d3-a103-4b0b-ae90-43dc059b815d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:07.040238 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 404/808] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Oct 15 03:27:07 2021] GET /identity/v3/services => generated 1268 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:27:07.047800 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07d5d3-a103-4b0b-ae90-43dc059b815d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:27:07.056028 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-4c07d5d3-a103-4b0b-ae90-43dc059b815d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 15 03:27:07.057546 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 405/809] 10.222.0.30 () {56 vars in 1141 bytes} [Fri Oct 15 03:27:07 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:27:07.064244 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b189cf7-ebf1-40b0-9f8c-7dfe6c8c7e0a admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:07.075092 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b189cf7-ebf1-40b0-9f8c-7dfe6c8c7e0a admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:07.080461 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948662d-8f26-4baa-bc57-fee268f5e2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:07.081542 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948662d-8f26-4baa-bc57-fee268f5e2da admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:07.082029 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948662d-8f26-4baa-bc57-fee268f5e2da admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:07.082550 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948662d-8f26-4baa-bc57-fee268f5e2da admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:07.083549 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948662d-8f26-4baa-bc57-fee268f5e2da admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:07.084142 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948662d-8f26-4baa-bc57-fee268f5e2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:07.086134 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948662d-8f26-4baa-bc57-fee268f5e2da admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:07.096123 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 405/810] 10.222.0.30 () {56 vars in 1136 bytes} [Fri Oct 15 03:27:07 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:07.103746 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07d5d3-a103-4b0b-ae90-43dc059b815d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:07.113506 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07d5d3-a103-4b0b-ae90-43dc059b815d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:07.118767 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634a5be-8cbf-444d-86f6-b045466d0e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:07.119563 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634a5be-8cbf-444d-86f6-b045466d0e47 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:07.119876 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634a5be-8cbf-444d-86f6-b045466d0e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:07.120152 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634a5be-8cbf-444d-86f6-b045466d0e47 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:07.131773 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634a5be-8cbf-444d-86f6-b045466d0e47 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:07.133753 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634a5be-8cbf-444d-86f6-b045466d0e47 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:07.152234 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-6634a5be-8cbf-444d-86f6-b045466d0e47 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:27:07.153789 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 406/811] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:07.160124 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948662d-8f26-4baa-bc57-fee268f5e2da admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:07.171306 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948662d-8f26-4baa-bc57-fee268f5e2da admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:07.176683 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c27956-4d0b-4829-a8a1-90bd1a1c7305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:07.177775 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c27956-4d0b-4829-a8a1-90bd1a1c7305 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:07.178268 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c27956-4d0b-4829-a8a1-90bd1a1c7305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:07.178785 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c27956-4d0b-4829-a8a1-90bd1a1c7305 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:07.179869 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c27956-4d0b-4829-a8a1-90bd1a1c7305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:07.180995 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c27956-4d0b-4829-a8a1-90bd1a1c7305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:07.182988 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c27956-4d0b-4829-a8a1-90bd1a1c7305 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:07.197383 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 406/812] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:27:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:07.203745 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634a5be-8cbf-444d-86f6-b045466d0e47 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:07.214493 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634a5be-8cbf-444d-86f6-b045466d0e47 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:07.219531 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0c2bb-f68d-4674-a28a-122715684670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:07.220410 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0c2bb-f68d-4674-a28a-122715684670 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:07.220909 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0c2bb-f68d-4674-a28a-122715684670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:07.221187 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0c2bb-f68d-4674-a28a-122715684670 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:07.230328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0c2bb-f68d-4674-a28a-122715684670 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:07.234751 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0c2bb-f68d-4674-a28a-122715684670 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:07.249010 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-39c0c2bb-f68d-4674-a28a-122715684670 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 15 03:27:07.250621 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 407/813] 10.222.0.30 () {56 vars in 1138 bytes} [Fri Oct 15 03:27:07 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:07.257270 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c27956-4d0b-4829-a8a1-90bd1a1c7305 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:07.270215 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c27956-4d0b-4829-a8a1-90bd1a1c7305 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:07.275812 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb58458-c9f7-40a8-84db-b461dba63c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:07.276652 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb58458-c9f7-40a8-84db-b461dba63c2e admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:07.277080 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb58458-c9f7-40a8-84db-b461dba63c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:07.277496 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb58458-c9f7-40a8-84db-b461dba63c2e admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:07.278504 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb58458-c9f7-40a8-84db-b461dba63c2e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:07.278963 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb58458-c9f7-40a8-84db-b461dba63c2e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:07.280996 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb58458-c9f7-40a8-84db-b461dba63c2e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:07.299514 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 407/814] 10.222.0.30 () {56 vars in 1170 bytes} [Fri Oct 15 03:27:07 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:07.306648 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0c2bb-f68d-4674-a28a-122715684670 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:07.317620 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0c2bb-f68d-4674-a28a-122715684670 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:07.324670 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753be14c-038c-4356-a2bf-6121c8a201ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:07.326282 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753be14c-038c-4356-a2bf-6121c8a201ba admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:07.326845 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753be14c-038c-4356-a2bf-6121c8a201ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:07.327580 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753be14c-038c-4356-a2bf-6121c8a201ba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:07.340447 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753be14c-038c-4356-a2bf-6121c8a201ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:07.342500 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753be14c-038c-4356-a2bf-6121c8a201ba admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:07.365072 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-753be14c-038c-4356-a2bf-6121c8a201ba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:27:07.367802 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 408/815] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:07.374965 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb58458-c9f7-40a8-84db-b461dba63c2e admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:07.388276 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aed107-5689-4b86-b71c-88549aae1d71 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:07.389001 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aed107-5689-4b86-b71c-88549aae1d71 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:07.389576 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aed107-5689-4b86-b71c-88549aae1d71 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:07.391587 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb58458-c9f7-40a8-84db-b461dba63c2e admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:07.391950 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 409/816] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:07.398454 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729144c2-0b4f-40a1-aeb1-2d5e1d63d6f0 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:07.398810 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729144c2-0b4f-40a1-aeb1-2d5e1d63d6f0 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:07.399134 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729144c2-0b4f-40a1-aeb1-2d5e1d63d6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:07.405377 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b9684-8279-4425-869d-ea5ef0040ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:07.405377 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b9684-8279-4425-869d-ea5ef0040ccc admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:07.405377 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b9684-8279-4425-869d-ea5ef0040ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:07.405377 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b9684-8279-4425-869d-ea5ef0040ccc admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:07.406116 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b9684-8279-4425-869d-ea5ef0040ccc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:07.406116 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b9684-8279-4425-869d-ea5ef0040ccc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:07.406116 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b9684-8279-4425-869d-ea5ef0040ccc admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:07.418784 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 408/817] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:27:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:07.419416 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-729144c2-0b4f-40a1-aeb1-2d5e1d63d6f0 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:07.424752 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-729144c2-0b4f-40a1-aeb1-2d5e1d63d6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:07.425806 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b9684-8279-4425-869d-ea5ef0040ccc admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:07.437670 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b9684-8279-4425-869d-ea5ef0040ccc admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:07.438549 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 410/818] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:07 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:27:07.443758 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14a8c9-36a7-4424-a717-8f546cba90c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:07.444829 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14a8c9-36a7-4424-a717-8f546cba90c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:07.445419 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14a8c9-36a7-4424-a717-8f546cba90c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:07.446422 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14a8c9-36a7-4424-a717-8f546cba90c1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:07.454260 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14a8c9-36a7-4424-a717-8f546cba90c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:07.456537 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14a8c9-36a7-4424-a717-8f546cba90c1 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:07.462120 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729144c2-0b4f-40a1-aeb1-2d5e1d63d6f0 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:07.471599 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729144c2-0b4f-40a1-aeb1-2d5e1d63d6f0 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:07.473877 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-7c14a8c9-36a7-4424-a717-8f546cba90c1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:27:07.475555 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 409/819] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:27:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:07.481798 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14a8c9-36a7-4424-a717-8f546cba90c1 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:07.482220 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0e86f-4fc3-46ab-b22d-1ba0b30b4cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:07.483187 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0e86f-4fc3-46ab-b22d-1ba0b30b4cdc admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:07.483563 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0e86f-4fc3-46ab-b22d-1ba0b30b4cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:07.483972 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0e86f-4fc3-46ab-b22d-1ba0b30b4cdc admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:07.484820 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0e86f-4fc3-46ab-b22d-1ba0b30b4cdc admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:07.486528 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0e86f-4fc3-46ab-b22d-1ba0b30b4cdc admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:07.493547 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14a8c9-36a7-4424-a717-8f546cba90c1 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:07.498595 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a4234-84c2-4b8e-9fc9-d925ef4158e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:07.499344 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a4234-84c2-4b8e-9fc9-d925ef4158e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:07.499628 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a4234-84c2-4b8e-9fc9-d925ef4158e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:07.499945 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a4234-84c2-4b8e-9fc9-d925ef4158e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:07.500793 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a4234-84c2-4b8e-9fc9-d925ef4158e8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:07.501149 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a4234-84c2-4b8e-9fc9-d925ef4158e8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:07.503135 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a4234-84c2-4b8e-9fc9-d925ef4158e8 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:07.505395 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 411/820] 10.222.0.30 () {60 vars in 1162 bytes} [Fri Oct 15 03:27:07 2021] POST /identity/v3/services => generated 241 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:27:07.524757 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 410/821] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:27:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:27:07.532346 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0e86f-4fc3-46ab-b22d-1ba0b30b4cdc admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:07.555507 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0e86f-4fc3-46ab-b22d-1ba0b30b4cdc admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:07.560800 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bb2b9-5aaf-4fc0-9e99-0b5b8fb07206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:07.562172 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bb2b9-5aaf-4fc0-9e99-0b5b8fb07206 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:07.562661 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bb2b9-5aaf-4fc0-9e99-0b5b8fb07206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:07.563170 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bb2b9-5aaf-4fc0-9e99-0b5b8fb07206 admin admin] PATH_INFO: `/v3/projects/9f95c04b0a7b4a2d8fbb4b547f70dc20/users/3f598b94a850413494da575188706cb1/roles/9ac52cb6a0744b1797edbae9fd88349b` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:07.565967 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bb2b9-5aaf-4fc0-9e99-0b5b8fb07206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user_id=3f598b94a850413494da575188706cb1, role_id=9ac52cb6a0744b1797edbae9fd88349b)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:07.569274 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bb2b9-5aaf-4fc0-9e99-0b5b8fb07206 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:07.589472 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 412/822] 10.222.0.30 () {58 vars in 1460 bytes} [Fri Oct 15 03:27:07 2021] PUT /identity/v3/projects/9f95c04b0a7b4a2d8fbb4b547f70dc20/users/3f598b94a850413494da575188706cb1/roles/9ac52cb6a0744b1797edbae9fd88349b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:27:08.425383 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecee84-53b1-485a-8312-6e241f34a573 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:08.425896 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecee84-53b1-485a-8312-6e241f34a573 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:08.426157 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecee84-53b1-485a-8312-6e241f34a573 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:08.428133 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 411/823] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:08.441269 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb8596-8010-446d-ad02-dd549251d691 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:08.441760 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb8596-8010-446d-ad02-dd549251d691 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:08.441836 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb8596-8010-446d-ad02-dd549251d691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:08.459944 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-6dcb8596-8010-446d-ad02-dd549251d691 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:08.461722 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-6dcb8596-8010-446d-ad02-dd549251d691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:08.519808 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 413/824] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:08 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:08.543487 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecee84-53b1-485a-8312-6e241f34a573 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:08.555575 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecee84-53b1-485a-8312-6e241f34a573 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:08.560005 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c5d59-e423-426c-8479-a8f3314cee55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:08.560786 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c5d59-e423-426c-8479-a8f3314cee55 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:08.561068 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c5d59-e423-426c-8479-a8f3314cee55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:08.561345 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c5d59-e423-426c-8479-a8f3314cee55 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:08.562000 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c5d59-e423-426c-8479-a8f3314cee55 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:08.563600 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c5d59-e423-426c-8479-a8f3314cee55 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:08.575436 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-c34c5d59-e423-426c-8479-a8f3314cee55 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 15 03:27:08.576890 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 412/825] 10.222.0.30 () {56 vars in 1153 bytes} [Fri Oct 15 03:27:08 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:08.583405 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb8596-8010-446d-ad02-dd549251d691 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:08.592821 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb8596-8010-446d-ad02-dd549251d691 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:08.597298 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a74df-5072-4c3b-ab27-cb5fea87b070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:08.597937 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a74df-5072-4c3b-ab27-cb5fea87b070 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:08.598479 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a74df-5072-4c3b-ab27-cb5fea87b070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:08.598750 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a74df-5072-4c3b-ab27-cb5fea87b070 admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:08.599464 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a74df-5072-4c3b-ab27-cb5fea87b070 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:08.599797 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a74df-5072-4c3b-ab27-cb5fea87b070 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:08.601387 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a74df-5072-4c3b-ab27-cb5fea87b070 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:08.606205 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 414/826] 10.222.0.30 () {56 vars in 1147 bytes} [Fri Oct 15 03:27:08 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:08.612609 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c5d59-e423-426c-8479-a8f3314cee55 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:08.622372 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c5d59-e423-426c-8479-a8f3314cee55 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:08.626847 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a5a45-d4d7-4fa5-a2ff-736337be010c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:08.627490 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a5a45-d4d7-4fa5-a2ff-736337be010c admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:08.627811 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a5a45-d4d7-4fa5-a2ff-736337be010c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:08.628089 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a5a45-d4d7-4fa5-a2ff-736337be010c admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:08.628793 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a5a45-d4d7-4fa5-a2ff-736337be010c admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:08.629097 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a5a45-d4d7-4fa5-a2ff-736337be010c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:08.630693 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a5a45-d4d7-4fa5-a2ff-736337be010c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:08.636513 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 413/827] 10.222.0.30 () {56 vars in 1147 bytes} [Fri Oct 15 03:27:08 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:08.642686 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a74df-5072-4c3b-ab27-cb5fea87b070 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:08.652977 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a74df-5072-4c3b-ab27-cb5fea87b070 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:08.657557 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5498930-d8a6-47d8-8234-0bbbf89da7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:08.658197 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5498930-d8a6-47d8-8234-0bbbf89da7ed admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:08.658477 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5498930-d8a6-47d8-8234-0bbbf89da7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:08.658751 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5498930-d8a6-47d8-8234-0bbbf89da7ed admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:08.659504 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5498930-d8a6-47d8-8234-0bbbf89da7ed admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:08.660530 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING py.warnings [None req-d5498930-d8a6-47d8-8234-0bbbf89da7ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:27:08.660530 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: warnings.warn(msg) Oct 15 03:27:08.660530 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: Oct 15 03:27:08.661405 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5498930-d8a6-47d8-8234-0bbbf89da7ed admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:08.684681 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 415/828] 10.222.0.30 () {60 vars in 1165 bytes} [Fri Oct 15 03:27:08 2021] POST /identity/v3/endpoints => generated 347 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:27:09.382084 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b94833-6488-4cdd-b449-24561b02c34a None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:09.382377 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b94833-6488-4cdd-b449-24561b02c34a None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:09.382660 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b94833-6488-4cdd-b449-24561b02c34a None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:09.385635 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 414/829] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:09.391856 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80a57b-88e1-46a7-8661-a1e7967dcc8b None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:09.392403 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80a57b-88e1-46a7-8661-a1e7967dcc8b None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:09.392901 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80a57b-88e1-46a7-8661-a1e7967dcc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:09.411294 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-0f80a57b-88e1-46a7-8661-a1e7967dcc8b None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:09.412936 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-0f80a57b-88e1-46a7-8661-a1e7967dcc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:09.435779 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 416/830] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:09 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:27:09.455164 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b94833-6488-4cdd-b449-24561b02c34a None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:09.470824 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b94833-6488-4cdd-b449-24561b02c34a None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:09.476358 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008000f4-0174-448d-a15c-175d990b0115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:09.477331 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008000f4-0174-448d-a15c-175d990b0115 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:09.477615 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008000f4-0174-448d-a15c-175d990b0115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:09.477901 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008000f4-0174-448d-a15c-175d990b0115 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:09.478558 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008000f4-0174-448d-a15c-175d990b0115 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:09.480260 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008000f4-0174-448d-a15c-175d990b0115 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:09.491643 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-008000f4-0174-448d-a15c-175d990b0115 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 15 03:27:09.493802 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 415/831] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Oct 15 03:27:09 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:09.500404 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80a57b-88e1-46a7-8661-a1e7967dcc8b None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:09.510470 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80a57b-88e1-46a7-8661-a1e7967dcc8b None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:09.515317 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de5a35-a225-4d49-b2f6-824c10d1e890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:09.516248 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de5a35-a225-4d49-b2f6-824c10d1e890 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:09.516752 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de5a35-a225-4d49-b2f6-824c10d1e890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:09.517239 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de5a35-a225-4d49-b2f6-824c10d1e890 admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:09.518151 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de5a35-a225-4d49-b2f6-824c10d1e890 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:09.518654 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de5a35-a225-4d49-b2f6-824c10d1e890 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:09.520480 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de5a35-a225-4d49-b2f6-824c10d1e890 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:09.530651 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 417/832] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Oct 15 03:27:09 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:09.532265 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008000f4-0174-448d-a15c-175d990b0115 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:09.542895 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008000f4-0174-448d-a15c-175d990b0115 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:09.547698 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f7250-cef7-4ea2-997b-1c005e5f2245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:09.548589 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f7250-cef7-4ea2-997b-1c005e5f2245 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:09.549073 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f7250-cef7-4ea2-997b-1c005e5f2245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:09.549570 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f7250-cef7-4ea2-997b-1c005e5f2245 admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:09.550482 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f7250-cef7-4ea2-997b-1c005e5f2245 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:09.550995 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f7250-cef7-4ea2-997b-1c005e5f2245 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:09.552808 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f7250-cef7-4ea2-997b-1c005e5f2245 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:09.562997 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 416/833] 10.222.0.30 () {56 vars in 1135 bytes} [Fri Oct 15 03:27:09 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:09.569304 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de5a35-a225-4d49-b2f6-824c10d1e890 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:09.579929 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de5a35-a225-4d49-b2f6-824c10d1e890 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:09.584859 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d4407-5f1a-41af-b034-95bce6cad940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:09.585733 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d4407-5f1a-41af-b034-95bce6cad940 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:09.586271 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d4407-5f1a-41af-b034-95bce6cad940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:09.586743 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d4407-5f1a-41af-b034-95bce6cad940 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:09.587730 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d4407-5f1a-41af-b034-95bce6cad940 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:09.589509 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d4407-5f1a-41af-b034-95bce6cad940 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:09.615796 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 418/834] 10.222.0.30 () {60 vars in 1165 bytes} [Fri Oct 15 03:27:09 2021] POST /identity/v3/endpoints => generated 346 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:27:09.834054 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbbebf-e50b-43af-ad48-69cb1402388a None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:09.834248 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbbebf-e50b-43af-ad48-69cb1402388a None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:09.834526 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbbebf-e50b-43af-ad48-69cb1402388a None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:09.837329 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 417/835] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:09.844014 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a280bed-c749-468f-8dc6-0cf9e3aaa64a None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:09.844320 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a280bed-c749-468f-8dc6-0cf9e3aaa64a None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:09.844525 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a280bed-c749-468f-8dc6-0cf9e3aaa64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:09.864300 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-0a280bed-c749-468f-8dc6-0cf9e3aaa64a None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:09.865515 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-0a280bed-c749-468f-8dc6-0cf9e3aaa64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:09.883328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 419/836] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:09 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:09.908754 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbbebf-e50b-43af-ad48-69cb1402388a None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:09.921584 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbbebf-e50b-43af-ad48-69cb1402388a None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:09.926291 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fdd89-48cc-44e1-bb4c-baec779515ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:09.927305 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fdd89-48cc-44e1-bb4c-baec779515ae admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:09.927834 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fdd89-48cc-44e1-bb4c-baec779515ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:09.928312 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fdd89-48cc-44e1-bb4c-baec779515ae admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:09.929185 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fdd89-48cc-44e1-bb4c-baec779515ae admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:09.931037 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fdd89-48cc-44e1-bb4c-baec779515ae admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:09.942703 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-7e5fdd89-48cc-44e1-bb4c-baec779515ae admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 15 03:27:09.947779 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 418/837] 10.222.0.30 () {56 vars in 1147 bytes} [Fri Oct 15 03:27:09 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:09.952111 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a280bed-c749-468f-8dc6-0cf9e3aaa64a None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:09.961874 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a280bed-c749-468f-8dc6-0cf9e3aaa64a None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:09.966514 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc30c1a-9da4-45cd-ae32-6ed293fbd591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:09.967190 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc30c1a-9da4-45cd-ae32-6ed293fbd591 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:09.967475 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc30c1a-9da4-45cd-ae32-6ed293fbd591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:09.967789 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc30c1a-9da4-45cd-ae32-6ed293fbd591 admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:09.968529 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc30c1a-9da4-45cd-ae32-6ed293fbd591 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:09.968831 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc30c1a-9da4-45cd-ae32-6ed293fbd591 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:09.970474 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc30c1a-9da4-45cd-ae32-6ed293fbd591 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:09.976674 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 420/838] 10.222.0.30 () {56 vars in 1143 bytes} [Fri Oct 15 03:27:09 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:09.983302 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fdd89-48cc-44e1-bb4c-baec779515ae admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:09.993869 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fdd89-48cc-44e1-bb4c-baec779515ae admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:09.995993 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78246671-d39b-4b14-ab60-af4325a7d742 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:09.996287 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78246671-d39b-4b14-ab60-af4325a7d742 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:09.996570 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78246671-d39b-4b14-ab60-af4325a7d742 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:09.998480 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 421/839] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:27:10.001093 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeec442-960a-43c8-bac1-5718b9c5eaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:10.001093 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeec442-960a-43c8-bac1-5718b9c5eaab admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:10.001093 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeec442-960a-43c8-bac1-5718b9c5eaab admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:10.001396 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeec442-960a-43c8-bac1-5718b9c5eaab admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:10.002176 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeec442-960a-43c8-bac1-5718b9c5eaab admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:10.002553 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeec442-960a-43c8-bac1-5718b9c5eaab admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:10.004606 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeec442-960a-43c8-bac1-5718b9c5eaab admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:10.005389 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c32274-8802-4155-9ffb-93afa28ae1a7 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:10.005824 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c32274-8802-4155-9ffb-93afa28ae1a7 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:10.006446 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c32274-8802-4155-9ffb-93afa28ae1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:10.011769 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 419/840] 10.222.0.30 () {56 vars in 1143 bytes} [Fri Oct 15 03:27:09 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:10.017960 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeec442-960a-43c8-bac1-5718b9c5eaab admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:10.033139 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeec442-960a-43c8-bac1-5718b9c5eaab admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:10.035082 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-c1c32274-8802-4155-9ffb-93afa28ae1a7 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:10.036325 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-c1c32274-8802-4155-9ffb-93afa28ae1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:10.039137 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd634d-aea9-4e85-88df-d36b56586387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:10.040406 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd634d-aea9-4e85-88df-d36b56586387 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:10.040689 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd634d-aea9-4e85-88df-d36b56586387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:10.040967 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd634d-aea9-4e85-88df-d36b56586387 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:10.041765 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd634d-aea9-4e85-88df-d36b56586387 admin admin] RBAC: Adding query filter params (interface=public, service_id=1d40eb4b6f10454cbcdce5d96cb18c85, region_id=RegionOne) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:10.042075 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd634d-aea9-4e85-88df-d36b56586387 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:10.043670 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd634d-aea9-4e85-88df-d36b56586387 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:10.050851 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 422/841] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:10 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:27:10.058136 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 420/842] 10.222.0.30 () {56 vars in 1272 bytes} [Fri Oct 15 03:27:10 2021] GET /identity/v3/endpoints?service_id=1d40eb4b6f10454cbcdce5d96cb18c85&interface=public®ion_id=RegionOne => generated 194 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:10.059600 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c32274-8802-4155-9ffb-93afa28ae1a7 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:10.069343 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c32274-8802-4155-9ffb-93afa28ae1a7 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:10.074069 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0209b-687a-4da6-a1a8-75927414610a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:10.074989 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0209b-687a-4da6-a1a8-75927414610a admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:10.075464 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0209b-687a-4da6-a1a8-75927414610a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:10.076867 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd634d-aea9-4e85-88df-d36b56586387 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:10.079927 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0209b-687a-4da6-a1a8-75927414610a admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:10.080872 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a0209b-687a-4da6-a1a8-75927414610a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:10.082684 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a0209b-687a-4da6-a1a8-75927414610a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:10.087754 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd634d-aea9-4e85-88df-d36b56586387 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:10.090005 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 423/843] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Oct 15 03:27:10 2021] GET /identity/v3/services => generated 1497 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:27:10.098447 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de356592-cb45-4747-a906-a92f693a7ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:10.099574 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de356592-cb45-4747-a906-a92f693a7ead admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:10.100111 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de356592-cb45-4747-a906-a92f693a7ead admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:10.100535 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de356592-cb45-4747-a906-a92f693a7ead admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:10.114034 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de356592-cb45-4747-a906-a92f693a7ead admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:27:10.122779 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-de356592-cb45-4747-a906-a92f693a7ead admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 15 03:27:10.124714 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 421/844] 10.222.0.30 () {56 vars in 1141 bytes} [Fri Oct 15 03:27:10 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:27:10.131654 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0209b-687a-4da6-a1a8-75927414610a admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:10.142365 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0209b-687a-4da6-a1a8-75927414610a admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:10.147543 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca36d8-2dae-4ad4-a71e-ee717abc1bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:10.148560 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca36d8-2dae-4ad4-a71e-ee717abc1bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:10.148995 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca36d8-2dae-4ad4-a71e-ee717abc1bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:10.149414 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca36d8-2dae-4ad4-a71e-ee717abc1bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:10.150399 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca36d8-2dae-4ad4-a71e-ee717abc1bb8 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:10.150875 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca36d8-2dae-4ad4-a71e-ee717abc1bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:10.152799 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca36d8-2dae-4ad4-a71e-ee717abc1bb8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:10.162754 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 424/845] 10.222.0.30 () {56 vars in 1136 bytes} [Fri Oct 15 03:27:10 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:10.171130 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de356592-cb45-4747-a906-a92f693a7ead admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:10.182003 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de356592-cb45-4747-a906-a92f693a7ead admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:10.187387 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89bc43-268b-4562-bfc6-5c1165eeb1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:10.188519 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89bc43-268b-4562-bfc6-5c1165eeb1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:10.188949 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89bc43-268b-4562-bfc6-5c1165eeb1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:10.189399 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89bc43-268b-4562-bfc6-5c1165eeb1d8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:10.201084 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89bc43-268b-4562-bfc6-5c1165eeb1d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:10.203260 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89bc43-268b-4562-bfc6-5c1165eeb1d8 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:10.221235 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-6a89bc43-268b-4562-bfc6-5c1165eeb1d8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:27:10.223373 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 422/846] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:10.230594 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca36d8-2dae-4ad4-a71e-ee717abc1bb8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:10.252828 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca36d8-2dae-4ad4-a71e-ee717abc1bb8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:10.258079 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f050a-8a15-437d-8503-db38b070f805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:10.259026 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f050a-8a15-437d-8503-db38b070f805 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:10.259479 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f050a-8a15-437d-8503-db38b070f805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:10.260026 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f050a-8a15-437d-8503-db38b070f805 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:10.260990 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f050a-8a15-437d-8503-db38b070f805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:10.261496 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f050a-8a15-437d-8503-db38b070f805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:10.263328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f050a-8a15-437d-8503-db38b070f805 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:10.277838 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 425/847] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:27:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:10.284517 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89bc43-268b-4562-bfc6-5c1165eeb1d8 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:10.299295 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89bc43-268b-4562-bfc6-5c1165eeb1d8 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:10.304222 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e9a37-cf2f-4b0d-b59e-f5d7cc10506c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:10.305763 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e9a37-cf2f-4b0d-b59e-f5d7cc10506c admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:10.306209 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e9a37-cf2f-4b0d-b59e-f5d7cc10506c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:10.306624 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e9a37-cf2f-4b0d-b59e-f5d7cc10506c admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:10.315793 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e9a37-cf2f-4b0d-b59e-f5d7cc10506c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:10.318096 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e9a37-cf2f-4b0d-b59e-f5d7cc10506c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:10.333727 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-ef0e9a37-cf2f-4b0d-b59e-f5d7cc10506c admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 15 03:27:10.335098 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 423/848] 10.222.0.30 () {56 vars in 1138 bytes} [Fri Oct 15 03:27:10 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:10.342271 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f050a-8a15-437d-8503-db38b070f805 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:10.354788 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f050a-8a15-437d-8503-db38b070f805 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:10.359548 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b7c53-a58a-44a0-bf27-588efdeb59d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:10.360388 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b7c53-a58a-44a0-bf27-588efdeb59d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:10.360816 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b7c53-a58a-44a0-bf27-588efdeb59d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:10.361235 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b7c53-a58a-44a0-bf27-588efdeb59d8 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:10.362238 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b7c53-a58a-44a0-bf27-588efdeb59d8 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:10.362687 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b7c53-a58a-44a0-bf27-588efdeb59d8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:10.364729 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b7c53-a58a-44a0-bf27-588efdeb59d8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:10.382934 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 426/849] 10.222.0.30 () {56 vars in 1170 bytes} [Fri Oct 15 03:27:10 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:10.389580 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e9a37-cf2f-4b0d-b59e-f5d7cc10506c admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:10.399459 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e9a37-cf2f-4b0d-b59e-f5d7cc10506c admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:10.404150 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a024ce-a950-402f-96e0-ae9d3ee6f30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:10.404943 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a024ce-a950-402f-96e0-ae9d3ee6f30b admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:10.405344 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a024ce-a950-402f-96e0-ae9d3ee6f30b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:10.405717 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a024ce-a950-402f-96e0-ae9d3ee6f30b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:10.413692 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a024ce-a950-402f-96e0-ae9d3ee6f30b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:10.415622 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a024ce-a950-402f-96e0-ae9d3ee6f30b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:10.431791 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 424/850] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:27:10 2021] GET /identity/v3/auth/tokens => generated 2291 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:27:10.435346 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b7c53-a58a-44a0-bf27-588efdeb59d8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:10.446111 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b7c53-a58a-44a0-bf27-588efdeb59d8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:10.451120 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359afae5-6cf0-45ae-a94e-db1e40161a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:10.452163 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359afae5-6cf0-45ae-a94e-db1e40161a88 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:10.452657 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359afae5-6cf0-45ae-a94e-db1e40161a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:10.453106 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359afae5-6cf0-45ae-a94e-db1e40161a88 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:10.464735 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359afae5-6cf0-45ae-a94e-db1e40161a88 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:10.466832 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359afae5-6cf0-45ae-a94e-db1e40161a88 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:10.484759 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-359afae5-6cf0-45ae-a94e-db1e40161a88 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:27:10.487215 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 427/851] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:10.493823 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a024ce-a950-402f-96e0-ae9d3ee6f30b admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:10.503170 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a024ce-a950-402f-96e0-ae9d3ee6f30b admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:10.508575 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11aaf5e-8dff-47f6-a519-2b6384ac623d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:10.509308 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11aaf5e-8dff-47f6-a519-2b6384ac623d admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:10.509649 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11aaf5e-8dff-47f6-a519-2b6384ac623d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:10.509984 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11aaf5e-8dff-47f6-a519-2b6384ac623d admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:10.510771 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11aaf5e-8dff-47f6-a519-2b6384ac623d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:10.511134 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11aaf5e-8dff-47f6-a519-2b6384ac623d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:10.512927 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11aaf5e-8dff-47f6-a519-2b6384ac623d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:10.530099 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 425/852] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:27:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:27:10.531402 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359afae5-6cf0-45ae-a94e-db1e40161a88 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:10.541766 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359afae5-6cf0-45ae-a94e-db1e40161a88 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:10.546594 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f545ab-842a-41e1-8ca8-c9bfdcae0e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:10.547616 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f545ab-842a-41e1-8ca8-c9bfdcae0e08 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:10.548153 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f545ab-842a-41e1-8ca8-c9bfdcae0e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:10.548631 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f545ab-842a-41e1-8ca8-c9bfdcae0e08 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:10.556310 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f545ab-842a-41e1-8ca8-c9bfdcae0e08 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:10.558500 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f545ab-842a-41e1-8ca8-c9bfdcae0e08 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:10.573885 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-f2f545ab-842a-41e1-8ca8-c9bfdcae0e08 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:27:10.575714 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 428/853] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:27:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:10.585758 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11aaf5e-8dff-47f6-a519-2b6384ac623d admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:10.596308 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11aaf5e-8dff-47f6-a519-2b6384ac623d admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:10.601344 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03caf87-a65a-479f-a8c0-30a7337aec0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:10.602759 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03caf87-a65a-479f-a8c0-30a7337aec0d admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:10.603184 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03caf87-a65a-479f-a8c0-30a7337aec0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:10.603641 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03caf87-a65a-479f-a8c0-30a7337aec0d admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:10.604674 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03caf87-a65a-479f-a8c0-30a7337aec0d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:10.605164 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03caf87-a65a-479f-a8c0-30a7337aec0d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:10.607247 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03caf87-a65a-479f-a8c0-30a7337aec0d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:10.620262 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 426/854] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:27:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:10.627092 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f545ab-842a-41e1-8ca8-c9bfdcae0e08 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:10.638922 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f545ab-842a-41e1-8ca8-c9bfdcae0e08 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:10.643720 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff3318-62f0-4727-b555-9fc91869aafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:10.644537 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff3318-62f0-4727-b555-9fc91869aafc admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:10.644956 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff3318-62f0-4727-b555-9fc91869aafc admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:10.645366 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff3318-62f0-4727-b555-9fc91869aafc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:10.646386 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff3318-62f0-4727-b555-9fc91869aafc admin admin] RBAC: Adding query filter params (role.id=9ac52cb6a0744b1797edbae9fd88349b, scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user.id=3f598b94a850413494da575188706cb1) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:10.646855 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff3318-62f0-4727-b555-9fc91869aafc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:10.649605 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff3318-62f0-4727-b555-9fc91869aafc admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:10.659817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 429/855] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:27:10 2021] GET /identity/v3/role_assignments?user.id=3f598b94a850413494da575188706cb1&scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20&role.id=9ac52cb6a0744b1797edbae9fd88349b => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:11.083590 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad916297-5816-4589-9c34-858790947f2a None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:11.083951 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad916297-5816-4589-9c34-858790947f2a None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:11.084176 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad916297-5816-4589-9c34-858790947f2a None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:11.086243 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 427/856] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:11.092098 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf21d58-5100-4fb0-aac5-75ab0a5ca1bb None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:11.092392 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf21d58-5100-4fb0-aac5-75ab0a5ca1bb None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:11.092674 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf21d58-5100-4fb0-aac5-75ab0a5ca1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:11.110544 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-4cf21d58-5100-4fb0-aac5-75ab0a5ca1bb None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:11.111812 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-4cf21d58-5100-4fb0-aac5-75ab0a5ca1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:11.120255 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 430/857] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:11 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:11.143476 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad916297-5816-4589-9c34-858790947f2a None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:11.156392 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad916297-5816-4589-9c34-858790947f2a None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:11.160801 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654556e-a00f-46d7-9ba6-70b96bc74607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:11.161625 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654556e-a00f-46d7-9ba6-70b96bc74607 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:11.161911 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654556e-a00f-46d7-9ba6-70b96bc74607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:11.162185 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654556e-a00f-46d7-9ba6-70b96bc74607 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:11.162892 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654556e-a00f-46d7-9ba6-70b96bc74607 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:11.165088 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654556e-a00f-46d7-9ba6-70b96bc74607 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:11.175848 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-2654556e-a00f-46d7-9ba6-70b96bc74607 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 15 03:27:11.177225 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 428/858] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:27:11 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:11.183564 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf21d58-5100-4fb0-aac5-75ab0a5ca1bb None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:11.192592 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf21d58-5100-4fb0-aac5-75ab0a5ca1bb None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:11.197240 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c12431-b80a-422d-9cb7-86a7104f0f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:11.197885 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c12431-b80a-422d-9cb7-86a7104f0f87 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:11.198166 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c12431-b80a-422d-9cb7-86a7104f0f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:11.198438 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c12431-b80a-422d-9cb7-86a7104f0f87 admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:11.199150 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c12431-b80a-422d-9cb7-86a7104f0f87 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:11.199451 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c12431-b80a-422d-9cb7-86a7104f0f87 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:11.201190 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c12431-b80a-422d-9cb7-86a7104f0f87 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:11.206227 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 431/859] 10.222.0.30 () {56 vars in 1133 bytes} [Fri Oct 15 03:27:11 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:11.212897 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654556e-a00f-46d7-9ba6-70b96bc74607 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:11.222670 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654556e-a00f-46d7-9ba6-70b96bc74607 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:11.228111 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdd979-9571-452c-a70f-5c18f0e1c1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:11.228759 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdd979-9571-452c-a70f-5c18f0e1c1cf admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:11.229043 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdd979-9571-452c-a70f-5c18f0e1c1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:11.229323 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdd979-9571-452c-a70f-5c18f0e1c1cf admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:11.230147 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdd979-9571-452c-a70f-5c18f0e1c1cf admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:11.230459 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdd979-9571-452c-a70f-5c18f0e1c1cf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:11.232153 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdd979-9571-452c-a70f-5c18f0e1c1cf admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:11.237173 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 429/860] 10.222.0.30 () {56 vars in 1133 bytes} [Fri Oct 15 03:27:11 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:11.982952 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03497b0d-1390-4167-ad78-3ec69f1587b7 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:11.983700 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03497b0d-1390-4167-ad78-3ec69f1587b7 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:11.983700 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03497b0d-1390-4167-ad78-3ec69f1587b7 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:11.985516 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 432/861] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:11.991437 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f624c53-21c7-4ce0-8877-5526cace4083 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:11.991989 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f624c53-21c7-4ce0-8877-5526cace4083 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:11.991989 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f624c53-21c7-4ce0-8877-5526cace4083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:12.010137 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-4f624c53-21c7-4ce0-8877-5526cace4083 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:12.011662 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-4f624c53-21c7-4ce0-8877-5526cace4083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:12.019906 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 430/862] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:11 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:27:12.044340 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03497b0d-1390-4167-ad78-3ec69f1587b7 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:12.057265 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03497b0d-1390-4167-ad78-3ec69f1587b7 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:12.061670 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcbd95-c25c-47fe-9012-817254a7318e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:12.062314 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcbd95-c25c-47fe-9012-817254a7318e admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:12.062589 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcbd95-c25c-47fe-9012-817254a7318e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:12.062857 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcbd95-c25c-47fe-9012-817254a7318e admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:12.063577 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adcbd95-c25c-47fe-9012-817254a7318e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:12.065447 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adcbd95-c25c-47fe-9012-817254a7318e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:12.066785 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.common [None req-0adcbd95-c25c-47fe-9012-817254a7318e admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 15 03:27:12.085802 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.sql.core [None req-0adcbd95-c25c-47fe-9012-817254a7318e admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 15 03:27:12.085802 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 15 03:27:12.085802 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [parameters: {'id': '8dbe90bd7bcb488aabe05495ec781532', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 15 03:27:12.085802 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79362) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 15 03:27:12.101703 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-0adcbd95-c25c-47fe-9012-817254a7318e admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8dbe90bd7bcb488aabe05495ec781532.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8dbe90bd7bcb488aabe05495ec781532. Oct 15 03:27:12.103454 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 433/863] 10.222.0.30 () {60 vars in 1161 bytes} [Fri Oct 15 03:27:12 2021] POST /identity/v3/projects => generated 262 bytes in 59 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:12.110048 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f624c53-21c7-4ce0-8877-5526cace4083 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:12.123134 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f624c53-21c7-4ce0-8877-5526cace4083 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:12.128146 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc047fe-90f5-4419-a17f-15e29be9814a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:12.129140 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc047fe-90f5-4419-a17f-15e29be9814a admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:12.129592 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc047fe-90f5-4419-a17f-15e29be9814a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:12.130034 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc047fe-90f5-4419-a17f-15e29be9814a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:12.138229 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc047fe-90f5-4419-a17f-15e29be9814a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:12.140479 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc047fe-90f5-4419-a17f-15e29be9814a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:12.153925 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-9bc047fe-90f5-4419-a17f-15e29be9814a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:27:12.155576 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 431/864] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:27:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:12.162369 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcbd95-c25c-47fe-9012-817254a7318e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:12.174496 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcbd95-c25c-47fe-9012-817254a7318e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:12.179252 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b4d29-0c32-40cb-b3eb-b0cda46ae1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:12.180707 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b4d29-0c32-40cb-b3eb-b0cda46ae1bb admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:12.181162 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b4d29-0c32-40cb-b3eb-b0cda46ae1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:12.181612 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b4d29-0c32-40cb-b3eb-b0cda46ae1bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:12.182566 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b4d29-0c32-40cb-b3eb-b0cda46ae1bb admin admin] RBAC: Adding query filter params (name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:12.183036 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b4d29-0c32-40cb-b3eb-b0cda46ae1bb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:12.185395 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b4d29-0c32-40cb-b3eb-b0cda46ae1bb admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:12.206004 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 434/865] 10.222.0.30 () {56 vars in 1133 bytes} [Fri Oct 15 03:27:12 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:12.490669 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233b23a-98d6-498e-973f-d16868545705 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:12.490953 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233b23a-98d6-498e-973f-d16868545705 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:12.491236 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233b23a-98d6-498e-973f-d16868545705 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:12.493920 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 432/866] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:12.500027 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c2252-4162-484b-9b0c-4768902ee1fe None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:12.500316 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c2252-4162-484b-9b0c-4768902ee1fe None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:12.500590 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c2252-4162-484b-9b0c-4768902ee1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:12.519336 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-429c2252-4162-484b-9b0c-4768902ee1fe None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:12.521076 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-429c2252-4162-484b-9b0c-4768902ee1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:12.529518 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 435/867] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:12 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:12.553245 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233b23a-98d6-498e-973f-d16868545705 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:12.568110 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233b23a-98d6-498e-973f-d16868545705 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:12.573119 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a247015-ce7e-4028-996e-8f177c4cdd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:12.573902 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a247015-ce7e-4028-996e-8f177c4cdd6f admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:12.574187 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a247015-ce7e-4028-996e-8f177c4cdd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:12.574460 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a247015-ce7e-4028-996e-8f177c4cdd6f admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:12.575112 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a247015-ce7e-4028-996e-8f177c4cdd6f admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:12.576741 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a247015-ce7e-4028-996e-8f177c4cdd6f admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:12.588257 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-8a247015-ce7e-4028-996e-8f177c4cdd6f admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 15 03:27:12.589758 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 433/868] 10.222.0.30 () {56 vars in 1147 bytes} [Fri Oct 15 03:27:12 2021] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:12.596499 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c2252-4162-484b-9b0c-4768902ee1fe None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:12.606035 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c2252-4162-484b-9b0c-4768902ee1fe None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:12.610868 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a74a5-f935-4a22-b43b-ff4df92b2377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:12.611585 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a74a5-f935-4a22-b43b-ff4df92b2377 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:12.611911 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a74a5-f935-4a22-b43b-ff4df92b2377 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:12.612241 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a74a5-f935-4a22-b43b-ff4df92b2377 admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:12.613022 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a74a5-f935-4a22-b43b-ff4df92b2377 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:12.613329 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a74a5-f935-4a22-b43b-ff4df92b2377 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:12.614975 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a74a5-f935-4a22-b43b-ff4df92b2377 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:12.621131 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 436/869] 10.222.0.30 () {56 vars in 1143 bytes} [Fri Oct 15 03:27:12 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:12.627472 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a247015-ce7e-4028-996e-8f177c4cdd6f admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:12.638156 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a247015-ce7e-4028-996e-8f177c4cdd6f admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:12.642885 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0a2f7-6b99-422a-9633-6f5d201957d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:12.643583 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0a2f7-6b99-422a-9633-6f5d201957d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:12.643944 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0a2f7-6b99-422a-9633-6f5d201957d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:12.644221 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0a2f7-6b99-422a-9633-6f5d201957d7 admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:12.644934 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0a2f7-6b99-422a-9633-6f5d201957d7 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:12.645292 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0a2f7-6b99-422a-9633-6f5d201957d7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:12.646952 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0a2f7-6b99-422a-9633-6f5d201957d7 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:12.652486 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 434/870] 10.222.0.30 () {56 vars in 1143 bytes} [Fri Oct 15 03:27:12 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:12.658979 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a74a5-f935-4a22-b43b-ff4df92b2377 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:12.669042 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a74a5-f935-4a22-b43b-ff4df92b2377 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:12.673878 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc14ed9-e95d-4a06-bd19-c50b103e114a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:12.674519 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc14ed9-e95d-4a06-bd19-c50b103e114a admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:12.674802 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc14ed9-e95d-4a06-bd19-c50b103e114a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:12.675132 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc14ed9-e95d-4a06-bd19-c50b103e114a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:12.676039 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc14ed9-e95d-4a06-bd19-c50b103e114a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:12.677681 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc14ed9-e95d-4a06-bd19-c50b103e114a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:12.701707 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 437/871] 10.222.0.30 () {60 vars in 1165 bytes} [Fri Oct 15 03:27:12 2021] POST /identity/v3/endpoints => generated 349 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:27:13.056038 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035977f1-fe9b-4910-8315-7306604a0caa None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:13.056828 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035977f1-fe9b-4910-8315-7306604a0caa None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:13.056828 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035977f1-fe9b-4910-8315-7306604a0caa None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:13.058594 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 435/872] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:13.064790 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfea986-3e23-4ec1-975f-3c64266bf598 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:13.065291 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfea986-3e23-4ec1-975f-3c64266bf598 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:13.065450 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfea986-3e23-4ec1-975f-3c64266bf598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:13.087249 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-4cfea986-3e23-4ec1-975f-3c64266bf598 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:13.088885 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-4cfea986-3e23-4ec1-975f-3c64266bf598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:13.110257 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 438/873] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:13 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:13.133871 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035977f1-fe9b-4910-8315-7306604a0caa None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:13.146434 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035977f1-fe9b-4910-8315-7306604a0caa None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:13.150925 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e6573-cb83-4f28-a7f7-595a6e94a3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:13.151776 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e6573-cb83-4f28-a7f7-595a6e94a3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:13.152060 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e6573-cb83-4f28-a7f7-595a6e94a3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:13.152335 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e6573-cb83-4f28-a7f7-595a6e94a3e2 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:13.153053 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e6573-cb83-4f28-a7f7-595a6e94a3e2 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:13.154707 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e6573-cb83-4f28-a7f7-595a6e94a3e2 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:13.166169 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-7f3e6573-cb83-4f28-a7f7-595a6e94a3e2 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 15 03:27:13.167723 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 436/874] 10.222.0.30 () {56 vars in 1126 bytes} [Fri Oct 15 03:27:13 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:13.174394 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfea986-3e23-4ec1-975f-3c64266bf598 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:13.184241 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfea986-3e23-4ec1-975f-3c64266bf598 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:13.189042 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9753b-b366-4289-b8c9-7de41d1ffa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:13.189696 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9753b-b366-4289-b8c9-7de41d1ffa6d admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:13.189974 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9753b-b366-4289-b8c9-7de41d1ffa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:13.190248 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9753b-b366-4289-b8c9-7de41d1ffa6d admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:13.191021 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9753b-b366-4289-b8c9-7de41d1ffa6d admin admin] RBAC: Adding query filter params (name=image) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:13.191327 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9753b-b366-4289-b8c9-7de41d1ffa6d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:13.193009 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9753b-b366-4289-b8c9-7de41d1ffa6d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:13.198392 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 439/875] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:13 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:13.204639 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e6573-cb83-4f28-a7f7-595a6e94a3e2 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:13.214953 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e6573-cb83-4f28-a7f7-595a6e94a3e2 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:13.219892 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b2232-9831-4022-8336-be9cce1fb782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:13.220542 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b2232-9831-4022-8336-be9cce1fb782 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:13.221017 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b2232-9831-4022-8336-be9cce1fb782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:13.221299 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b2232-9831-4022-8336-be9cce1fb782 admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:13.222078 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b2232-9831-4022-8336-be9cce1fb782 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:13.222384 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b2232-9831-4022-8336-be9cce1fb782 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:13.224386 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b2232-9831-4022-8336-be9cce1fb782 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:13.235465 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 437/876] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:13 2021] GET /identity/v3/services?type=image => generated 122 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:27:13.575848 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3e6da-ebef-4e1b-981a-e0d12854860a None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:13.576252 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3e6da-ebef-4e1b-981a-e0d12854860a None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:13.576432 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3e6da-ebef-4e1b-981a-e0d12854860a None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:13.578435 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 440/877] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:13.584395 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fc006-2095-4b98-8503-c154d664935b None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:13.584683 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fc006-2095-4b98-8503-c154d664935b None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:13.584943 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fc006-2095-4b98-8503-c154d664935b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:13.604254 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-aa8fc006-2095-4b98-8503-c154d664935b None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:13.605440 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-aa8fc006-2095-4b98-8503-c154d664935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:13.619789 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 438/878] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:13 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:27:13.637636 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3e6da-ebef-4e1b-981a-e0d12854860a None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:13.650582 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3e6da-ebef-4e1b-981a-e0d12854860a None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:13.654959 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946a4b0-959e-4941-8d3f-a2389fd99232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:13.655604 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946a4b0-959e-4941-8d3f-a2389fd99232 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:13.655937 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946a4b0-959e-4941-8d3f-a2389fd99232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:13.656210 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946a4b0-959e-4941-8d3f-a2389fd99232 admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:13.656949 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946a4b0-959e-4941-8d3f-a2389fd99232 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:13.658531 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946a4b0-959e-4941-8d3f-a2389fd99232 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:13.683798 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 441/879] 10.222.0.30 () {60 vars in 1162 bytes} [Fri Oct 15 03:27:13 2021] POST /identity/v3/services => generated 242 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:27:14.608920 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92b8b4-077f-4723-bb9c-59c3dd6c000a None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:14.608920 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92b8b4-077f-4723-bb9c-59c3dd6c000a None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:14.608920 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92b8b4-077f-4723-bb9c-59c3dd6c000a None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:14.608920 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 439/880] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:14.618675 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ec104-8d9c-44c0-bee6-34b1e428e1c8 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:14.618675 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ec104-8d9c-44c0-bee6-34b1e428e1c8 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:14.618675 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ec104-8d9c-44c0-bee6-34b1e428e1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:14.636163 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-f65ec104-8d9c-44c0-bee6-34b1e428e1c8 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:14.637648 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-f65ec104-8d9c-44c0-bee6-34b1e428e1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:14.659821 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 442/881] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:14 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:14.681619 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92b8b4-077f-4723-bb9c-59c3dd6c000a None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:14.694136 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92b8b4-077f-4723-bb9c-59c3dd6c000a None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:14.699157 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84957ea0-9068-4632-8d1a-5b7d13388aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:14.700108 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84957ea0-9068-4632-8d1a-5b7d13388aef admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:14.700584 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84957ea0-9068-4632-8d1a-5b7d13388aef admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:14.701050 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84957ea0-9068-4632-8d1a-5b7d13388aef admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:14.701967 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84957ea0-9068-4632-8d1a-5b7d13388aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:14.704048 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84957ea0-9068-4632-8d1a-5b7d13388aef admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:14.705551 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.common [None req-84957ea0-9068-4632-8d1a-5b7d13388aef admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 15 03:27:14.718897 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.sql.core [None req-84957ea0-9068-4632-8d1a-5b7d13388aef admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 15 03:27:14.718897 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 15 03:27:14.718897 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [parameters: {'user_id': '8700d3a3a5744a0aa13d3e77997e378f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 15 03:27:14.718897 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79361) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 15 03:27:14.725859 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-84957ea0-9068-4632-8d1a-5b7d13388aef admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 15 03:27:14.727648 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 440/882] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:27:14 2021] POST /identity/v3/users => generated 160 bytes in 46 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:14.734580 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ec104-8d9c-44c0-bee6-34b1e428e1c8 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:14.744759 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ec104-8d9c-44c0-bee6-34b1e428e1c8 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:14.749642 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3ee01-7aa1-4300-a916-abb8ac420318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:14.750714 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3ee01-7aa1-4300-a916-abb8ac420318 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:14.751196 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3ee01-7aa1-4300-a916-abb8ac420318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:14.751718 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3ee01-7aa1-4300-a916-abb8ac420318 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:14.760458 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3ee01-7aa1-4300-a916-abb8ac420318 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:14.762773 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3ee01-7aa1-4300-a916-abb8ac420318 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:14.776971 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-32f3ee01-7aa1-4300-a916-abb8ac420318 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 15 03:27:14.778676 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 443/883] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:27:14 2021] GET /identity/v3/users/cinder => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:14.785573 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84957ea0-9068-4632-8d1a-5b7d13388aef admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:14.796622 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84957ea0-9068-4632-8d1a-5b7d13388aef admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:14.801939 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc530bd0-4968-4819-8ca6-48e9c2678113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:14.802935 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc530bd0-4968-4819-8ca6-48e9c2678113 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:14.803422 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc530bd0-4968-4819-8ca6-48e9c2678113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:14.803948 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc530bd0-4968-4819-8ca6-48e9c2678113 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:14.805591 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc530bd0-4968-4819-8ca6-48e9c2678113 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:14.806104 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc530bd0-4968-4819-8ca6-48e9c2678113 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:14.808503 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc530bd0-4968-4819-8ca6-48e9c2678113 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:14.849937 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 441/884] 10.222.0.30 () {56 vars in 1122 bytes} [Fri Oct 15 03:27:14 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:15.044829 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507bd9b-17cc-472f-b783-27ae04e8eb48 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:15.045200 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507bd9b-17cc-472f-b783-27ae04e8eb48 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:15.045395 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507bd9b-17cc-472f-b783-27ae04e8eb48 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:15.047470 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 444/885] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:15.054351 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ba4a7-497e-48b4-ae9b-2810e31b563b None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:15.054351 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ba4a7-497e-48b4-ae9b-2810e31b563b None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:15.055125 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ba4a7-497e-48b4-ae9b-2810e31b563b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:15.073895 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-9b7ba4a7-497e-48b4-ae9b-2810e31b563b None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:15.075424 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-9b7ba4a7-497e-48b4-ae9b-2810e31b563b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:15.083597 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 442/886] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:15 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:15.110655 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507bd9b-17cc-472f-b783-27ae04e8eb48 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:15.123792 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507bd9b-17cc-472f-b783-27ae04e8eb48 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:15.128339 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11750520-3042-45d5-bfc6-bb12b1218efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:15.129159 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11750520-3042-45d5-bfc6-bb12b1218efe admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:15.129410 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11750520-3042-45d5-bfc6-bb12b1218efe admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:15.129685 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11750520-3042-45d5-bfc6-bb12b1218efe admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:15.130349 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11750520-3042-45d5-bfc6-bb12b1218efe admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:15.131981 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11750520-3042-45d5-bfc6-bb12b1218efe admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:15.145728 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-11750520-3042-45d5-bfc6-bb12b1218efe admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 15 03:27:15.147055 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 445/887] 10.222.0.30 () {56 vars in 1147 bytes} [Fri Oct 15 03:27:15 2021] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:15.154437 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ba4a7-497e-48b4-ae9b-2810e31b563b None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:15.164268 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ba4a7-497e-48b4-ae9b-2810e31b563b None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:15.169918 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39785100-c8a8-4d0e-b036-5a36b8916b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:15.170832 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39785100-c8a8-4d0e-b036-5a36b8916b01 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:15.171318 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39785100-c8a8-4d0e-b036-5a36b8916b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:15.171865 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39785100-c8a8-4d0e-b036-5a36b8916b01 admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:15.172801 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39785100-c8a8-4d0e-b036-5a36b8916b01 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:15.173325 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39785100-c8a8-4d0e-b036-5a36b8916b01 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:15.175127 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39785100-c8a8-4d0e-b036-5a36b8916b01 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:15.180885 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 443/888] 10.222.0.30 () {56 vars in 1143 bytes} [Fri Oct 15 03:27:15 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:15.187530 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11750520-3042-45d5-bfc6-bb12b1218efe admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:15.198093 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11750520-3042-45d5-bfc6-bb12b1218efe admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:15.202848 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9ba01-ce42-4a1f-8bd9-a88ae1f769db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:15.203779 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9ba01-ce42-4a1f-8bd9-a88ae1f769db admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:15.204214 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9ba01-ce42-4a1f-8bd9-a88ae1f769db admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:15.204646 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9ba01-ce42-4a1f-8bd9-a88ae1f769db admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:15.205505 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9ba01-ce42-4a1f-8bd9-a88ae1f769db admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:15.205977 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9ba01-ce42-4a1f-8bd9-a88ae1f769db admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:15.207734 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9ba01-ce42-4a1f-8bd9-a88ae1f769db admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:15.213348 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 446/889] 10.222.0.30 () {56 vars in 1143 bytes} [Fri Oct 15 03:27:15 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:15.219960 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39785100-c8a8-4d0e-b036-5a36b8916b01 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:15.229828 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39785100-c8a8-4d0e-b036-5a36b8916b01 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:15.237462 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea37c07-0d43-401b-8962-00df21f4a874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:15.238183 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea37c07-0d43-401b-8962-00df21f4a874 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:15.238531 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea37c07-0d43-401b-8962-00df21f4a874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:15.238924 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea37c07-0d43-401b-8962-00df21f4a874 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:15.239825 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea37c07-0d43-401b-8962-00df21f4a874 admin admin] RBAC: Adding query filter params (interface=admin, service_id=1d40eb4b6f10454cbcdce5d96cb18c85, region_id=RegionOne) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:15.240199 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea37c07-0d43-401b-8962-00df21f4a874 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:15.241913 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea37c07-0d43-401b-8962-00df21f4a874 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:15.247451 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 444/890] 10.222.0.30 () {56 vars in 1270 bytes} [Fri Oct 15 03:27:15 2021] GET /identity/v3/endpoints?service_id=1d40eb4b6f10454cbcdce5d96cb18c85&interface=admin®ion_id=RegionOne => generated 193 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:15.253449 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9ba01-ce42-4a1f-8bd9-a88ae1f769db admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:15.263716 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9ba01-ce42-4a1f-8bd9-a88ae1f769db admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:15.268062 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b319c-fe04-4aa5-befa-37149e677a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:15.268697 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b319c-fe04-4aa5-befa-37149e677a10 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:15.268972 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b319c-fe04-4aa5-befa-37149e677a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:15.269244 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b319c-fe04-4aa5-befa-37149e677a10 admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:15.269923 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b319c-fe04-4aa5-befa-37149e677a10 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:15.271493 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b319c-fe04-4aa5-befa-37149e677a10 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:15.278528 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 447/891] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Oct 15 03:27:15 2021] GET /identity/v3/services => generated 1727 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:27:15.585186 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee9023-d6b0-41db-adf0-38b56a3ad7aa None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:15.585550 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee9023-d6b0-41db-adf0-38b56a3ad7aa None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:15.585749 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee9023-d6b0-41db-adf0-38b56a3ad7aa None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:15.587608 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 445/892] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:15.593372 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31ab93-0818-474f-b6b2-df1c638fb6fa None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:15.593665 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31ab93-0818-474f-b6b2-df1c638fb6fa None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:15.593947 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31ab93-0818-474f-b6b2-df1c638fb6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:15.611836 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-1d31ab93-0818-474f-b6b2-df1c638fb6fa None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:15.613024 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-1d31ab93-0818-474f-b6b2-df1c638fb6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:15.621172 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 448/893] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:15 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:15.645593 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee9023-d6b0-41db-adf0-38b56a3ad7aa None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:15.658434 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee9023-d6b0-41db-adf0-38b56a3ad7aa None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:15.662808 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db7d58-2187-497e-9307-32e4150a1cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:15.663456 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db7d58-2187-497e-9307-32e4150a1cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:15.663769 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db7d58-2187-497e-9307-32e4150a1cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:15.664614 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db7d58-2187-497e-9307-32e4150a1cc4 admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:15.665355 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db7d58-2187-497e-9307-32e4150a1cc4 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:15.666937 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db7d58-2187-497e-9307-32e4150a1cc4 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:15.680062 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 446/894] 10.222.0.30 () {60 vars in 1162 bytes} [Fri Oct 15 03:27:15 2021] POST /identity/v3/services => generated 242 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:27:15.983253 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992c081-1e33-41e4-9965-b50263b71a36 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:15.983581 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992c081-1e33-41e4-9965-b50263b71a36 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:15.983778 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992c081-1e33-41e4-9965-b50263b71a36 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:15.985519 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 449/895] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:15.991613 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f430883-6cc4-480b-8017-e42834662e6d None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:15.991926 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f430883-6cc4-480b-8017-e42834662e6d None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:15.992258 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f430883-6cc4-480b-8017-e42834662e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:16.009883 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-8f430883-6cc4-480b-8017-e42834662e6d None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:16.011045 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-8f430883-6cc4-480b-8017-e42834662e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:16.028083 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 447/896] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:15 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:16.052129 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992c081-1e33-41e4-9965-b50263b71a36 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:16.064533 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992c081-1e33-41e4-9965-b50263b71a36 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:16.068755 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4583dd-b644-419c-85f8-353422d65e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:16.069513 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4583dd-b644-419c-85f8-353422d65e17 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:16.069787 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4583dd-b644-419c-85f8-353422d65e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:16.070054 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4583dd-b644-419c-85f8-353422d65e17 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:16.071270 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4583dd-b644-419c-85f8-353422d65e17 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:16.072886 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4583dd-b644-419c-85f8-353422d65e17 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:16.083414 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-fd4583dd-b644-419c-85f8-353422d65e17 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 15 03:27:16.084614 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 450/897] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:27:16 2021] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:16.091666 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f430883-6cc4-480b-8017-e42834662e6d None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:16.100757 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f430883-6cc4-480b-8017-e42834662e6d None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:16.105115 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c38b94-f123-4213-8ec5-d7e27e7a54d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:16.105756 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c38b94-f123-4213-8ec5-d7e27e7a54d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:16.106038 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c38b94-f123-4213-8ec5-d7e27e7a54d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:16.106313 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c38b94-f123-4213-8ec5-d7e27e7a54d7 admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:16.107021 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c38b94-f123-4213-8ec5-d7e27e7a54d7 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:16.107322 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c38b94-f123-4213-8ec5-d7e27e7a54d7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:16.108934 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c38b94-f123-4213-8ec5-d7e27e7a54d7 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:16.113845 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 448/898] 10.222.0.30 () {56 vars in 1133 bytes} [Fri Oct 15 03:27:16 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:16.120248 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4583dd-b644-419c-85f8-353422d65e17 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:16.130163 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4583dd-b644-419c-85f8-353422d65e17 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:16.135348 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fada33d-5fd5-4e5b-ac80-548487510bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:16.136024 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fada33d-5fd5-4e5b-ac80-548487510bbf admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:16.136311 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fada33d-5fd5-4e5b-ac80-548487510bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:16.136589 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fada33d-5fd5-4e5b-ac80-548487510bbf admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:16.137308 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fada33d-5fd5-4e5b-ac80-548487510bbf admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:16.137611 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fada33d-5fd5-4e5b-ac80-548487510bbf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:16.139267 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fada33d-5fd5-4e5b-ac80-548487510bbf admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:16.145358 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 451/899] 10.222.0.30 () {56 vars in 1133 bytes} [Fri Oct 15 03:27:16 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:27:16.151663 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c38b94-f123-4213-8ec5-d7e27e7a54d7 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:16.161236 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c38b94-f123-4213-8ec5-d7e27e7a54d7 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:16.166118 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771c1b4-cea5-42aa-a66e-1e4f6ff25ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:16.166755 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771c1b4-cea5-42aa-a66e-1e4f6ff25ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:16.167034 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771c1b4-cea5-42aa-a66e-1e4f6ff25ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:16.167309 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771c1b4-cea5-42aa-a66e-1e4f6ff25ac0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:16.168123 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771c1b4-cea5-42aa-a66e-1e4f6ff25ac0 admin admin] RBAC: Adding query filter params (interface=public, service_id=abf68bf799764fdd9df50f2b545cb806, region_id=RegionOne) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:16.168433 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771c1b4-cea5-42aa-a66e-1e4f6ff25ac0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:16.170005 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771c1b4-cea5-42aa-a66e-1e4f6ff25ac0 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:16.174954 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 449/900] 10.222.0.30 () {56 vars in 1272 bytes} [Fri Oct 15 03:27:16 2021] GET /identity/v3/endpoints?service_id=abf68bf799764fdd9df50f2b545cb806&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:16.181421 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fada33d-5fd5-4e5b-ac80-548487510bbf admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:16.190905 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fada33d-5fd5-4e5b-ac80-548487510bbf admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:16.195354 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ddd15-ae45-4de4-b410-0870f77daa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:16.196020 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ddd15-ae45-4de4-b410-0870f77daa1c admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:16.196310 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ddd15-ae45-4de4-b410-0870f77daa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:16.196573 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ddd15-ae45-4de4-b410-0870f77daa1c admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:16.197252 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ddd15-ae45-4de4-b410-0870f77daa1c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:16.198820 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ddd15-ae45-4de4-b410-0870f77daa1c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:16.205359 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 452/901] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Oct 15 03:27:16 2021] GET /identity/v3/services => generated 1957 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:27:17.559380 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ff7d8-0bd8-4d16-8ae7-239a0e27ddd0 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:17.559905 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ff7d8-0bd8-4d16-8ae7-239a0e27ddd0 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:17.559905 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ff7d8-0bd8-4d16-8ae7-239a0e27ddd0 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:17.561828 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 450/902] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:17.567505 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8ef2a-43d2-4b3f-a9f8-ca016469137d None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:17.567917 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8ef2a-43d2-4b3f-a9f8-ca016469137d None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:17.568090 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8ef2a-43d2-4b3f-a9f8-ca016469137d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:17.586689 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-38c8ef2a-43d2-4b3f-a9f8-ca016469137d None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:17.587887 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-38c8ef2a-43d2-4b3f-a9f8-ca016469137d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:17.595808 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 453/903] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:17 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:17.619769 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ff7d8-0bd8-4d16-8ae7-239a0e27ddd0 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:17.631759 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ff7d8-0bd8-4d16-8ae7-239a0e27ddd0 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:17.636641 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dff76f-c44e-406c-84d7-9bfbe48d97be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:17.637477 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dff76f-c44e-406c-84d7-9bfbe48d97be admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:17.637760 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dff76f-c44e-406c-84d7-9bfbe48d97be admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:17.638029 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dff76f-c44e-406c-84d7-9bfbe48d97be admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:17.638675 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dff76f-c44e-406c-84d7-9bfbe48d97be admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:17.640279 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dff76f-c44e-406c-84d7-9bfbe48d97be admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:17.651596 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-03dff76f-c44e-406c-84d7-9bfbe48d97be admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 15 03:27:17.652933 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 451/904] 10.222.0.30 () {56 vars in 1147 bytes} [Fri Oct 15 03:27:17 2021] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:17.659159 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8ef2a-43d2-4b3f-a9f8-ca016469137d None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:17.667915 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8ef2a-43d2-4b3f-a9f8-ca016469137d None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:17.672471 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9eca0-3cb7-4baa-9f45-48d1c3cc49cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:17.673118 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9eca0-3cb7-4baa-9f45-48d1c3cc49cd admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:17.673393 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9eca0-3cb7-4baa-9f45-48d1c3cc49cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:17.673664 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9eca0-3cb7-4baa-9f45-48d1c3cc49cd admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:17.674373 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9eca0-3cb7-4baa-9f45-48d1c3cc49cd admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:17.674670 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9eca0-3cb7-4baa-9f45-48d1c3cc49cd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:17.676271 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9eca0-3cb7-4baa-9f45-48d1c3cc49cd admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:17.681344 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 454/905] 10.222.0.30 () {56 vars in 1143 bytes} [Fri Oct 15 03:27:17 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:17.687402 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dff76f-c44e-406c-84d7-9bfbe48d97be admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:17.697724 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dff76f-c44e-406c-84d7-9bfbe48d97be admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:17.702313 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d35b0f-4409-468a-8f95-fa54beefada2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:17.702951 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d35b0f-4409-468a-8f95-fa54beefada2 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:17.703235 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d35b0f-4409-468a-8f95-fa54beefada2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:17.703512 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d35b0f-4409-468a-8f95-fa54beefada2 admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:17.704278 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d35b0f-4409-468a-8f95-fa54beefada2 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:17.704588 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d35b0f-4409-468a-8f95-fa54beefada2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:17.706198 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d35b0f-4409-468a-8f95-fa54beefada2 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:17.711503 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 452/906] 10.222.0.30 () {56 vars in 1143 bytes} [Fri Oct 15 03:27:17 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:17.717740 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9eca0-3cb7-4baa-9f45-48d1c3cc49cd admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:17.727656 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9eca0-3cb7-4baa-9f45-48d1c3cc49cd admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:17.732462 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7f8fb-2870-4b27-94be-c5d8ca687a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:17.733169 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7f8fb-2870-4b27-94be-c5d8ca687a4c admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:17.733517 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7f8fb-2870-4b27-94be-c5d8ca687a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:17.733876 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7f8fb-2870-4b27-94be-c5d8ca687a4c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:17.734700 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7f8fb-2870-4b27-94be-c5d8ca687a4c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:17.736622 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7f8fb-2870-4b27-94be-c5d8ca687a4c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:17.756157 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 455/907] 10.222.0.30 () {60 vars in 1165 bytes} [Fri Oct 15 03:27:17 2021] POST /identity/v3/endpoints => generated 325 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:27:18.012221 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3aab6-a649-46a3-8fd4-1ed35ae5703b None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:18.012600 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3aab6-a649-46a3-8fd4-1ed35ae5703b None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:18.012781 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3aab6-a649-46a3-8fd4-1ed35ae5703b None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:18.014596 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 453/908] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:18.020467 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785305f-7b1a-452c-a61c-5570a49f30de None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:18.020985 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785305f-7b1a-452c-a61c-5570a49f30de None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:18.021328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785305f-7b1a-452c-a61c-5570a49f30de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:18.040786 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-1785305f-7b1a-452c-a61c-5570a49f30de None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:18.041963 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-1785305f-7b1a-452c-a61c-5570a49f30de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:18.059715 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 456/909] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:18 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:27:18.087517 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3aab6-a649-46a3-8fd4-1ed35ae5703b None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:18.100582 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3aab6-a649-46a3-8fd4-1ed35ae5703b None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:18.105501 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef2be3-0052-4c73-a232-453e03da714b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:18.106274 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef2be3-0052-4c73-a232-453e03da714b admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:18.106559 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef2be3-0052-4c73-a232-453e03da714b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:18.106833 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef2be3-0052-4c73-a232-453e03da714b admin admin] PATH_INFO: `/v3/services/image` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:18.107486 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef2be3-0052-4c73-a232-453e03da714b admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:18.109105 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef2be3-0052-4c73-a232-453e03da714b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:18.119939 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-c0ef2be3-0052-4c73-a232-453e03da714b admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 15 03:27:18.126508 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 454/910] 10.222.0.30 () {56 vars in 1126 bytes} [Fri Oct 15 03:27:18 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:18.128016 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785305f-7b1a-452c-a61c-5570a49f30de None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:18.137767 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785305f-7b1a-452c-a61c-5570a49f30de None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:18.142252 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e9ac4-7b54-4737-8597-8dc56606cc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:18.142967 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e9ac4-7b54-4737-8597-8dc56606cc4d admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:18.143342 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e9ac4-7b54-4737-8597-8dc56606cc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:18.143697 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e9ac4-7b54-4737-8597-8dc56606cc4d admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:18.144486 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e9ac4-7b54-4737-8597-8dc56606cc4d admin admin] RBAC: Adding query filter params (name=image) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:18.144852 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e9ac4-7b54-4737-8597-8dc56606cc4d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:18.146506 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e9ac4-7b54-4737-8597-8dc56606cc4d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:18.152191 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 457/911] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:18 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:18.158374 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef2be3-0052-4c73-a232-453e03da714b admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:18.168384 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef2be3-0052-4c73-a232-453e03da714b admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:18.172786 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1d810-9294-4644-8b10-203bcc82cc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:18.173420 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1d810-9294-4644-8b10-203bcc82cc0b admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:18.173702 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1d810-9294-4644-8b10-203bcc82cc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:18.173974 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1d810-9294-4644-8b10-203bcc82cc0b admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:18.174681 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1d810-9294-4644-8b10-203bcc82cc0b admin admin] RBAC: Adding query filter params (type=image) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:18.174983 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1d810-9294-4644-8b10-203bcc82cc0b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:18.176588 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1d810-9294-4644-8b10-203bcc82cc0b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:18.181773 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 455/912] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:18 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:18.188220 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e9ac4-7b54-4737-8597-8dc56606cc4d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:18.198234 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e9ac4-7b54-4737-8597-8dc56606cc4d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:18.202657 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4928fa-5254-4e59-9aa4-0d28cf4ea9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:18.203286 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4928fa-5254-4e59-9aa4-0d28cf4ea9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:18.203562 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4928fa-5254-4e59-9aa4-0d28cf4ea9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:18.203871 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4928fa-5254-4e59-9aa4-0d28cf4ea9c7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:18.204659 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4928fa-5254-4e59-9aa4-0d28cf4ea9c7 admin admin] RBAC: Adding query filter params (interface=public, service_id=0e44c19b41904140a981ef1884b30a2b, region_id=RegionOne) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:18.204965 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4928fa-5254-4e59-9aa4-0d28cf4ea9c7 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:18.206539 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4928fa-5254-4e59-9aa4-0d28cf4ea9c7 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:18.212104 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 458/913] 10.222.0.30 () {56 vars in 1272 bytes} [Fri Oct 15 03:27:18 2021] GET /identity/v3/endpoints?service_id=0e44c19b41904140a981ef1884b30a2b&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:18.217974 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1d810-9294-4644-8b10-203bcc82cc0b admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:18.227738 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1d810-9294-4644-8b10-203bcc82cc0b admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:18.234950 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504e48a-7ecb-4a11-8dc8-2726ebcedb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:18.235599 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504e48a-7ecb-4a11-8dc8-2726ebcedb2f admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:18.235925 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504e48a-7ecb-4a11-8dc8-2726ebcedb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:18.236197 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504e48a-7ecb-4a11-8dc8-2726ebcedb2f admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:18.236876 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504e48a-7ecb-4a11-8dc8-2726ebcedb2f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:18.240874 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504e48a-7ecb-4a11-8dc8-2726ebcedb2f admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:18.248268 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 456/914] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Oct 15 03:27:18 2021] GET /identity/v3/services => generated 1957 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:27:18.513760 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a910511-48d4-43e4-bf11-57e8501a728a None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:18.514075 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a910511-48d4-43e4-bf11-57e8501a728a None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:18.514318 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a910511-48d4-43e4-bf11-57e8501a728a None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:18.516301 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 459/915] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:18.522009 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2e401-876e-4ddf-a417-99db92c1706f None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:18.522302 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2e401-876e-4ddf-a417-99db92c1706f None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:18.522581 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2e401-876e-4ddf-a417-99db92c1706f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:18.540897 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-79c2e401-876e-4ddf-a417-99db92c1706f None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:18.542075 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-79c2e401-876e-4ddf-a417-99db92c1706f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:18.549814 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 457/916] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:18 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:18.573018 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a910511-48d4-43e4-bf11-57e8501a728a None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:18.585335 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a910511-48d4-43e4-bf11-57e8501a728a None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:18.590276 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9a2f6-74f2-48e4-9045-d33eda284e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:18.591048 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9a2f6-74f2-48e4-9045-d33eda284e59 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:18.591327 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9a2f6-74f2-48e4-9045-d33eda284e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:18.591599 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9a2f6-74f2-48e4-9045-d33eda284e59 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:18.592288 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9a2f6-74f2-48e4-9045-d33eda284e59 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:18.593864 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9a2f6-74f2-48e4-9045-d33eda284e59 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:18.605662 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-02f9a2f6-74f2-48e4-9045-d33eda284e59 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 15 03:27:18.607032 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 460/917] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:27:18 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:18.613376 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2e401-876e-4ddf-a417-99db92c1706f None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:18.623054 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2e401-876e-4ddf-a417-99db92c1706f None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:18.627525 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2c1ce-ee4f-4786-b1d0-5e7690ab459f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:18.628403 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2c1ce-ee4f-4786-b1d0-5e7690ab459f admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:18.628765 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2c1ce-ee4f-4786-b1d0-5e7690ab459f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:18.629095 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2c1ce-ee4f-4786-b1d0-5e7690ab459f admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:18.629879 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2c1ce-ee4f-4786-b1d0-5e7690ab459f admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:18.630249 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2c1ce-ee4f-4786-b1d0-5e7690ab459f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:18.631935 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2c1ce-ee4f-4786-b1d0-5e7690ab459f admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:18.637643 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 458/918] 10.222.0.30 () {56 vars in 1133 bytes} [Fri Oct 15 03:27:18 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:27:18.644019 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9a2f6-74f2-48e4-9045-d33eda284e59 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:18.654070 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9a2f6-74f2-48e4-9045-d33eda284e59 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:18.658560 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2318a4-5187-4d91-b87b-602619680013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:18.659192 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2318a4-5187-4d91-b87b-602619680013 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:18.659469 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2318a4-5187-4d91-b87b-602619680013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:18.659764 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2318a4-5187-4d91-b87b-602619680013 admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:18.660476 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2318a4-5187-4d91-b87b-602619680013 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:18.660776 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2318a4-5187-4d91-b87b-602619680013 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:18.662347 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2318a4-5187-4d91-b87b-602619680013 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:18.667917 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 461/919] 10.222.0.30 () {56 vars in 1133 bytes} [Fri Oct 15 03:27:18 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:27:18.674045 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2c1ce-ee4f-4786-b1d0-5e7690ab459f admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:18.684263 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2c1ce-ee4f-4786-b1d0-5e7690ab459f admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:18.688717 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2596397-5a18-41c3-bfd1-93207016ce02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:18.689404 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2596397-5a18-41c3-bfd1-93207016ce02 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:18.689682 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2596397-5a18-41c3-bfd1-93207016ce02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:18.689999 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2596397-5a18-41c3-bfd1-93207016ce02 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:18.690743 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2596397-5a18-41c3-bfd1-93207016ce02 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:18.692589 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2596397-5a18-41c3-bfd1-93207016ce02 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:18.713214 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 459/920] 10.222.0.30 () {60 vars in 1165 bytes} [Fri Oct 15 03:27:18 2021] POST /identity/v3/endpoints => generated 334 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:27:20.050425 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d193436-710c-410f-8c6d-1c894ec37616 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:20.050946 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d193436-710c-410f-8c6d-1c894ec37616 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:20.050946 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d193436-710c-410f-8c6d-1c894ec37616 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:20.052794 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 462/921] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:20.059735 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22434eac-eaeb-4103-89b4-62d091542bb3 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:20.060209 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22434eac-eaeb-4103-89b4-62d091542bb3 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:20.060357 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22434eac-eaeb-4103-89b4-62d091542bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:20.079441 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-22434eac-eaeb-4103-89b4-62d091542bb3 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:20.080652 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-22434eac-eaeb-4103-89b4-62d091542bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:20.103704 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 460/922] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:20 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:20.126639 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d193436-710c-410f-8c6d-1c894ec37616 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:20.139448 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d193436-710c-410f-8c6d-1c894ec37616 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:20.144042 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a11c4-dd53-40cb-8d18-c244195575b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:20.144817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a11c4-dd53-40cb-8d18-c244195575b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:20.145142 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a11c4-dd53-40cb-8d18-c244195575b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:20.145416 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a11c4-dd53-40cb-8d18-c244195575b3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:20.146584 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a11c4-dd53-40cb-8d18-c244195575b3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:20.148301 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a11c4-dd53-40cb-8d18-c244195575b3 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:20.150049 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 463/923] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:27:20.156615 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22434eac-eaeb-4103-89b4-62d091542bb3 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:20.165617 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22434eac-eaeb-4103-89b4-62d091542bb3 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:20.170350 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5ec0c-f906-483f-9ee9-b0295203a8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:20.171002 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5ec0c-f906-483f-9ee9-b0295203a8a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:20.171280 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5ec0c-f906-483f-9ee9-b0295203a8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:20.171548 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5ec0c-f906-483f-9ee9-b0295203a8a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:20.172303 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5ec0c-f906-483f-9ee9-b0295203a8a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:20.174334 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5ec0c-f906-483f-9ee9-b0295203a8a6 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:20.201434 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 461/924] 10.222.0.30 () {60 vars in 1162 bytes} [Fri Oct 15 03:27:20 2021] POST /identity/v3/projects => generated 311 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:27:20.622097 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7d313-9db4-472d-909e-9bc6bd43e07e None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:20.622492 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7d313-9db4-472d-909e-9bc6bd43e07e None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:20.622665 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7d313-9db4-472d-909e-9bc6bd43e07e None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:20.624501 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 464/925] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:20.630436 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ea13e-71e1-4b4b-a282-04576ef39f42 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:20.630798 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ea13e-71e1-4b4b-a282-04576ef39f42 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:20.631146 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ea13e-71e1-4b4b-a282-04576ef39f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:20.649792 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-b57ea13e-71e1-4b4b-a282-04576ef39f42 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:20.650974 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-b57ea13e-71e1-4b4b-a282-04576ef39f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:20.705156 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 462/926] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:20 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:20.729813 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7d313-9db4-472d-909e-9bc6bd43e07e None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:20.744058 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7d313-9db4-472d-909e-9bc6bd43e07e None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:20.748964 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544929b6-729d-4b53-b44e-cda5e2a746fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:20.749743 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544929b6-729d-4b53-b44e-cda5e2a746fd admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:20.750049 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544929b6-729d-4b53-b44e-cda5e2a746fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:20.750314 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544929b6-729d-4b53-b44e-cda5e2a746fd admin admin] PATH_INFO: `/v3/services/image` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:20.750979 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544929b6-729d-4b53-b44e-cda5e2a746fd admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:20.752591 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544929b6-729d-4b53-b44e-cda5e2a746fd admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:20.763901 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-544929b6-729d-4b53-b44e-cda5e2a746fd admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 15 03:27:20.765205 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 465/927] 10.222.0.30 () {56 vars in 1126 bytes} [Fri Oct 15 03:27:20 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:20.771983 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ea13e-71e1-4b4b-a282-04576ef39f42 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:20.780812 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ea13e-71e1-4b4b-a282-04576ef39f42 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:20.785245 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1773a4-e24e-4ca7-87bd-cd2ececb7424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:20.785887 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1773a4-e24e-4ca7-87bd-cd2ececb7424 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:20.786170 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1773a4-e24e-4ca7-87bd-cd2ececb7424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:20.786441 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1773a4-e24e-4ca7-87bd-cd2ececb7424 admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:20.787149 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1773a4-e24e-4ca7-87bd-cd2ececb7424 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:20.787449 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1773a4-e24e-4ca7-87bd-cd2ececb7424 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:20.789118 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1773a4-e24e-4ca7-87bd-cd2ececb7424 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:20.793884 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 463/928] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:20 2021] GET /identity/v3/services?name=image => generated 122 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:20.800094 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544929b6-729d-4b53-b44e-cda5e2a746fd admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:20.810599 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544929b6-729d-4b53-b44e-cda5e2a746fd admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:20.815062 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ae38d-472e-4fb6-a954-9cc49e1b10c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:20.815704 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ae38d-472e-4fb6-a954-9cc49e1b10c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:20.816000 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ae38d-472e-4fb6-a954-9cc49e1b10c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:20.816272 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ae38d-472e-4fb6-a954-9cc49e1b10c3 admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:20.816985 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ae38d-472e-4fb6-a954-9cc49e1b10c3 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:20.817288 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ae38d-472e-4fb6-a954-9cc49e1b10c3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:20.818851 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ae38d-472e-4fb6-a954-9cc49e1b10c3 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:20.824221 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 466/929] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:20 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:27:20.830554 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1773a4-e24e-4ca7-87bd-cd2ececb7424 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:20.840002 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1773a4-e24e-4ca7-87bd-cd2ececb7424 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:20.844454 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b7c34-9d02-45cd-b078-8a70eb083e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:20.845084 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b7c34-9d02-45cd-b078-8a70eb083e09 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:20.845368 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b7c34-9d02-45cd-b078-8a70eb083e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:20.845644 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b7c34-9d02-45cd-b078-8a70eb083e09 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:20.846387 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b7c34-9d02-45cd-b078-8a70eb083e09 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:20.848260 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b7c34-9d02-45cd-b078-8a70eb083e09 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:20.866322 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 464/930] 10.222.0.30 () {60 vars in 1165 bytes} [Fri Oct 15 03:27:20 2021] POST /identity/v3/endpoints => generated 327 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:27:21.090571 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429186e-cd5b-49d9-86ed-ac34848db0d0 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:21.091110 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429186e-cd5b-49d9-86ed-ac34848db0d0 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:21.091110 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429186e-cd5b-49d9-86ed-ac34848db0d0 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:21.092923 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 467/931] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:21.099070 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8c977-18e9-4237-9b3f-63ae53a8dd0f None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:21.099476 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8c977-18e9-4237-9b3f-63ae53a8dd0f None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:21.099625 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8c977-18e9-4237-9b3f-63ae53a8dd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:21.118447 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-54f8c977-18e9-4237-9b3f-63ae53a8dd0f None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:21.119629 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-54f8c977-18e9-4237-9b3f-63ae53a8dd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:21.137464 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 465/932] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:21 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:21.161804 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429186e-cd5b-49d9-86ed-ac34848db0d0 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:21.173647 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429186e-cd5b-49d9-86ed-ac34848db0d0 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:21.177891 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d59ab-8d6e-41ff-ae9f-df117c0b2d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:21.178669 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d59ab-8d6e-41ff-ae9f-df117c0b2d28 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:21.178941 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d59ab-8d6e-41ff-ae9f-df117c0b2d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:21.179206 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d59ab-8d6e-41ff-ae9f-df117c0b2d28 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:21.189207 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d59ab-8d6e-41ff-ae9f-df117c0b2d28 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:27:21.196937 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-6b4d59ab-8d6e-41ff-ae9f-df117c0b2d28 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 15 03:27:21.198257 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 468/933] 10.222.0.30 () {56 vars in 1141 bytes} [Fri Oct 15 03:27:21 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:21.204723 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8c977-18e9-4237-9b3f-63ae53a8dd0f None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:21.214228 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8c977-18e9-4237-9b3f-63ae53a8dd0f None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:21.218605 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47307182-1d8d-45af-b976-2cb5decc276f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:21.219253 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47307182-1d8d-45af-b976-2cb5decc276f admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:21.219532 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47307182-1d8d-45af-b976-2cb5decc276f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:21.219833 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47307182-1d8d-45af-b976-2cb5decc276f admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:21.220653 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47307182-1d8d-45af-b976-2cb5decc276f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:21.220889 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47307182-1d8d-45af-b976-2cb5decc276f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:21.222456 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47307182-1d8d-45af-b976-2cb5decc276f admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:21.232670 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 466/934] 10.222.0.30 () {56 vars in 1136 bytes} [Fri Oct 15 03:27:21 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:21.237353 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d59ab-8d6e-41ff-ae9f-df117c0b2d28 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:21.251574 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d59ab-8d6e-41ff-ae9f-df117c0b2d28 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:21.256152 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e38d81-ea18-4747-9b0d-ecd02964161a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:21.256915 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e38d81-ea18-4747-9b0d-ecd02964161a admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:21.257194 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e38d81-ea18-4747-9b0d-ecd02964161a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:21.257986 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e38d81-ea18-4747-9b0d-ecd02964161a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:21.267973 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e38d81-ea18-4747-9b0d-ecd02964161a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:21.269875 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e38d81-ea18-4747-9b0d-ecd02964161a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:21.286568 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-22e38d81-ea18-4747-9b0d-ecd02964161a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:27:21.287906 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 469/935] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:21.294082 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47307182-1d8d-45af-b976-2cb5decc276f admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:21.303535 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47307182-1d8d-45af-b976-2cb5decc276f admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:21.308088 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f9606-cd05-4078-83f1-640562600105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:21.308726 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f9606-cd05-4078-83f1-640562600105 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:21.309005 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f9606-cd05-4078-83f1-640562600105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:21.309270 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f9606-cd05-4078-83f1-640562600105 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:21.309990 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f9606-cd05-4078-83f1-640562600105 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:21.310285 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f9606-cd05-4078-83f1-640562600105 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:21.311886 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f9606-cd05-4078-83f1-640562600105 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:21.325069 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 467/936] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:27:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:21.331122 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e38d81-ea18-4747-9b0d-ecd02964161a admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:21.341158 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e38d81-ea18-4747-9b0d-ecd02964161a admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:21.345531 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6619a07-3d89-4c20-a768-097941419c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:21.346318 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6619a07-3d89-4c20-a768-097941419c1c admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:21.346582 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6619a07-3d89-4c20-a768-097941419c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:21.346850 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6619a07-3d89-4c20-a768-097941419c1c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:21.354455 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6619a07-3d89-4c20-a768-097941419c1c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:21.356504 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6619a07-3d89-4c20-a768-097941419c1c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:21.369947 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-e6619a07-3d89-4c20-a768-097941419c1c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 15 03:27:21.376338 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 470/937] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Oct 15 03:27:21 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:27:21.377556 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f9606-cd05-4078-83f1-640562600105 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:21.387751 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f9606-cd05-4078-83f1-640562600105 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:21.392144 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a4c1a-eb78-45fc-b936-6a3e36a93ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:21.392785 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a4c1a-eb78-45fc-b936-6a3e36a93ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:21.393064 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a4c1a-eb78-45fc-b936-6a3e36a93ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:21.393334 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a4c1a-eb78-45fc-b936-6a3e36a93ea5 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:21.394170 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a4c1a-eb78-45fc-b936-6a3e36a93ea5 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:21.394472 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a4c1a-eb78-45fc-b936-6a3e36a93ea5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:21.396320 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a4c1a-eb78-45fc-b936-6a3e36a93ea5 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:21.413551 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 468/938] 10.222.0.30 () {56 vars in 1154 bytes} [Fri Oct 15 03:27:21 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:21.420306 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6619a07-3d89-4c20-a768-097941419c1c admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:21.431375 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6619a07-3d89-4c20-a768-097941419c1c admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:21.436255 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452922e-6627-4daf-8a79-f6f5299625ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:21.436918 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452922e-6627-4daf-8a79-f6f5299625ea admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:21.437205 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452922e-6627-4daf-8a79-f6f5299625ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:21.437483 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452922e-6627-4daf-8a79-f6f5299625ea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:21.446201 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452922e-6627-4daf-8a79-f6f5299625ea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:21.448023 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452922e-6627-4daf-8a79-f6f5299625ea admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:21.456991 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 471/939] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:27:21 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:27:21.463624 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a4c1a-eb78-45fc-b936-6a3e36a93ea5 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:21.473669 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a4c1a-eb78-45fc-b936-6a3e36a93ea5 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:21.478785 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8709e-41c9-4390-a771-848866828b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:21.479698 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8709e-41c9-4390-a771-848866828b8a admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:21.480064 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8709e-41c9-4390-a771-848866828b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:21.480400 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8709e-41c9-4390-a771-848866828b8a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:21.490399 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8709e-41c9-4390-a771-848866828b8a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:21.492869 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8709e-41c9-4390-a771-848866828b8a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:21.508896 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-95d8709e-41c9-4390-a771-848866828b8a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:27:21.510211 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 469/940] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:21.516287 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452922e-6627-4daf-8a79-f6f5299625ea admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:21.525952 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452922e-6627-4daf-8a79-f6f5299625ea admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:21.530557 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a266c6-ba10-4be0-b577-4cf4651a3c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:21.531270 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a266c6-ba10-4be0-b577-4cf4651a3c48 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:21.531627 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a266c6-ba10-4be0-b577-4cf4651a3c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:21.532008 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a266c6-ba10-4be0-b577-4cf4651a3c48 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:21.532813 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a266c6-ba10-4be0-b577-4cf4651a3c48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:21.533201 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a266c6-ba10-4be0-b577-4cf4651a3c48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:21.534862 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a266c6-ba10-4be0-b577-4cf4651a3c48 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:21.546862 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 472/941] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:27:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:21.553202 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8709e-41c9-4390-a771-848866828b8a admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:21.562606 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8709e-41c9-4390-a771-848866828b8a admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:21.566980 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77a2c2-731f-4f39-8783-4d3eafadb1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:21.567767 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77a2c2-731f-4f39-8783-4d3eafadb1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:21.568047 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77a2c2-731f-4f39-8783-4d3eafadb1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:21.568315 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77a2c2-731f-4f39-8783-4d3eafadb1a0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:21.575017 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77a2c2-731f-4f39-8783-4d3eafadb1a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:21.576977 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77a2c2-731f-4f39-8783-4d3eafadb1a0 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:21.590048 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-de77a2c2-731f-4f39-8783-4d3eafadb1a0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:27:21.591425 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 470/942] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:27:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:21.597761 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a266c6-ba10-4be0-b577-4cf4651a3c48 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:21.608413 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a266c6-ba10-4be0-b577-4cf4651a3c48 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:21.613011 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae064a2-8fa7-4741-8117-babf2da49217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:21.613724 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae064a2-8fa7-4741-8117-babf2da49217 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:21.614099 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae064a2-8fa7-4741-8117-babf2da49217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:21.614448 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae064a2-8fa7-4741-8117-babf2da49217 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:21.615365 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae064a2-8fa7-4741-8117-babf2da49217 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:21.615773 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae064a2-8fa7-4741-8117-babf2da49217 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:21.617781 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae064a2-8fa7-4741-8117-babf2da49217 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:21.630417 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 473/943] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:27:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:21.637118 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77a2c2-731f-4f39-8783-4d3eafadb1a0 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:21.647257 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77a2c2-731f-4f39-8783-4d3eafadb1a0 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:21.652215 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255bf10-12ac-416d-a4af-36ef03db8735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:21.652832 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255bf10-12ac-416d-a4af-36ef03db8735 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:21.653108 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255bf10-12ac-416d-a4af-36ef03db8735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:21.653374 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255bf10-12ac-416d-a4af-36ef03db8735 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:21.654193 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255bf10-12ac-416d-a4af-36ef03db8735 admin admin] RBAC: Adding query filter params (role.id=9ac52cb6a0744b1797edbae9fd88349b, scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user.id=3d71a1bd93b04249b2b8e6a054de44c7) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:21.654512 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255bf10-12ac-416d-a4af-36ef03db8735 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:21.656355 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255bf10-12ac-416d-a4af-36ef03db8735 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:21.661673 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 471/944] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:27:21 2021] GET /identity/v3/role_assignments?user.id=3d71a1bd93b04249b2b8e6a054de44c7&scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20&role.id=9ac52cb6a0744b1797edbae9fd88349b => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:22.513222 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e693b-2260-4890-baca-42e5454dad20 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:22.513700 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e693b-2260-4890-baca-42e5454dad20 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:22.513700 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e693b-2260-4890-baca-42e5454dad20 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:22.515517 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 474/945] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:22.521611 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5cc69-b426-45f3-8087-59b2377a56c7 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:22.522062 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5cc69-b426-45f3-8087-59b2377a56c7 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:22.522240 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5cc69-b426-45f3-8087-59b2377a56c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:22.540784 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-e0e5cc69-b426-45f3-8087-59b2377a56c7 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:22.541970 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e0e5cc69-b426-45f3-8087-59b2377a56c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:22.549917 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 472/946] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:22 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:27:22.575110 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e693b-2260-4890-baca-42e5454dad20 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:22.587755 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e693b-2260-4890-baca-42e5454dad20 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:22.592119 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa512180-dbca-417e-b0c7-5fc38f613dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:22.592890 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa512180-dbca-417e-b0c7-5fc38f613dcc admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:22.593174 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa512180-dbca-417e-b0c7-5fc38f613dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:22.593454 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa512180-dbca-417e-b0c7-5fc38f613dcc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:22.594634 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa512180-dbca-417e-b0c7-5fc38f613dcc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:22.596362 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa512180-dbca-417e-b0c7-5fc38f613dcc admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:22.599992 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 475/947] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:22 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:22.605133 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5cc69-b426-45f3-8087-59b2377a56c7 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:22.614054 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5cc69-b426-45f3-8087-59b2377a56c7 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:22.619340 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46363562-a341-405e-b9c5-ce871fe2159d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:22.620052 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46363562-a341-405e-b9c5-ce871fe2159d admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:22.620339 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46363562-a341-405e-b9c5-ce871fe2159d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:22.620617 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46363562-a341-405e-b9c5-ce871fe2159d admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:22.621347 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46363562-a341-405e-b9c5-ce871fe2159d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:22.623247 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46363562-a341-405e-b9c5-ce871fe2159d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:22.645819 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 473/948] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Oct 15 03:27:22 2021] POST /identity/v3/users => generated 285 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:27:23.153006 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e941db-94ad-441d-983d-d1a06730a075 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:23.153400 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e941db-94ad-441d-983d-d1a06730a075 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:23.153600 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e941db-94ad-441d-983d-d1a06730a075 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:23.155367 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 476/949] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:23.161240 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f020c2-138d-487c-acdb-64bcfa7446e2 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:23.161531 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f020c2-138d-487c-acdb-64bcfa7446e2 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:23.161808 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f020c2-138d-487c-acdb-64bcfa7446e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:23.178901 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-c7f020c2-138d-487c-acdb-64bcfa7446e2 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:23.180634 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c7f020c2-138d-487c-acdb-64bcfa7446e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:23.188460 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 474/950] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:23 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:27:23.211564 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e941db-94ad-441d-983d-d1a06730a075 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:23.223890 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e941db-94ad-441d-983d-d1a06730a075 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:23.228169 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b881aa8-6b5d-4cbc-b70b-062367b6030c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:23.228791 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b881aa8-6b5d-4cbc-b70b-062367b6030c admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:23.229074 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b881aa8-6b5d-4cbc-b70b-062367b6030c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:23.229348 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b881aa8-6b5d-4cbc-b70b-062367b6030c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:23.243997 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b881aa8-6b5d-4cbc-b70b-062367b6030c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:23.245749 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b881aa8-6b5d-4cbc-b70b-062367b6030c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:23.254727 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 477/951] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:27:23 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:27:23.261602 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f020c2-138d-487c-acdb-64bcfa7446e2 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:23.270517 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f020c2-138d-487c-acdb-64bcfa7446e2 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:23.275727 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519a85c-eec4-4a77-b1e1-f4773e79be61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:23.276578 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519a85c-eec4-4a77-b1e1-f4773e79be61 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:23.276956 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519a85c-eec4-4a77-b1e1-f4773e79be61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:23.277240 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519a85c-eec4-4a77-b1e1-f4773e79be61 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:23.278485 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519a85c-eec4-4a77-b1e1-f4773e79be61 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:23.280216 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519a85c-eec4-4a77-b1e1-f4773e79be61 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:23.281912 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 475/952] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:23 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:27:23.904639 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8b805-a594-4b53-87ac-ff4cf990de50 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:23.905161 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8b805-a594-4b53-87ac-ff4cf990de50 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:23.905161 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8b805-a594-4b53-87ac-ff4cf990de50 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:23.906965 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 478/953] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:23.912913 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b931a-1a71-42fb-9fa6-619b2559850d None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:23.913310 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b931a-1a71-42fb-9fa6-619b2559850d None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:23.913578 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b931a-1a71-42fb-9fa6-619b2559850d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:23.931840 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-844b931a-1a71-42fb-9fa6-619b2559850d None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:23.933011 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-844b931a-1a71-42fb-9fa6-619b2559850d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:23.940521 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 476/954] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:23 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:27:23.964490 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8b805-a594-4b53-87ac-ff4cf990de50 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:23.976595 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8b805-a594-4b53-87ac-ff4cf990de50 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:23.980970 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8703199-3728-4d31-ac36-b2a6553dbca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:23.981756 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8703199-3728-4d31-ac36-b2a6553dbca1 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:23.982036 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8703199-3728-4d31-ac36-b2a6553dbca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:23.982307 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8703199-3728-4d31-ac36-b2a6553dbca1 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:23.992907 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8703199-3728-4d31-ac36-b2a6553dbca1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:27:24.000059 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-f8703199-3728-4d31-ac36-b2a6553dbca1 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 15 03:27:24.001229 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 479/955] 10.222.0.30 () {56 vars in 1141 bytes} [Fri Oct 15 03:27:23 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:24.008537 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b931a-1a71-42fb-9fa6-619b2559850d None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:24.017353 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b931a-1a71-42fb-9fa6-619b2559850d None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:24.021875 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b675a4-eb8a-4886-848c-0c6f1166ad74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:24.022522 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b675a4-eb8a-4886-848c-0c6f1166ad74 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:24.022804 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b675a4-eb8a-4886-848c-0c6f1166ad74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:24.023081 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b675a4-eb8a-4886-848c-0c6f1166ad74 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:24.023875 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b675a4-eb8a-4886-848c-0c6f1166ad74 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:24.024183 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b675a4-eb8a-4886-848c-0c6f1166ad74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:24.025785 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b675a4-eb8a-4886-848c-0c6f1166ad74 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:24.033665 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 477/956] 10.222.0.30 () {56 vars in 1136 bytes} [Fri Oct 15 03:27:24 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:24.039712 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8703199-3728-4d31-ac36-b2a6553dbca1 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:24.049565 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8703199-3728-4d31-ac36-b2a6553dbca1 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:24.053960 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e565b-6ae2-43aa-a1d4-132ee4b58221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:24.055255 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e565b-6ae2-43aa-a1d4-132ee4b58221 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:24.055532 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e565b-6ae2-43aa-a1d4-132ee4b58221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:24.055831 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e565b-6ae2-43aa-a1d4-132ee4b58221 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:24.065642 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e565b-6ae2-43aa-a1d4-132ee4b58221 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:24.067473 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e565b-6ae2-43aa-a1d4-132ee4b58221 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:24.084609 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-a57e565b-6ae2-43aa-a1d4-132ee4b58221 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:27:24.085789 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 480/957] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:24.094238 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b675a4-eb8a-4886-848c-0c6f1166ad74 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:24.104156 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b675a4-eb8a-4886-848c-0c6f1166ad74 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:24.108685 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff5cf2-b199-4e25-868d-52605a64ec73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:24.109327 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff5cf2-b199-4e25-868d-52605a64ec73 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:24.109612 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff5cf2-b199-4e25-868d-52605a64ec73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:24.109888 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff5cf2-b199-4e25-868d-52605a64ec73 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:24.110614 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff5cf2-b199-4e25-868d-52605a64ec73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:24.110917 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff5cf2-b199-4e25-868d-52605a64ec73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:24.112555 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff5cf2-b199-4e25-868d-52605a64ec73 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:24.124484 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 478/958] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:27:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:24.130566 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e565b-6ae2-43aa-a1d4-132ee4b58221 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:24.140655 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e565b-6ae2-43aa-a1d4-132ee4b58221 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:24.147840 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a7c15-1bbb-4289-8f37-06157046ed0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:24.148728 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a7c15-1bbb-4289-8f37-06157046ed0b admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:24.149019 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a7c15-1bbb-4289-8f37-06157046ed0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:24.149301 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a7c15-1bbb-4289-8f37-06157046ed0b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:24.156609 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a7c15-1bbb-4289-8f37-06157046ed0b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:24.158550 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a7c15-1bbb-4289-8f37-06157046ed0b admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:24.172199 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-522a7c15-1bbb-4289-8f37-06157046ed0b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 15 03:27:24.173317 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 481/959] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Oct 15 03:27:24 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:24.180276 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff5cf2-b199-4e25-868d-52605a64ec73 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:24.189749 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff5cf2-b199-4e25-868d-52605a64ec73 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:24.194171 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53e093-a4ac-41a6-a3a1-2a97b8e63fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:24.194809 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53e093-a4ac-41a6-a3a1-2a97b8e63fac admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:24.195089 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53e093-a4ac-41a6-a3a1-2a97b8e63fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:24.195358 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53e093-a4ac-41a6-a3a1-2a97b8e63fac admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:24.196221 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53e093-a4ac-41a6-a3a1-2a97b8e63fac admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:24.196526 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53e093-a4ac-41a6-a3a1-2a97b8e63fac admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:24.198348 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53e093-a4ac-41a6-a3a1-2a97b8e63fac admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:24.214818 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 479/960] 10.222.0.30 () {56 vars in 1154 bytes} [Fri Oct 15 03:27:24 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:24.220722 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a7c15-1bbb-4289-8f37-06157046ed0b admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:24.231301 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a7c15-1bbb-4289-8f37-06157046ed0b admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:24.235918 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462e59d-2f28-4661-80fb-7704ff65886e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:24.236690 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462e59d-2f28-4661-80fb-7704ff65886e admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:24.236975 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462e59d-2f28-4661-80fb-7704ff65886e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:24.237251 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462e59d-2f28-4661-80fb-7704ff65886e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:24.248371 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462e59d-2f28-4661-80fb-7704ff65886e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:24.250225 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462e59d-2f28-4661-80fb-7704ff65886e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:24.267003 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-3462e59d-2f28-4661-80fb-7704ff65886e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:27:24.268188 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 482/961] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:27:24.275024 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53e093-a4ac-41a6-a3a1-2a97b8e63fac admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:24.284546 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53e093-a4ac-41a6-a3a1-2a97b8e63fac admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:24.288974 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeddfba-b4f7-41eb-a6b3-307aaba62ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:24.289610 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeddfba-b4f7-41eb-a6b3-307aaba62ecb admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:24.289894 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeddfba-b4f7-41eb-a6b3-307aaba62ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:24.290167 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeddfba-b4f7-41eb-a6b3-307aaba62ecb admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:24.290882 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeddfba-b4f7-41eb-a6b3-307aaba62ecb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:24.291184 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeddfba-b4f7-41eb-a6b3-307aaba62ecb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:24.292799 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeddfba-b4f7-41eb-a6b3-307aaba62ecb admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:24.303606 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 480/962] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:27:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:24.309416 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462e59d-2f28-4661-80fb-7704ff65886e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:24.318695 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462e59d-2f28-4661-80fb-7704ff65886e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:24.323836 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4083e7-abf2-424b-b703-82a5506719ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:24.324590 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4083e7-abf2-424b-b703-82a5506719ec admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:24.324877 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4083e7-abf2-424b-b703-82a5506719ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:24.325154 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4083e7-abf2-424b-b703-82a5506719ec admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:24.331890 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4083e7-abf2-424b-b703-82a5506719ec admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:24.333819 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4083e7-abf2-424b-b703-82a5506719ec admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:24.347051 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-8e4083e7-abf2-424b-b703-82a5506719ec admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:27:24.348478 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 483/963] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:27:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:27:24.354778 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeddfba-b4f7-41eb-a6b3-307aaba62ecb admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:24.364268 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeddfba-b4f7-41eb-a6b3-307aaba62ecb admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:24.368774 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067302e-83a7-4e80-9cd2-c13f6eeda78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:24.369460 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067302e-83a7-4e80-9cd2-c13f6eeda78a admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:24.369807 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067302e-83a7-4e80-9cd2-c13f6eeda78a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:24.370147 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067302e-83a7-4e80-9cd2-c13f6eeda78a admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:24.371019 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067302e-83a7-4e80-9cd2-c13f6eeda78a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:24.371395 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067302e-83a7-4e80-9cd2-c13f6eeda78a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:24.373347 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067302e-83a7-4e80-9cd2-c13f6eeda78a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:24.385520 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 481/964] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:27:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:27:24.392487 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4083e7-abf2-424b-b703-82a5506719ec admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:24.404417 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4083e7-abf2-424b-b703-82a5506719ec admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:24.408943 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08615355-57cf-4f94-ac23-e590c3a046fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:24.409748 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08615355-57cf-4f94-ac23-e590c3a046fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:24.410021 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08615355-57cf-4f94-ac23-e590c3a046fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:24.410292 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08615355-57cf-4f94-ac23-e590c3a046fc admin admin] PATH_INFO: `/v3/projects/9f95c04b0a7b4a2d8fbb4b547f70dc20/users/3d71a1bd93b04249b2b8e6a054de44c7/roles/9ac52cb6a0744b1797edbae9fd88349b` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:24.412515 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08615355-57cf-4f94-ac23-e590c3a046fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user_id=3d71a1bd93b04249b2b8e6a054de44c7, role_id=9ac52cb6a0744b1797edbae9fd88349b)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:24.415174 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08615355-57cf-4f94-ac23-e590c3a046fc admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:24.427493 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 484/965] 10.222.0.30 () {58 vars in 1460 bytes} [Fri Oct 15 03:27:24 2021] PUT /identity/v3/projects/9f95c04b0a7b4a2d8fbb4b547f70dc20/users/3d71a1bd93b04249b2b8e6a054de44c7/roles/9ac52cb6a0744b1797edbae9fd88349b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:27:24.950507 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89285afc-ce01-4c7d-a530-14f19f6c3cab None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:24.951484 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89285afc-ce01-4c7d-a530-14f19f6c3cab None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:24.951484 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89285afc-ce01-4c7d-a530-14f19f6c3cab None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:24.952855 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 482/966] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:24.958980 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fa6a3-9ae3-431f-86b8-62600d4cddf4 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:24.959368 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fa6a3-9ae3-431f-86b8-62600d4cddf4 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:24.959524 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fa6a3-9ae3-431f-86b8-62600d4cddf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:24.977401 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-865fa6a3-9ae3-431f-86b8-62600d4cddf4 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:24.978563 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-865fa6a3-9ae3-431f-86b8-62600d4cddf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:25.033067 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 485/967] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:24 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:25.058449 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89285afc-ce01-4c7d-a530-14f19f6c3cab None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:25.070169 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89285afc-ce01-4c7d-a530-14f19f6c3cab None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:25.074432 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597a1ea-91be-439b-b132-3716666f2958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:25.075252 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597a1ea-91be-439b-b132-3716666f2958 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:25.075614 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597a1ea-91be-439b-b132-3716666f2958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:25.075978 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597a1ea-91be-439b-b132-3716666f2958 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:25.085826 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597a1ea-91be-439b-b132-3716666f2958 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:27:25.092455 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-8597a1ea-91be-439b-b132-3716666f2958 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:27:25.093591 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 483/968] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:27:25 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:25.100213 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865fa6a3-9ae3-431f-86b8-62600d4cddf4 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:25.109448 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865fa6a3-9ae3-431f-86b8-62600d4cddf4 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:25.113838 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306a7fa-f80d-4531-ae24-f58b185de4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:25.114481 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306a7fa-f80d-4531-ae24-f58b185de4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:25.114757 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306a7fa-f80d-4531-ae24-f58b185de4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:25.115026 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306a7fa-f80d-4531-ae24-f58b185de4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:25.115803 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306a7fa-f80d-4531-ae24-f58b185de4e7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:25.116101 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306a7fa-f80d-4531-ae24-f58b185de4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:25.118294 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306a7fa-f80d-4531-ae24-f58b185de4e7 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:25.126533 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 486/969] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:27:25 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:27:25.133219 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597a1ea-91be-439b-b132-3716666f2958 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:25.143231 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597a1ea-91be-439b-b132-3716666f2958 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:25.147581 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832e6db-d626-4690-8d18-d001060a347c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:25.148997 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832e6db-d626-4690-8d18-d001060a347c admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:25.149283 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832e6db-d626-4690-8d18-d001060a347c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:25.149552 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832e6db-d626-4690-8d18-d001060a347c admin admin] PATH_INFO: `/v3/users/0158485ebd394f2fa640bde26ae9d5af` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:25.163889 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832e6db-d626-4690-8d18-d001060a347c admin admin] RBAC: Authorizing `identity:get_user(user_id=0158485ebd394f2fa640bde26ae9d5af)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:25.166013 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832e6db-d626-4690-8d18-d001060a347c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:25.167845 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 484/970] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:27:25 2021] GET /identity/v3/users/0158485ebd394f2fa640bde26ae9d5af => generated 285 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:27:25.174043 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306a7fa-f80d-4531-ae24-f58b185de4e7 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:25.183486 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306a7fa-f80d-4531-ae24-f58b185de4e7 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:25.187908 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d797b-1190-44f8-b45e-c8ac58aa6aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:25.188525 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d797b-1190-44f8-b45e-c8ac58aa6aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:25.188808 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d797b-1190-44f8-b45e-c8ac58aa6aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:25.189078 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d797b-1190-44f8-b45e-c8ac58aa6aa9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:25.197062 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d797b-1190-44f8-b45e-c8ac58aa6aa9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:25.198785 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d797b-1190-44f8-b45e-c8ac58aa6aa9 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:25.207486 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 487/971] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:27:25 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:27:25.214199 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832e6db-d626-4690-8d18-d001060a347c admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:25.223712 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832e6db-d626-4690-8d18-d001060a347c admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:25.228177 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55235b49-a6da-4be2-91e4-f38d42baa832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:25.229003 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55235b49-a6da-4be2-91e4-f38d42baa832 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:25.229283 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55235b49-a6da-4be2-91e4-f38d42baa832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:25.229556 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55235b49-a6da-4be2-91e4-f38d42baa832 admin admin] PATH_INFO: `/v3/projects/5c8d02ef9d024b498892abc56eb06cec` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:25.230755 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55235b49-a6da-4be2-91e4-f38d42baa832 admin admin] RBAC: Authorizing `identity:get_project(project_id=5c8d02ef9d024b498892abc56eb06cec)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:25.232827 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55235b49-a6da-4be2-91e4-f38d42baa832 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:25.234494 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 485/972] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:27:25 2021] GET /identity/v3/projects/5c8d02ef9d024b498892abc56eb06cec => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:25.241219 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d797b-1190-44f8-b45e-c8ac58aa6aa9 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:25.250910 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d797b-1190-44f8-b45e-c8ac58aa6aa9 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:25.255400 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7acfe-646d-4f73-aca1-572819dfb4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:25.256059 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7acfe-646d-4f73-aca1-572819dfb4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:25.256336 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7acfe-646d-4f73-aca1-572819dfb4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:25.256603 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7acfe-646d-4f73-aca1-572819dfb4f5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:25.258033 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7acfe-646d-4f73-aca1-572819dfb4f5 admin admin] RBAC: Adding query filter params (role.id=15ba70b0cba04962a6d0b80b50c07004, scope.project.id=5c8d02ef9d024b498892abc56eb06cec, user.id=0158485ebd394f2fa640bde26ae9d5af) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:25.258342 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7acfe-646d-4f73-aca1-572819dfb4f5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:25.260194 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7acfe-646d-4f73-aca1-572819dfb4f5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:25.265430 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 488/973] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:27:25 2021] GET /identity/v3/role_assignments?user.id=0158485ebd394f2fa640bde26ae9d5af&scope.project.id=5c8d02ef9d024b498892abc56eb06cec&role.id=15ba70b0cba04962a6d0b80b50c07004 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:27:26.664991 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509b3a5-2c4a-4707-9e47-faf77722a6b9 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:26.665484 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509b3a5-2c4a-4707-9e47-faf77722a6b9 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:26.665484 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509b3a5-2c4a-4707-9e47-faf77722a6b9 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:26.667227 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 486/974] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:26.673277 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cee6ed-b75d-47ff-84f7-d959d96db41f None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:26.673651 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cee6ed-b75d-47ff-84f7-d959d96db41f None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:26.673828 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cee6ed-b75d-47ff-84f7-d959d96db41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:26.691479 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-13cee6ed-b75d-47ff-84f7-d959d96db41f None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:26.692692 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-13cee6ed-b75d-47ff-84f7-d959d96db41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:26.700248 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 489/975] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:26 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:26.724521 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509b3a5-2c4a-4707-9e47-faf77722a6b9 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:26.736755 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509b3a5-2c4a-4707-9e47-faf77722a6b9 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:26.741012 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadcbbe-6955-486c-9e1a-651bec9fa31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:26.742333 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadcbbe-6955-486c-9e1a-651bec9fa31e admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:26.742621 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadcbbe-6955-486c-9e1a-651bec9fa31e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:26.742891 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadcbbe-6955-486c-9e1a-651bec9fa31e admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:26.752679 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadcbbe-6955-486c-9e1a-651bec9fa31e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:27:26.759924 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-dfadcbbe-6955-486c-9e1a-651bec9fa31e admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 15 03:27:26.761176 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 487/976] 10.222.0.30 () {56 vars in 1141 bytes} [Fri Oct 15 03:27:26 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:26.767312 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cee6ed-b75d-47ff-84f7-d959d96db41f None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:26.776748 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cee6ed-b75d-47ff-84f7-d959d96db41f None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:26.781164 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c2701-9496-4b3c-bab7-a92f42f6db7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:26.781800 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c2701-9496-4b3c-bab7-a92f42f6db7a admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:26.782074 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c2701-9496-4b3c-bab7-a92f42f6db7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:26.782344 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c2701-9496-4b3c-bab7-a92f42f6db7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:26.783094 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c2701-9496-4b3c-bab7-a92f42f6db7a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:26.783393 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c2701-9496-4b3c-bab7-a92f42f6db7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:26.785000 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c2701-9496-4b3c-bab7-a92f42f6db7a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:26.793427 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 490/977] 10.222.0.30 () {56 vars in 1136 bytes} [Fri Oct 15 03:27:26 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:26.799835 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadcbbe-6955-486c-9e1a-651bec9fa31e admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:26.810552 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadcbbe-6955-486c-9e1a-651bec9fa31e admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:26.814903 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f24124-2c1f-40c9-b3f7-09eb5e67fc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:26.815641 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f24124-2c1f-40c9-b3f7-09eb5e67fc94 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:26.815949 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f24124-2c1f-40c9-b3f7-09eb5e67fc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:26.816215 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f24124-2c1f-40c9-b3f7-09eb5e67fc94 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:26.825967 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f24124-2c1f-40c9-b3f7-09eb5e67fc94 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:26.827850 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f24124-2c1f-40c9-b3f7-09eb5e67fc94 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:26.844174 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-37f24124-2c1f-40c9-b3f7-09eb5e67fc94 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:27:26.845265 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 488/978] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:26.852427 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c2701-9496-4b3c-bab7-a92f42f6db7a admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:26.861611 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c2701-9496-4b3c-bab7-a92f42f6db7a admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:26.865983 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320210f-ab4c-4490-ba2a-c527d7720b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:26.866612 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320210f-ab4c-4490-ba2a-c527d7720b40 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:26.866895 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320210f-ab4c-4490-ba2a-c527d7720b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:26.867166 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320210f-ab4c-4490-ba2a-c527d7720b40 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:26.867916 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320210f-ab4c-4490-ba2a-c527d7720b40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:26.868218 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320210f-ab4c-4490-ba2a-c527d7720b40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:26.869795 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320210f-ab4c-4490-ba2a-c527d7720b40 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:26.881015 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 491/979] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:27:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:26.887292 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f24124-2c1f-40c9-b3f7-09eb5e67fc94 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:26.896790 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f24124-2c1f-40c9-b3f7-09eb5e67fc94 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:26.901790 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c49646-e6bc-4a4d-afaa-2e49482a5499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:26.902540 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c49646-e6bc-4a4d-afaa-2e49482a5499 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:26.902816 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c49646-e6bc-4a4d-afaa-2e49482a5499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:26.903080 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c49646-e6bc-4a4d-afaa-2e49482a5499 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:26.910114 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c49646-e6bc-4a4d-afaa-2e49482a5499 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:26.912130 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c49646-e6bc-4a4d-afaa-2e49482a5499 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:26.925857 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-f0c49646-e6bc-4a4d-afaa-2e49482a5499 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 15 03:27:26.926911 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 489/980] 10.222.0.30 () {56 vars in 1114 bytes} [Fri Oct 15 03:27:26 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:26.933371 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320210f-ab4c-4490-ba2a-c527d7720b40 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:26.942787 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320210f-ab4c-4490-ba2a-c527d7720b40 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:26.947149 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcb7fc-43d0-4af2-a472-c7a11bd80d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:26.947891 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcb7fc-43d0-4af2-a472-c7a11bd80d53 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:26.948171 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcb7fc-43d0-4af2-a472-c7a11bd80d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:26.948442 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcb7fc-43d0-4af2-a472-c7a11bd80d53 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:26.949275 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcb7fc-43d0-4af2-a472-c7a11bd80d53 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:26.949574 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcb7fc-43d0-4af2-a472-c7a11bd80d53 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:26.951381 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcb7fc-43d0-4af2-a472-c7a11bd80d53 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:26.968374 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 492/981] 10.222.0.30 () {56 vars in 1154 bytes} [Fri Oct 15 03:27:26 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:26.974879 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c49646-e6bc-4a4d-afaa-2e49482a5499 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:26.985303 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c49646-e6bc-4a4d-afaa-2e49482a5499 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:26.989703 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d7d40-9aa1-4269-ba3a-893b694c6750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:26.990319 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d7d40-9aa1-4269-ba3a-893b694c6750 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:26.990597 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d7d40-9aa1-4269-ba3a-893b694c6750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:26.990866 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d7d40-9aa1-4269-ba3a-893b694c6750 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:26.998822 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d7d40-9aa1-4269-ba3a-893b694c6750 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:27.000580 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d7d40-9aa1-4269-ba3a-893b694c6750 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:27.009773 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 490/982] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:27:26 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:27:27.015883 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcb7fc-43d0-4af2-a472-c7a11bd80d53 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:27.025629 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcb7fc-43d0-4af2-a472-c7a11bd80d53 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:27.030152 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d371da7-49fa-4a65-84c6-e796646f8419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:27.030918 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d371da7-49fa-4a65-84c6-e796646f8419 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:27.031197 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d371da7-49fa-4a65-84c6-e796646f8419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:27.031471 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d371da7-49fa-4a65-84c6-e796646f8419 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:27.041560 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d371da7-49fa-4a65-84c6-e796646f8419 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:27.043380 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d371da7-49fa-4a65-84c6-e796646f8419 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:27.060061 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-5d371da7-49fa-4a65-84c6-e796646f8419 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:27:27.061212 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 493/983] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:27.067554 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d7d40-9aa1-4269-ba3a-893b694c6750 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:27.076872 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d7d40-9aa1-4269-ba3a-893b694c6750 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:27.081354 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4d057-5ce5-4247-a1be-4fdd31790dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:27.081981 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4d057-5ce5-4247-a1be-4fdd31790dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:27.082259 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4d057-5ce5-4247-a1be-4fdd31790dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:27.082530 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4d057-5ce5-4247-a1be-4fdd31790dc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:27.083246 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4d057-5ce5-4247-a1be-4fdd31790dc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:27.083542 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4d057-5ce5-4247-a1be-4fdd31790dc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:27.085137 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4d057-5ce5-4247-a1be-4fdd31790dc6 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:27.096067 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 491/984] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:27:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:27.102560 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d371da7-49fa-4a65-84c6-e796646f8419 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:27.112136 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d371da7-49fa-4a65-84c6-e796646f8419 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:27.116563 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cfc9f-75e0-4c80-9d25-8f025f4609bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:27.117828 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cfc9f-75e0-4c80-9d25-8f025f4609bf admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:27.118107 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cfc9f-75e0-4c80-9d25-8f025f4609bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:27.118376 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cfc9f-75e0-4c80-9d25-8f025f4609bf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:27.124995 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cfc9f-75e0-4c80-9d25-8f025f4609bf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:27.126974 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cfc9f-75e0-4c80-9d25-8f025f4609bf admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:27.140174 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-b85cfc9f-75e0-4c80-9d25-8f025f4609bf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:27:27.141299 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 494/985] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:27:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:27.147760 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4d057-5ce5-4247-a1be-4fdd31790dc6 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:27.157119 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4d057-5ce5-4247-a1be-4fdd31790dc6 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:27.161500 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce9d0c-26a0-448d-9ca2-5471b8f60070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:27.162237 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce9d0c-26a0-448d-9ca2-5471b8f60070 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:27.162520 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce9d0c-26a0-448d-9ca2-5471b8f60070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:27.162790 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce9d0c-26a0-448d-9ca2-5471b8f60070 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:27.164139 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce9d0c-26a0-448d-9ca2-5471b8f60070 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:27.164446 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce9d0c-26a0-448d-9ca2-5471b8f60070 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:27.166268 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce9d0c-26a0-448d-9ca2-5471b8f60070 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:27.178410 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 492/986] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:27:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:27:27.185691 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cfc9f-75e0-4c80-9d25-8f025f4609bf admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:27.195783 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cfc9f-75e0-4c80-9d25-8f025f4609bf admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:27.200166 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567c9d2-4677-43fd-806d-305ddbbf58b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:27.200784 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567c9d2-4677-43fd-806d-305ddbbf58b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:27.201065 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567c9d2-4677-43fd-806d-305ddbbf58b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:27.201337 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567c9d2-4677-43fd-806d-305ddbbf58b4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:27.202165 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567c9d2-4677-43fd-806d-305ddbbf58b4 admin admin] RBAC: Adding query filter params (role.id=9ac52cb6a0744b1797edbae9fd88349b, scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user.id=3d71a1bd93b04249b2b8e6a054de44c7) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:27.202471 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567c9d2-4677-43fd-806d-305ddbbf58b4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:27.204347 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567c9d2-4677-43fd-806d-305ddbbf58b4 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:27.219717 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 495/987] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:27:27 2021] GET /identity/v3/role_assignments?user.id=3d71a1bd93b04249b2b8e6a054de44c7&scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20&role.id=9ac52cb6a0744b1797edbae9fd88349b => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:27.503062 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eede5e-7c7b-443c-bf3a-bc749121522a None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:27.503345 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eede5e-7c7b-443c-bf3a-bc749121522a None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:27.503638 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eede5e-7c7b-443c-bf3a-bc749121522a None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:27.505500 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 493/988] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:27.512159 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384a1fb-54e6-4dc1-8d70-3efa86dd1ea8 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:27.512517 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384a1fb-54e6-4dc1-8d70-3efa86dd1ea8 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:27.512859 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384a1fb-54e6-4dc1-8d70-3efa86dd1ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:27.530369 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-d384a1fb-54e6-4dc1-8d70-3efa86dd1ea8 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:27.531537 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-d384a1fb-54e6-4dc1-8d70-3efa86dd1ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:27.539502 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 496/989] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:27 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:27.564045 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eede5e-7c7b-443c-bf3a-bc749121522a None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:27.577045 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eede5e-7c7b-443c-bf3a-bc749121522a None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:27.581517 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfde34e-3084-4e0b-9c2e-8d136a56f3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:27.582291 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfde34e-3084-4e0b-9c2e-8d136a56f3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:27.582570 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfde34e-3084-4e0b-9c2e-8d136a56f3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:27.582841 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfde34e-3084-4e0b-9c2e-8d136a56f3c3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:27.595556 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfde34e-3084-4e0b-9c2e-8d136a56f3c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:27:27.602642 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-2cfde34e-3084-4e0b-9c2e-8d136a56f3c3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:27:27.603840 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 494/990] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:27:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:27.610887 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384a1fb-54e6-4dc1-8d70-3efa86dd1ea8 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:27.620515 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384a1fb-54e6-4dc1-8d70-3efa86dd1ea8 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:27.625077 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5852b9-50cc-4495-9062-2005992d50f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:27.625734 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5852b9-50cc-4495-9062-2005992d50f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:27.626011 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5852b9-50cc-4495-9062-2005992d50f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:27.626291 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5852b9-50cc-4495-9062-2005992d50f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:27.627052 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5852b9-50cc-4495-9062-2005992d50f7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:27.627355 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5852b9-50cc-4495-9062-2005992d50f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:27.629016 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5852b9-50cc-4495-9062-2005992d50f7 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:27.638120 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 497/991] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:27:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:27.644641 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfde34e-3084-4e0b-9c2e-8d136a56f3c3 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:27.655693 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfde34e-3084-4e0b-9c2e-8d136a56f3c3 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:27.660279 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32f375-4cc9-48c2-a1de-f4d05ffc0cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:27.661118 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32f375-4cc9-48c2-a1de-f4d05ffc0cba admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:27.661401 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32f375-4cc9-48c2-a1de-f4d05ffc0cba admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:27.661677 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32f375-4cc9-48c2-a1de-f4d05ffc0cba admin admin] PATH_INFO: `/v3/users/0158485ebd394f2fa640bde26ae9d5af` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:27.662877 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32f375-4cc9-48c2-a1de-f4d05ffc0cba admin admin] RBAC: Authorizing `identity:get_user(user_id=0158485ebd394f2fa640bde26ae9d5af)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:27.665620 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32f375-4cc9-48c2-a1de-f4d05ffc0cba admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:27.667627 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 495/992] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:27:27 2021] GET /identity/v3/users/0158485ebd394f2fa640bde26ae9d5af => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:27.673846 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5852b9-50cc-4495-9062-2005992d50f7 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:27.683618 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5852b9-50cc-4495-9062-2005992d50f7 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:27.688446 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc41a58-0f53-492c-a41e-504972634f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:27.689275 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc41a58-0f53-492c-a41e-504972634f0d admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:27.689560 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc41a58-0f53-492c-a41e-504972634f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:27.689836 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc41a58-0f53-492c-a41e-504972634f0d admin admin] PATH_INFO: `/v3/projects/5c8d02ef9d024b498892abc56eb06cec` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:27.691021 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc41a58-0f53-492c-a41e-504972634f0d admin admin] RBAC: Authorizing `identity:get_project(project_id=5c8d02ef9d024b498892abc56eb06cec)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:27.693113 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc41a58-0f53-492c-a41e-504972634f0d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:27.694795 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 498/993] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:27:27 2021] GET /identity/v3/projects/5c8d02ef9d024b498892abc56eb06cec => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:27.701594 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32f375-4cc9-48c2-a1de-f4d05ffc0cba admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:27.712223 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32f375-4cc9-48c2-a1de-f4d05ffc0cba admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:27.717244 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78859fd6-7344-4288-b63c-88afd9170810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:27.718109 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78859fd6-7344-4288-b63c-88afd9170810 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:27.718387 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78859fd6-7344-4288-b63c-88afd9170810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:27.718652 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78859fd6-7344-4288-b63c-88afd9170810 admin admin] PATH_INFO: `/v3/projects/5c8d02ef9d024b498892abc56eb06cec/users/0158485ebd394f2fa640bde26ae9d5af/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:27.720660 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78859fd6-7344-4288-b63c-88afd9170810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c8d02ef9d024b498892abc56eb06cec, user_id=0158485ebd394f2fa640bde26ae9d5af, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:27.723546 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78859fd6-7344-4288-b63c-88afd9170810 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:27.738372 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 496/994] 10.222.0.30 () {58 vars in 1460 bytes} [Fri Oct 15 03:27:27 2021] PUT /identity/v3/projects/5c8d02ef9d024b498892abc56eb06cec/users/0158485ebd394f2fa640bde26ae9d5af/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:27:29.985457 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580868fe-c055-4b4a-af58-78b70faee6ed None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:29.985972 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580868fe-c055-4b4a-af58-78b70faee6ed None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:29.986065 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580868fe-c055-4b4a-af58-78b70faee6ed None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:29.987819 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 499/995] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:29.993920 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0c7ed-797a-4816-a704-9541f151f567 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:29.994334 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0c7ed-797a-4816-a704-9541f151f567 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:29.994464 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0c7ed-797a-4816-a704-9541f151f567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:30.011384 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-63d0c7ed-797a-4816-a704-9541f151f567 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:30.012579 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-63d0c7ed-797a-4816-a704-9541f151f567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:30.066518 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 497/996] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:29 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:30.090880 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580868fe-c055-4b4a-af58-78b70faee6ed None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:30.103025 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580868fe-c055-4b4a-af58-78b70faee6ed None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:30.107319 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc88c3-0a2f-4442-a2ec-6eb3433f6e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:30.108111 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc88c3-0a2f-4442-a2ec-6eb3433f6e4c admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:30.108395 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc88c3-0a2f-4442-a2ec-6eb3433f6e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:30.108670 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc88c3-0a2f-4442-a2ec-6eb3433f6e4c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:30.119104 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc88c3-0a2f-4442-a2ec-6eb3433f6e4c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:27:30.125940 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-7ffc88c3-0a2f-4442-a2ec-6eb3433f6e4c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:27:30.127057 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 500/997] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:27:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:30.134082 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0c7ed-797a-4816-a704-9541f151f567 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:30.142732 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0c7ed-797a-4816-a704-9541f151f567 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:30.147116 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07c991-8406-4c42-ad01-01d71dd2fa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:30.147787 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07c991-8406-4c42-ad01-01d71dd2fa09 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:30.148115 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07c991-8406-4c42-ad01-01d71dd2fa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:30.148387 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07c991-8406-4c42-ad01-01d71dd2fa09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:30.149125 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07c991-8406-4c42-ad01-01d71dd2fa09 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:30.149424 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07c991-8406-4c42-ad01-01d71dd2fa09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:30.150994 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07c991-8406-4c42-ad01-01d71dd2fa09 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:30.158850 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 498/998] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:27:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:27:30.165473 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc88c3-0a2f-4442-a2ec-6eb3433f6e4c admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:30.175965 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc88c3-0a2f-4442-a2ec-6eb3433f6e4c admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:30.181157 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2e31f-5291-493f-8ec4-0da13ef7741e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:30.181988 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2e31f-5291-493f-8ec4-0da13ef7741e admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:30.182267 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2e31f-5291-493f-8ec4-0da13ef7741e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:30.182535 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2e31f-5291-493f-8ec4-0da13ef7741e admin admin] PATH_INFO: `/v3/users/0158485ebd394f2fa640bde26ae9d5af` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:30.183779 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2e31f-5291-493f-8ec4-0da13ef7741e admin admin] RBAC: Authorizing `identity:get_user(user_id=0158485ebd394f2fa640bde26ae9d5af)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:30.185911 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2e31f-5291-493f-8ec4-0da13ef7741e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:30.187491 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 501/999] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:27:30 2021] GET /identity/v3/users/0158485ebd394f2fa640bde26ae9d5af => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:30.193394 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07c991-8406-4c42-ad01-01d71dd2fa09 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:30.202470 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07c991-8406-4c42-ad01-01d71dd2fa09 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:30.206852 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a20ed-5083-4ea0-add6-6e7865c3a223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:30.207459 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a20ed-5083-4ea0-add6-6e7865c3a223 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:30.207775 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a20ed-5083-4ea0-add6-6e7865c3a223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:30.208054 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a20ed-5083-4ea0-add6-6e7865c3a223 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:30.215478 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a20ed-5083-4ea0-add6-6e7865c3a223 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:30.217247 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a20ed-5083-4ea0-add6-6e7865c3a223 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:30.226466 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 499/1000] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:27:30 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:27:30.232377 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2e31f-5291-493f-8ec4-0da13ef7741e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:30.242449 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2e31f-5291-493f-8ec4-0da13ef7741e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:30.246918 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd89b4a-fdf2-478d-a545-d59ea16b05a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:30.247763 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd89b4a-fdf2-478d-a545-d59ea16b05a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:30.248045 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd89b4a-fdf2-478d-a545-d59ea16b05a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:30.248314 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd89b4a-fdf2-478d-a545-d59ea16b05a5 admin admin] PATH_INFO: `/v3/projects/5c8d02ef9d024b498892abc56eb06cec` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:30.249475 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd89b4a-fdf2-478d-a545-d59ea16b05a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=5c8d02ef9d024b498892abc56eb06cec)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:30.251496 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd89b4a-fdf2-478d-a545-d59ea16b05a5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:30.253161 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 502/1001] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:27:30 2021] GET /identity/v3/projects/5c8d02ef9d024b498892abc56eb06cec => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:30.259438 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a20ed-5083-4ea0-add6-6e7865c3a223 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:30.267944 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a20ed-5083-4ea0-add6-6e7865c3a223 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:30.272360 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd181d28-1568-4c32-a9f6-c016c6505449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:30.272974 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd181d28-1568-4c32-a9f6-c016c6505449 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:30.273254 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd181d28-1568-4c32-a9f6-c016c6505449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:30.273529 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd181d28-1568-4c32-a9f6-c016c6505449 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:30.274347 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd181d28-1568-4c32-a9f6-c016c6505449 admin admin] RBAC: Adding query filter params (role.id=15ba70b0cba04962a6d0b80b50c07004, scope.project.id=5c8d02ef9d024b498892abc56eb06cec, user.id=0158485ebd394f2fa640bde26ae9d5af) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:30.274654 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd181d28-1568-4c32-a9f6-c016c6505449 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:30.276493 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd181d28-1568-4c32-a9f6-c016c6505449 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:30.281978 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 500/1002] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:27:30 2021] GET /identity/v3/role_assignments?user.id=0158485ebd394f2fa640bde26ae9d5af&scope.project.id=5c8d02ef9d024b498892abc56eb06cec&role.id=15ba70b0cba04962a6d0b80b50c07004 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:32.526279 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880edba-21e3-4eae-b102-e2f39575d6be None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:32.526758 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880edba-21e3-4eae-b102-e2f39575d6be None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:32.526758 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880edba-21e3-4eae-b102-e2f39575d6be None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:32.528560 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 503/1003] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:32.534290 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14769b56-2ef9-4381-a34b-01eedb383ba0 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:32.534702 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14769b56-2ef9-4381-a34b-01eedb383ba0 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:32.534822 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14769b56-2ef9-4381-a34b-01eedb383ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:32.552375 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-14769b56-2ef9-4381-a34b-01eedb383ba0 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:32.553549 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-14769b56-2ef9-4381-a34b-01eedb383ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:32.561661 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 501/1004] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:32 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:32.587901 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880edba-21e3-4eae-b102-e2f39575d6be None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:32.599890 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880edba-21e3-4eae-b102-e2f39575d6be None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:32.604145 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66522415-cea3-4296-b176-38f3d559982e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:32.604885 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66522415-cea3-4296-b176-38f3d559982e admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:32.605162 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66522415-cea3-4296-b176-38f3d559982e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:32.605430 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66522415-cea3-4296-b176-38f3d559982e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:32.606581 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66522415-cea3-4296-b176-38f3d559982e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:32.608288 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66522415-cea3-4296-b176-38f3d559982e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:32.609815 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 504/1005] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:32 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:32.615627 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14769b56-2ef9-4381-a34b-01eedb383ba0 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:32.624185 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14769b56-2ef9-4381-a34b-01eedb383ba0 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:32.628549 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc6181-e869-4ee0-9710-d560fa01467a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:32.629177 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc6181-e869-4ee0-9710-d560fa01467a admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:32.629457 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc6181-e869-4ee0-9710-d560fa01467a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:32.629731 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc6181-e869-4ee0-9710-d560fa01467a admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:32.630426 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc6181-e869-4ee0-9710-d560fa01467a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:32.632912 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc6181-e869-4ee0-9710-d560fa01467a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:32.651320 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 502/1006] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Oct 15 03:27:32 2021] POST /identity/v3/users => generated 286 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:27:34.910686 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929978de-cf71-4c66-ad61-d2a84e7c8418 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:34.911246 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929978de-cf71-4c66-ad61-d2a84e7c8418 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:34.911246 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929978de-cf71-4c66-ad61-d2a84e7c8418 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:34.913020 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 505/1007] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:34.919049 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fad07-5e21-4feb-b666-a78d193e6430 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:34.919413 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fad07-5e21-4feb-b666-a78d193e6430 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:34.919607 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fad07-5e21-4feb-b666-a78d193e6430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:34.936721 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-2c1fad07-5e21-4feb-b666-a78d193e6430 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:34.937896 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-2c1fad07-5e21-4feb-b666-a78d193e6430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:34.945946 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 503/1008] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:34 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:34.970296 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929978de-cf71-4c66-ad61-d2a84e7c8418 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:34.982923 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929978de-cf71-4c66-ad61-d2a84e7c8418 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:34.987143 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc9d2b-de8f-45d5-bbeb-2930b808ca3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:34.987989 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc9d2b-de8f-45d5-bbeb-2930b808ca3e admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:34.988261 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc9d2b-de8f-45d5-bbeb-2930b808ca3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:34.988525 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc9d2b-de8f-45d5-bbeb-2930b808ca3e admin admin] PATH_INFO: `/v3/roles/3f958dcb5c7c413a9d9edd4ed05d20a2` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:34.990293 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc9d2b-de8f-45d5-bbeb-2930b808ca3e admin admin] RBAC: Authorizing `identity:get_role(role_id=3f958dcb5c7c413a9d9edd4ed05d20a2)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:34.991286 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING py.warnings [None req-24fc9d2b-de8f-45d5-bbeb-2930b808ca3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:27:34.991286 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: warnings.warn(msg) Oct 15 03:27:34.991286 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: Oct 15 03:27:34.993380 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc9d2b-de8f-45d5-bbeb-2930b808ca3e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:34.994707 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 506/1009] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:27:34 2021] GET /identity/v3/roles/3f958dcb5c7c413a9d9edd4ed05d20a2 => generated 223 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:35.000665 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fad07-5e21-4feb-b666-a78d193e6430 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:35.009189 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fad07-5e21-4feb-b666-a78d193e6430 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:35.013551 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8dc48-f17b-4c17-8d68-7eaa3028629a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:35.014381 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8dc48-f17b-4c17-8d68-7eaa3028629a admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:35.014661 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8dc48-f17b-4c17-8d68-7eaa3028629a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:35.014935 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8dc48-f17b-4c17-8d68-7eaa3028629a admin admin] PATH_INFO: `/v3/users/84eaf49bfb284d669bf6fb22cef9be39` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:35.028110 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8dc48-f17b-4c17-8d68-7eaa3028629a admin admin] RBAC: Authorizing `identity:get_user(user_id=84eaf49bfb284d669bf6fb22cef9be39)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:35.030220 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8dc48-f17b-4c17-8d68-7eaa3028629a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:35.031807 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 504/1010] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:27:34 2021] GET /identity/v3/users/84eaf49bfb284d669bf6fb22cef9be39 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:35.037723 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc9d2b-de8f-45d5-bbeb-2930b808ca3e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:35.047601 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc9d2b-de8f-45d5-bbeb-2930b808ca3e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:35.051993 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bb55c-e5c8-44e5-b0b1-77d9222c5a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:35.052591 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bb55c-e5c8-44e5-b0b1-77d9222c5a1d admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:35.052867 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bb55c-e5c8-44e5-b0b1-77d9222c5a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:35.053134 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bb55c-e5c8-44e5-b0b1-77d9222c5a1d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:35.060628 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bb55c-e5c8-44e5-b0b1-77d9222c5a1d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:35.062316 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bb55c-e5c8-44e5-b0b1-77d9222c5a1d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:35.070782 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 507/1011] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:27:35 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:27:35.076724 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8dc48-f17b-4c17-8d68-7eaa3028629a admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:35.086188 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8dc48-f17b-4c17-8d68-7eaa3028629a admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:35.090589 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b08aa-a3f3-44cf-92e3-b3cec822552e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:35.091381 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b08aa-a3f3-44cf-92e3-b3cec822552e admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:35.091662 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b08aa-a3f3-44cf-92e3-b3cec822552e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:35.091959 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b08aa-a3f3-44cf-92e3-b3cec822552e admin admin] PATH_INFO: `/v3/projects/5c8d02ef9d024b498892abc56eb06cec` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:35.093110 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b08aa-a3f3-44cf-92e3-b3cec822552e admin admin] RBAC: Authorizing `identity:get_project(project_id=5c8d02ef9d024b498892abc56eb06cec)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:35.095079 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b08aa-a3f3-44cf-92e3-b3cec822552e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:35.096693 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 505/1012] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:27:35 2021] GET /identity/v3/projects/5c8d02ef9d024b498892abc56eb06cec => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:35.103538 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bb55c-e5c8-44e5-b0b1-77d9222c5a1d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:35.111816 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bb55c-e5c8-44e5-b0b1-77d9222c5a1d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:35.116245 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bbe09-1d17-40b0-9676-f80d597ff4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:35.116840 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bbe09-1d17-40b0-9676-f80d597ff4cd admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:35.117118 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bbe09-1d17-40b0-9676-f80d597ff4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:35.117389 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bbe09-1d17-40b0-9676-f80d597ff4cd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:35.118203 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1bbe09-1d17-40b0-9676-f80d597ff4cd admin admin] RBAC: Adding query filter params (role.id=3f958dcb5c7c413a9d9edd4ed05d20a2, scope.project.id=5c8d02ef9d024b498892abc56eb06cec, user.id=84eaf49bfb284d669bf6fb22cef9be39) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:35.118507 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1bbe09-1d17-40b0-9676-f80d597ff4cd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:35.120304 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1bbe09-1d17-40b0-9676-f80d597ff4cd admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:35.125338 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 508/1013] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:27:35 2021] GET /identity/v3/role_assignments?user.id=84eaf49bfb284d669bf6fb22cef9be39&scope.project.id=5c8d02ef9d024b498892abc56eb06cec&role.id=3f958dcb5c7c413a9d9edd4ed05d20a2 => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:37.317213 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79868ec7-c0b2-4355-9dc7-5ea41cb30816 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:37.317710 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79868ec7-c0b2-4355-9dc7-5ea41cb30816 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:37.317804 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79868ec7-c0b2-4355-9dc7-5ea41cb30816 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:37.319581 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 506/1014] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:37.325431 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b29377-7802-4c51-8fb8-4dcccd335c90 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:37.325828 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b29377-7802-4c51-8fb8-4dcccd335c90 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:37.325978 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b29377-7802-4c51-8fb8-4dcccd335c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:37.343433 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-c0b29377-7802-4c51-8fb8-4dcccd335c90 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:37.344633 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-c0b29377-7802-4c51-8fb8-4dcccd335c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:37.352972 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 509/1015] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:37 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:37.376093 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79868ec7-c0b2-4355-9dc7-5ea41cb30816 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:37.387806 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79868ec7-c0b2-4355-9dc7-5ea41cb30816 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:37.392148 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebedc8-7b3b-4e40-ab55-687e20f93500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:37.392959 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebedc8-7b3b-4e40-ab55-687e20f93500 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:37.393241 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebedc8-7b3b-4e40-ab55-687e20f93500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:37.393513 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebedc8-7b3b-4e40-ab55-687e20f93500 admin admin] PATH_INFO: `/v3/roles/3f958dcb5c7c413a9d9edd4ed05d20a2` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:37.394975 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ebedc8-7b3b-4e40-ab55-687e20f93500 admin admin] RBAC: Authorizing `identity:get_role(role_id=3f958dcb5c7c413a9d9edd4ed05d20a2)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:37.396020 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING py.warnings [None req-89ebedc8-7b3b-4e40-ab55-687e20f93500 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:27:37.396020 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: warnings.warn(msg) Oct 15 03:27:37.396020 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: Oct 15 03:27:37.396898 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ebedc8-7b3b-4e40-ab55-687e20f93500 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:37.398706 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 507/1016] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:27:37 2021] GET /identity/v3/roles/3f958dcb5c7c413a9d9edd4ed05d20a2 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:37.404631 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b29377-7802-4c51-8fb8-4dcccd335c90 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:37.413199 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b29377-7802-4c51-8fb8-4dcccd335c90 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:37.418199 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77720251-bace-4f96-abde-4edeb63276c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:37.419030 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77720251-bace-4f96-abde-4edeb63276c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:37.419311 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77720251-bace-4f96-abde-4edeb63276c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:37.419585 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77720251-bace-4f96-abde-4edeb63276c4 admin admin] PATH_INFO: `/v3/users/84eaf49bfb284d669bf6fb22cef9be39` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:37.420803 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77720251-bace-4f96-abde-4edeb63276c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=84eaf49bfb284d669bf6fb22cef9be39)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:37.422899 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77720251-bace-4f96-abde-4edeb63276c4 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:37.424486 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 510/1017] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:27:37 2021] GET /identity/v3/users/84eaf49bfb284d669bf6fb22cef9be39 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:37.430359 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebedc8-7b3b-4e40-ab55-687e20f93500 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:37.439364 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebedc8-7b3b-4e40-ab55-687e20f93500 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:37.443776 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7ea62-50db-4bf5-9976-a4478dc7cf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:37.444577 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7ea62-50db-4bf5-9976-a4478dc7cf66 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:37.444859 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7ea62-50db-4bf5-9976-a4478dc7cf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:37.445132 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7ea62-50db-4bf5-9976-a4478dc7cf66 admin admin] PATH_INFO: `/v3/projects/5c8d02ef9d024b498892abc56eb06cec` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:37.446289 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7ea62-50db-4bf5-9976-a4478dc7cf66 admin admin] RBAC: Authorizing `identity:get_project(project_id=5c8d02ef9d024b498892abc56eb06cec)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:37.448313 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7ea62-50db-4bf5-9976-a4478dc7cf66 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:37.450033 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 508/1018] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:27:37 2021] GET /identity/v3/projects/5c8d02ef9d024b498892abc56eb06cec => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:27:37.455542 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77720251-bace-4f96-abde-4edeb63276c4 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:37.465040 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77720251-bace-4f96-abde-4edeb63276c4 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:37.469499 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97932a-3ca3-4d23-b7ae-a95575aab7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:37.470300 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97932a-3ca3-4d23-b7ae-a95575aab7af admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:37.470582 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97932a-3ca3-4d23-b7ae-a95575aab7af admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:37.470854 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97932a-3ca3-4d23-b7ae-a95575aab7af admin admin] PATH_INFO: `/v3/projects/5c8d02ef9d024b498892abc56eb06cec/users/84eaf49bfb284d669bf6fb22cef9be39/roles/3f958dcb5c7c413a9d9edd4ed05d20a2` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:37.473328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97932a-3ca3-4d23-b7ae-a95575aab7af admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c8d02ef9d024b498892abc56eb06cec, user_id=84eaf49bfb284d669bf6fb22cef9be39, role_id=3f958dcb5c7c413a9d9edd4ed05d20a2)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:37.476491 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97932a-3ca3-4d23-b7ae-a95575aab7af admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:37.488641 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 511/1019] 10.222.0.30 () {58 vars in 1460 bytes} [Fri Oct 15 03:27:37 2021] PUT /identity/v3/projects/5c8d02ef9d024b498892abc56eb06cec/users/84eaf49bfb284d669bf6fb22cef9be39/roles/3f958dcb5c7c413a9d9edd4ed05d20a2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:27:39.689368 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042a39f-f74b-4e6f-a958-1d9503c571b6 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:39.689863 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042a39f-f74b-4e6f-a958-1d9503c571b6 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:39.689863 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042a39f-f74b-4e6f-a958-1d9503c571b6 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:39.691612 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 509/1020] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:39.698270 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ec8ba-baaf-469c-820c-a1338222ed04 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:39.698728 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ec8ba-baaf-469c-820c-a1338222ed04 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:39.698817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ec8ba-baaf-469c-820c-a1338222ed04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:39.716448 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-d07ec8ba-baaf-469c-820c-a1338222ed04 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:39.717622 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-d07ec8ba-baaf-469c-820c-a1338222ed04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:39.771809 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 512/1021] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:39 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:39.796982 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042a39f-f74b-4e6f-a958-1d9503c571b6 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:39.808757 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042a39f-f74b-4e6f-a958-1d9503c571b6 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:39.813047 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d81f51-f2d5-40db-bca6-1cc0bf189083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:39.813864 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d81f51-f2d5-40db-bca6-1cc0bf189083 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:39.814150 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d81f51-f2d5-40db-bca6-1cc0bf189083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:39.814426 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d81f51-f2d5-40db-bca6-1cc0bf189083 admin admin] PATH_INFO: `/v3/roles/3f958dcb5c7c413a9d9edd4ed05d20a2` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:39.815916 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d81f51-f2d5-40db-bca6-1cc0bf189083 admin admin] RBAC: Authorizing `identity:get_role(role_id=3f958dcb5c7c413a9d9edd4ed05d20a2)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:39.817499 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d81f51-f2d5-40db-bca6-1cc0bf189083 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:39.818802 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 510/1022] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:27:39 2021] GET /identity/v3/roles/3f958dcb5c7c413a9d9edd4ed05d20a2 => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:39.824686 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ec8ba-baaf-469c-820c-a1338222ed04 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:39.833173 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ec8ba-baaf-469c-820c-a1338222ed04 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:39.838105 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305031f7-8463-4cf1-9258-3056f02b881e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:39.838926 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305031f7-8463-4cf1-9258-3056f02b881e admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:39.839226 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305031f7-8463-4cf1-9258-3056f02b881e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:39.839493 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305031f7-8463-4cf1-9258-3056f02b881e admin admin] PATH_INFO: `/v3/users/84eaf49bfb284d669bf6fb22cef9be39` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:39.840703 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305031f7-8463-4cf1-9258-3056f02b881e admin admin] RBAC: Authorizing `identity:get_user(user_id=84eaf49bfb284d669bf6fb22cef9be39)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:39.842793 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305031f7-8463-4cf1-9258-3056f02b881e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:39.844366 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 513/1023] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:27:39 2021] GET /identity/v3/users/84eaf49bfb284d669bf6fb22cef9be39 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:39.850448 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d81f51-f2d5-40db-bca6-1cc0bf189083 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:39.860031 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d81f51-f2d5-40db-bca6-1cc0bf189083 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:39.864475 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28ba89-14ce-42a3-a290-f82a63d09e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:39.865065 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28ba89-14ce-42a3-a290-f82a63d09e56 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:39.865352 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28ba89-14ce-42a3-a290-f82a63d09e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:39.865630 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28ba89-14ce-42a3-a290-f82a63d09e56 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:39.873105 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28ba89-14ce-42a3-a290-f82a63d09e56 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:39.874777 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28ba89-14ce-42a3-a290-f82a63d09e56 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:39.883856 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 511/1024] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:27:39 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:27:39.889752 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305031f7-8463-4cf1-9258-3056f02b881e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:39.899376 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305031f7-8463-4cf1-9258-3056f02b881e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:39.903922 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758511ca-5606-4c22-84b1-a0f48e0ff645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:39.904696 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758511ca-5606-4c22-84b1-a0f48e0ff645 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:39.904973 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758511ca-5606-4c22-84b1-a0f48e0ff645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:39.905243 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758511ca-5606-4c22-84b1-a0f48e0ff645 admin admin] PATH_INFO: `/v3/projects/5c8d02ef9d024b498892abc56eb06cec` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:39.906375 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758511ca-5606-4c22-84b1-a0f48e0ff645 admin admin] RBAC: Authorizing `identity:get_project(project_id=5c8d02ef9d024b498892abc56eb06cec)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:39.908380 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758511ca-5606-4c22-84b1-a0f48e0ff645 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:39.909955 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 514/1025] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:27:39 2021] GET /identity/v3/projects/5c8d02ef9d024b498892abc56eb06cec => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:39.916661 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28ba89-14ce-42a3-a290-f82a63d09e56 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:39.924985 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28ba89-14ce-42a3-a290-f82a63d09e56 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:39.929995 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c029b2c-3963-4458-a34e-391e001490eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:39.930590 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c029b2c-3963-4458-a34e-391e001490eb admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:39.930900 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c029b2c-3963-4458-a34e-391e001490eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:39.931177 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c029b2c-3963-4458-a34e-391e001490eb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:39.932039 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c029b2c-3963-4458-a34e-391e001490eb admin admin] RBAC: Adding query filter params (role.id=3f958dcb5c7c413a9d9edd4ed05d20a2, scope.project.id=5c8d02ef9d024b498892abc56eb06cec, user.id=84eaf49bfb284d669bf6fb22cef9be39) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:39.932356 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c029b2c-3963-4458-a34e-391e001490eb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:39.934122 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c029b2c-3963-4458-a34e-391e001490eb admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:39.939604 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 512/1026] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:27:39 2021] GET /identity/v3/role_assignments?user.id=84eaf49bfb284d669bf6fb22cef9be39&scope.project.id=5c8d02ef9d024b498892abc56eb06cec&role.id=3f958dcb5c7c413a9d9edd4ed05d20a2 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:27:42.170112 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45bbbda-51ca-49d5-83cc-1866b0853a80 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:42.170636 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45bbbda-51ca-49d5-83cc-1866b0853a80 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:42.170636 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45bbbda-51ca-49d5-83cc-1866b0853a80 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:42.172451 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 515/1027] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:42.178254 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbab10-55ac-42a3-9ef5-f3cf029fdc94 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:42.178669 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbab10-55ac-42a3-9ef5-f3cf029fdc94 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:42.178842 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbab10-55ac-42a3-9ef5-f3cf029fdc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:42.196740 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-73cbab10-55ac-42a3-9ef5-f3cf029fdc94 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:42.197915 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-73cbab10-55ac-42a3-9ef5-f3cf029fdc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:42.205426 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 513/1028] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:42 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:42.230666 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45bbbda-51ca-49d5-83cc-1866b0853a80 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:42.242753 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45bbbda-51ca-49d5-83cc-1866b0853a80 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:42.247125 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56728107-0864-41c2-b892-14cb36eecbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:42.247922 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56728107-0864-41c2-b892-14cb36eecbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:42.248213 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56728107-0864-41c2-b892-14cb36eecbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:42.248489 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56728107-0864-41c2-b892-14cb36eecbc3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:42.249659 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56728107-0864-41c2-b892-14cb36eecbc3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:42.251335 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56728107-0864-41c2-b892-14cb36eecbc3 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:42.252940 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 516/1029] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:42 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:42.259855 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbab10-55ac-42a3-9ef5-f3cf029fdc94 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:42.268633 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbab10-55ac-42a3-9ef5-f3cf029fdc94 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:42.273903 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f41fb4-3779-40e7-94f5-b591ecd6ac33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:42.274542 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f41fb4-3779-40e7-94f5-b591ecd6ac33 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:42.274822 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f41fb4-3779-40e7-94f5-b591ecd6ac33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:42.275096 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f41fb4-3779-40e7-94f5-b591ecd6ac33 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:42.275844 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f41fb4-3779-40e7-94f5-b591ecd6ac33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:42.277759 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f41fb4-3779-40e7-94f5-b591ecd6ac33 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:42.301832 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 514/1030] 10.222.0.30 () {60 vars in 1162 bytes} [Fri Oct 15 03:27:42 2021] POST /identity/v3/projects => generated 311 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:27:44.541303 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c51f1-6185-4bbe-a56f-155d26c981e1 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:44.541850 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c51f1-6185-4bbe-a56f-155d26c981e1 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:44.541850 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c51f1-6185-4bbe-a56f-155d26c981e1 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:44.543548 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 517/1031] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:44.550649 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a05d0f-4e96-4afb-b6a3-2e41e511bdea None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:44.551074 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a05d0f-4e96-4afb-b6a3-2e41e511bdea None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:44.551232 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a05d0f-4e96-4afb-b6a3-2e41e511bdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:44.568943 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-28a05d0f-4e96-4afb-b6a3-2e41e511bdea None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:44.570127 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-28a05d0f-4e96-4afb-b6a3-2e41e511bdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:44.625316 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 515/1032] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:44 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:44.650832 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c51f1-6185-4bbe-a56f-155d26c981e1 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:44.662523 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c51f1-6185-4bbe-a56f-155d26c981e1 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:44.667283 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642ae96-e514-4f42-a4e1-1454b25d25c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:44.668058 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642ae96-e514-4f42-a4e1-1454b25d25c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:44.668338 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642ae96-e514-4f42-a4e1-1454b25d25c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:44.668608 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642ae96-e514-4f42-a4e1-1454b25d25c6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:44.669755 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642ae96-e514-4f42-a4e1-1454b25d25c6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:44.671413 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642ae96-e514-4f42-a4e1-1454b25d25c6 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:44.672981 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 518/1033] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:27:44 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:27:44.679378 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a05d0f-4e96-4afb-b6a3-2e41e511bdea None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:44.687956 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a05d0f-4e96-4afb-b6a3-2e41e511bdea None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:44.692372 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605150e-aa66-4d0f-9a7c-12441f588af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:44.693006 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605150e-aa66-4d0f-9a7c-12441f588af9 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:44.693291 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605150e-aa66-4d0f-9a7c-12441f588af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:44.693568 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605150e-aa66-4d0f-9a7c-12441f588af9 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:44.694299 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605150e-aa66-4d0f-9a7c-12441f588af9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:44.696248 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605150e-aa66-4d0f-9a7c-12441f588af9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:44.714719 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 516/1034] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Oct 15 03:27:44 2021] POST /identity/v3/users => generated 286 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:27:46.984085 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028e697-fdf7-4427-93e6-4a1f19296c85 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:46.984649 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028e697-fdf7-4427-93e6-4a1f19296c85 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:46.984649 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028e697-fdf7-4427-93e6-4a1f19296c85 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:46.987434 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 519/1035] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:46.993827 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd19e2-0951-4ea7-a313-a2483b6a0b07 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:46.994215 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd19e2-0951-4ea7-a313-a2483b6a0b07 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:46.994380 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd19e2-0951-4ea7-a313-a2483b6a0b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:47.011516 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-b2cd19e2-0951-4ea7-a313-a2483b6a0b07 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:47.012743 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-b2cd19e2-0951-4ea7-a313-a2483b6a0b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:47.020210 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 517/1036] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:46 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:47.044975 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028e697-fdf7-4427-93e6-4a1f19296c85 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:47.057211 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028e697-fdf7-4427-93e6-4a1f19296c85 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:47.061499 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ee07d-7c4c-4b72-8311-7b311b71b768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:47.062245 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ee07d-7c4c-4b72-8311-7b311b71b768 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:47.062528 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ee07d-7c4c-4b72-8311-7b311b71b768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:47.062799 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ee07d-7c4c-4b72-8311-7b311b71b768 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:47.073191 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ee07d-7c4c-4b72-8311-7b311b71b768 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:27:47.079924 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-f25ee07d-7c4c-4b72-8311-7b311b71b768 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:27:47.081031 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 520/1037] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:27:47 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:47.087222 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd19e2-0951-4ea7-a313-a2483b6a0b07 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:47.095834 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd19e2-0951-4ea7-a313-a2483b6a0b07 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:47.100550 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be04230-5938-448d-926f-659ef07ab0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:47.101186 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be04230-5938-448d-926f-659ef07ab0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:47.101469 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be04230-5938-448d-926f-659ef07ab0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:47.101738 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be04230-5938-448d-926f-659ef07ab0f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:47.102480 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be04230-5938-448d-926f-659ef07ab0f5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:47.102778 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be04230-5938-448d-926f-659ef07ab0f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:47.104415 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be04230-5938-448d-926f-659ef07ab0f5 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:47.112375 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 518/1038] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:27:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:47.119006 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ee07d-7c4c-4b72-8311-7b311b71b768 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:47.128949 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ee07d-7c4c-4b72-8311-7b311b71b768 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:47.134088 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8382094-0030-4280-9cf9-f3499a00ca1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:47.134905 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8382094-0030-4280-9cf9-f3499a00ca1c admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:47.135186 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8382094-0030-4280-9cf9-f3499a00ca1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:47.135460 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8382094-0030-4280-9cf9-f3499a00ca1c admin admin] PATH_INFO: `/v3/users/0efe0817a0be48968b60b411fe16c694` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:47.149936 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8382094-0030-4280-9cf9-f3499a00ca1c admin admin] RBAC: Authorizing `identity:get_user(user_id=0efe0817a0be48968b60b411fe16c694)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:47.153841 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8382094-0030-4280-9cf9-f3499a00ca1c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:47.155576 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 521/1039] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:27:47 2021] GET /identity/v3/users/0efe0817a0be48968b60b411fe16c694 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:47.161880 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be04230-5938-448d-926f-659ef07ab0f5 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:47.171184 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be04230-5938-448d-926f-659ef07ab0f5 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:47.175623 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53adf2f-0f38-482c-ae99-91df783dad57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:47.176264 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53adf2f-0f38-482c-ae99-91df783dad57 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:47.176543 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53adf2f-0f38-482c-ae99-91df783dad57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:47.176817 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53adf2f-0f38-482c-ae99-91df783dad57 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:47.184729 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53adf2f-0f38-482c-ae99-91df783dad57 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:47.186428 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53adf2f-0f38-482c-ae99-91df783dad57 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:47.195500 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 519/1040] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:27:47 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:27:47.201450 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8382094-0030-4280-9cf9-f3499a00ca1c admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:47.210620 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8382094-0030-4280-9cf9-f3499a00ca1c admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:47.215039 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c3d0b-98d8-4617-88fa-d5590a6252dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:47.215881 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c3d0b-98d8-4617-88fa-d5590a6252dc admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:47.216163 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c3d0b-98d8-4617-88fa-d5590a6252dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:47.216437 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c3d0b-98d8-4617-88fa-d5590a6252dc admin admin] PATH_INFO: `/v3/projects/a2ff851e44fe4891a95c7ce521f7d93f` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:47.217588 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c3d0b-98d8-4617-88fa-d5590a6252dc admin admin] RBAC: Authorizing `identity:get_project(project_id=a2ff851e44fe4891a95c7ce521f7d93f)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:47.219603 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c3d0b-98d8-4617-88fa-d5590a6252dc admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:47.221261 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 522/1041] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:27:47 2021] GET /identity/v3/projects/a2ff851e44fe4891a95c7ce521f7d93f => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:47.227784 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53adf2f-0f38-482c-ae99-91df783dad57 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:47.236295 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53adf2f-0f38-482c-ae99-91df783dad57 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:47.240645 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b91c8-fde1-4bd5-9e02-7aead1c7a798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:47.241792 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b91c8-fde1-4bd5-9e02-7aead1c7a798 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:47.242078 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b91c8-fde1-4bd5-9e02-7aead1c7a798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:47.242368 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b91c8-fde1-4bd5-9e02-7aead1c7a798 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:47.243185 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b91c8-fde1-4bd5-9e02-7aead1c7a798 admin admin] RBAC: Adding query filter params (role.id=15ba70b0cba04962a6d0b80b50c07004, scope.project.id=a2ff851e44fe4891a95c7ce521f7d93f, user.id=0efe0817a0be48968b60b411fe16c694) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:47.243487 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b91c8-fde1-4bd5-9e02-7aead1c7a798 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:47.245322 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b91c8-fde1-4bd5-9e02-7aead1c7a798 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:47.250446 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 520/1042] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:27:47 2021] GET /identity/v3/role_assignments?user.id=0efe0817a0be48968b60b411fe16c694&scope.project.id=a2ff851e44fe4891a95c7ce521f7d93f&role.id=15ba70b0cba04962a6d0b80b50c07004 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:49.440870 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e317490-5eef-48f4-bd19-7abdb22330fb None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:49.441435 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e317490-5eef-48f4-bd19-7abdb22330fb None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:49.441435 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e317490-5eef-48f4-bd19-7abdb22330fb None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:49.443203 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 523/1043] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:49.449528 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfae359-342b-41d1-bcd9-1cec69a3a06e None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:49.449956 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfae359-342b-41d1-bcd9-1cec69a3a06e None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:49.450085 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfae359-342b-41d1-bcd9-1cec69a3a06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:49.467211 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-bbfae359-342b-41d1-bcd9-1cec69a3a06e None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:49.468422 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-bbfae359-342b-41d1-bcd9-1cec69a3a06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:49.476334 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 521/1044] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:49 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:49.500132 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e317490-5eef-48f4-bd19-7abdb22330fb None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:49.512352 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e317490-5eef-48f4-bd19-7abdb22330fb None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:49.516573 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b178e3-cfa7-4af1-9999-a789ce52d69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:49.517311 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b178e3-cfa7-4af1-9999-a789ce52d69b admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:49.517588 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b178e3-cfa7-4af1-9999-a789ce52d69b admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:49.517859 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b178e3-cfa7-4af1-9999-a789ce52d69b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:49.528334 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b178e3-cfa7-4af1-9999-a789ce52d69b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:27:49.534963 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-a2b178e3-cfa7-4af1-9999-a789ce52d69b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:27:49.536096 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 524/1045] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:27:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:49.543085 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfae359-342b-41d1-bcd9-1cec69a3a06e None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:49.551718 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfae359-342b-41d1-bcd9-1cec69a3a06e None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:49.557235 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77671340-f527-4143-a899-b9f3462d6034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:49.558051 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77671340-f527-4143-a899-b9f3462d6034 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:49.558449 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77671340-f527-4143-a899-b9f3462d6034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:49.558732 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77671340-f527-4143-a899-b9f3462d6034 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:49.559574 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77671340-f527-4143-a899-b9f3462d6034 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:49.560079 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77671340-f527-4143-a899-b9f3462d6034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:49.562241 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77671340-f527-4143-a899-b9f3462d6034 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:49.570383 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 522/1046] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:27:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:49.576638 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b178e3-cfa7-4af1-9999-a789ce52d69b admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:49.587342 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b178e3-cfa7-4af1-9999-a789ce52d69b admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:49.591810 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39228f5-36dd-4658-a593-14368ee456dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:49.592633 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39228f5-36dd-4658-a593-14368ee456dd admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:49.592913 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39228f5-36dd-4658-a593-14368ee456dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:49.593186 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39228f5-36dd-4658-a593-14368ee456dd admin admin] PATH_INFO: `/v3/users/0efe0817a0be48968b60b411fe16c694` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:49.594370 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39228f5-36dd-4658-a593-14368ee456dd admin admin] RBAC: Authorizing `identity:get_user(user_id=0efe0817a0be48968b60b411fe16c694)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:49.596525 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39228f5-36dd-4658-a593-14368ee456dd admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:49.598496 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 525/1047] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:27:49 2021] GET /identity/v3/users/0efe0817a0be48968b60b411fe16c694 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:49.604802 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77671340-f527-4143-a899-b9f3462d6034 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:49.614001 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77671340-f527-4143-a899-b9f3462d6034 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:49.618519 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44430f8-b1ee-48b4-b14a-2894e7ee96e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:49.619331 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44430f8-b1ee-48b4-b14a-2894e7ee96e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:49.619612 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44430f8-b1ee-48b4-b14a-2894e7ee96e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:49.619919 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44430f8-b1ee-48b4-b14a-2894e7ee96e4 admin admin] PATH_INFO: `/v3/projects/a2ff851e44fe4891a95c7ce521f7d93f` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:49.621085 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44430f8-b1ee-48b4-b14a-2894e7ee96e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=a2ff851e44fe4891a95c7ce521f7d93f)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:49.623099 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44430f8-b1ee-48b4-b14a-2894e7ee96e4 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:49.624751 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 523/1048] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:27:49 2021] GET /identity/v3/projects/a2ff851e44fe4891a95c7ce521f7d93f => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:49.630594 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39228f5-36dd-4658-a593-14368ee456dd admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:49.640246 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39228f5-36dd-4658-a593-14368ee456dd admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:49.644689 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facec42d-c3aa-4ef5-aaf5-ffe18fa36838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:49.645501 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facec42d-c3aa-4ef5-aaf5-ffe18fa36838 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:49.645782 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facec42d-c3aa-4ef5-aaf5-ffe18fa36838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:49.646055 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facec42d-c3aa-4ef5-aaf5-ffe18fa36838 admin admin] PATH_INFO: `/v3/projects/a2ff851e44fe4891a95c7ce521f7d93f/users/0efe0817a0be48968b60b411fe16c694/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:49.648612 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facec42d-c3aa-4ef5-aaf5-ffe18fa36838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ff851e44fe4891a95c7ce521f7d93f, user_id=0efe0817a0be48968b60b411fe16c694, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:49.651174 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facec42d-c3aa-4ef5-aaf5-ffe18fa36838 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:49.663455 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 526/1049] 10.222.0.30 () {58 vars in 1460 bytes} [Fri Oct 15 03:27:49 2021] PUT /identity/v3/projects/a2ff851e44fe4891a95c7ce521f7d93f/users/0efe0817a0be48968b60b411fe16c694/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:27:51.852209 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354810df-a726-4743-bf1c-975ca8359480 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:51.852728 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354810df-a726-4743-bf1c-975ca8359480 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:51.852728 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354810df-a726-4743-bf1c-975ca8359480 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:51.854527 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 524/1050] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:51.860344 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9c5d4-89ac-4f8d-a4a1-520161ebc233 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:51.860761 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9c5d4-89ac-4f8d-a4a1-520161ebc233 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:51.860869 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9c5d4-89ac-4f8d-a4a1-520161ebc233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:51.878310 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-17a9c5d4-89ac-4f8d-a4a1-520161ebc233 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:51.879469 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-17a9c5d4-89ac-4f8d-a4a1-520161ebc233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:51.933457 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 527/1051] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:51 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:51.958827 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354810df-a726-4743-bf1c-975ca8359480 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:51.971180 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354810df-a726-4743-bf1c-975ca8359480 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:51.975781 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fec02-e263-4669-81f7-4c233bcd0916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:51.976538 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fec02-e263-4669-81f7-4c233bcd0916 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:51.976816 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fec02-e263-4669-81f7-4c233bcd0916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:51.977084 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fec02-e263-4669-81f7-4c233bcd0916 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:51.986894 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fec02-e263-4669-81f7-4c233bcd0916 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:27:51.993608 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-130fec02-e263-4669-81f7-4c233bcd0916 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:27:51.994720 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 525/1052] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:27:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:52.001161 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9c5d4-89ac-4f8d-a4a1-520161ebc233 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:52.010234 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9c5d4-89ac-4f8d-a4a1-520161ebc233 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:52.014608 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d273c4-2a2d-46e8-9d5c-f288ee68ff9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:52.015243 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d273c4-2a2d-46e8-9d5c-f288ee68ff9d admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:52.015520 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d273c4-2a2d-46e8-9d5c-f288ee68ff9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:52.015825 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d273c4-2a2d-46e8-9d5c-f288ee68ff9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:52.016574 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d273c4-2a2d-46e8-9d5c-f288ee68ff9d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:52.016874 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d273c4-2a2d-46e8-9d5c-f288ee68ff9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:52.018437 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d273c4-2a2d-46e8-9d5c-f288ee68ff9d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:52.026859 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 528/1053] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:27:52 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:52.032810 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fec02-e263-4669-81f7-4c233bcd0916 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:52.042968 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fec02-e263-4669-81f7-4c233bcd0916 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:52.047382 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed83be-c150-429e-ad13-4eb9d64ba087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:52.048219 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed83be-c150-429e-ad13-4eb9d64ba087 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:52.048496 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed83be-c150-429e-ad13-4eb9d64ba087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:52.048763 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed83be-c150-429e-ad13-4eb9d64ba087 admin admin] PATH_INFO: `/v3/users/0efe0817a0be48968b60b411fe16c694` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:52.049943 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed83be-c150-429e-ad13-4eb9d64ba087 admin admin] RBAC: Authorizing `identity:get_user(user_id=0efe0817a0be48968b60b411fe16c694)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:52.052082 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed83be-c150-429e-ad13-4eb9d64ba087 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:52.054355 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 526/1054] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:27:52 2021] GET /identity/v3/users/0efe0817a0be48968b60b411fe16c694 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:52.060141 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d273c4-2a2d-46e8-9d5c-f288ee68ff9d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:52.069177 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d273c4-2a2d-46e8-9d5c-f288ee68ff9d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:52.073517 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1d0c2-1d57-4b14-a7e4-9663feb99e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:52.074113 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1d0c2-1d57-4b14-a7e4-9663feb99e72 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:52.074391 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1d0c2-1d57-4b14-a7e4-9663feb99e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:52.074659 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1d0c2-1d57-4b14-a7e4-9663feb99e72 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:52.081966 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1d0c2-1d57-4b14-a7e4-9663feb99e72 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:52.083652 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1d0c2-1d57-4b14-a7e4-9663feb99e72 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:52.092025 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 529/1055] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:27:52 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:27:52.098075 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed83be-c150-429e-ad13-4eb9d64ba087 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:52.107663 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed83be-c150-429e-ad13-4eb9d64ba087 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:52.112036 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744ef81-c999-40b8-812b-dd2f1e2ea454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:52.112809 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744ef81-c999-40b8-812b-dd2f1e2ea454 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:52.113090 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744ef81-c999-40b8-812b-dd2f1e2ea454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:52.113365 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744ef81-c999-40b8-812b-dd2f1e2ea454 admin admin] PATH_INFO: `/v3/projects/a2ff851e44fe4891a95c7ce521f7d93f` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:52.114504 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744ef81-c999-40b8-812b-dd2f1e2ea454 admin admin] RBAC: Authorizing `identity:get_project(project_id=a2ff851e44fe4891a95c7ce521f7d93f)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:52.117151 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744ef81-c999-40b8-812b-dd2f1e2ea454 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:52.118749 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 527/1056] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:27:52 2021] GET /identity/v3/projects/a2ff851e44fe4891a95c7ce521f7d93f => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:27:52.125213 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1d0c2-1d57-4b14-a7e4-9663feb99e72 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:52.133921 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1d0c2-1d57-4b14-a7e4-9663feb99e72 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:52.138365 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b16b04-0daa-4a23-9f96-b82d48c3f69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:52.138983 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b16b04-0daa-4a23-9f96-b82d48c3f69f admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:52.139261 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b16b04-0daa-4a23-9f96-b82d48c3f69f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:52.139532 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b16b04-0daa-4a23-9f96-b82d48c3f69f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:52.140386 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b16b04-0daa-4a23-9f96-b82d48c3f69f admin admin] RBAC: Adding query filter params (role.id=15ba70b0cba04962a6d0b80b50c07004, scope.project.id=a2ff851e44fe4891a95c7ce521f7d93f, user.id=0efe0817a0be48968b60b411fe16c694) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:52.140690 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b16b04-0daa-4a23-9f96-b82d48c3f69f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:52.142499 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b16b04-0daa-4a23-9f96-b82d48c3f69f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:52.147912 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 530/1057] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:27:52 2021] GET /identity/v3/role_assignments?user.id=0efe0817a0be48968b60b411fe16c694&scope.project.id=a2ff851e44fe4891a95c7ce521f7d93f&role.id=15ba70b0cba04962a6d0b80b50c07004 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:54.375111 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862b1e0-2445-4500-b258-ed54a6d43b39 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:54.375641 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862b1e0-2445-4500-b258-ed54a6d43b39 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:54.375641 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862b1e0-2445-4500-b258-ed54a6d43b39 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:54.377437 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 528/1058] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:54.383372 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a94f60-e7e1-4c21-ad78-c2febefcd9a2 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:54.383806 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a94f60-e7e1-4c21-ad78-c2febefcd9a2 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:54.383957 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a94f60-e7e1-4c21-ad78-c2febefcd9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:54.401062 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-b0a94f60-e7e1-4c21-ad78-c2febefcd9a2 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:54.402225 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-b0a94f60-e7e1-4c21-ad78-c2febefcd9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:54.409723 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 531/1059] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:54 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:54.433457 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862b1e0-2445-4500-b258-ed54a6d43b39 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:54.446282 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862b1e0-2445-4500-b258-ed54a6d43b39 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:54.450782 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5751a96-9dff-478a-b839-475a806d195f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:54.451391 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5751a96-9dff-478a-b839-475a806d195f admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:54.451668 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5751a96-9dff-478a-b839-475a806d195f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:54.451961 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5751a96-9dff-478a-b839-475a806d195f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:54.459412 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5751a96-9dff-478a-b839-475a806d195f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:54.461772 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5751a96-9dff-478a-b839-475a806d195f admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:54.470199 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 529/1060] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:27:54 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:27:54.476941 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a94f60-e7e1-4c21-ad78-c2febefcd9a2 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:54.485576 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a94f60-e7e1-4c21-ad78-c2febefcd9a2 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:54.490012 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bc96d-1bc1-4197-be23-48f23d8e7def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:54.490776 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bc96d-1bc1-4197-be23-48f23d8e7def admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:54.491613 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bc96d-1bc1-4197-be23-48f23d8e7def admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:54.491913 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bc96d-1bc1-4197-be23-48f23d8e7def admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:54.498616 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205bc96d-1bc1-4197-be23-48f23d8e7def admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:54.500407 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205bc96d-1bc1-4197-be23-48f23d8e7def admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:54.514158 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-205bc96d-1bc1-4197-be23-48f23d8e7def admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 15 03:27:54.515250 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 532/1061] 10.222.0.30 () {56 vars in 1138 bytes} [Fri Oct 15 03:27:54 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:27:54.521361 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5751a96-9dff-478a-b839-475a806d195f admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:54.529681 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5751a96-9dff-478a-b839-475a806d195f admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:54.534048 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842fcacd-600f-418c-949a-04f28ef3ff52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:54.534650 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fcacd-600f-418c-949a-04f28ef3ff52 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:54.534926 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fcacd-600f-418c-949a-04f28ef3ff52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:54.535194 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fcacd-600f-418c-949a-04f28ef3ff52 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:54.535931 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842fcacd-600f-418c-949a-04f28ef3ff52 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:27:54.536230 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842fcacd-600f-418c-949a-04f28ef3ff52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:54.537864 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842fcacd-600f-418c-949a-04f28ef3ff52 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:54.544844 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 530/1062] 10.222.0.30 () {56 vars in 1136 bytes} [Fri Oct 15 03:27:54 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:56.754995 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fd9ba-43fc-4f71-8f7b-d3ff464243b9 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:56.755502 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fd9ba-43fc-4f71-8f7b-d3ff464243b9 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:56.755593 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fd9ba-43fc-4f71-8f7b-d3ff464243b9 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:56.757960 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 533/1063] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:56.763779 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828af29-b317-4599-990b-a5facc45e81c None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:56.764218 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828af29-b317-4599-990b-a5facc45e81c None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:56.764314 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828af29-b317-4599-990b-a5facc45e81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:56.781124 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-c828af29-b317-4599-990b-a5facc45e81c None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:56.782284 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c828af29-b317-4599-990b-a5facc45e81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:56.789676 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 531/1064] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:56 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:56.813605 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fd9ba-43fc-4f71-8f7b-d3ff464243b9 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:56.826415 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fd9ba-43fc-4f71-8f7b-d3ff464243b9 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:56.830690 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd168381-5348-474d-863e-137507f6c5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:56.831307 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd168381-5348-474d-863e-137507f6c5b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:56.831586 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd168381-5348-474d-863e-137507f6c5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:56.831894 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd168381-5348-474d-863e-137507f6c5b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:56.832650 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd168381-5348-474d-863e-137507f6c5b1 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:56.833646 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING py.warnings [None req-dd168381-5348-474d-863e-137507f6c5b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:27:56.833646 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: warnings.warn(msg) Oct 15 03:27:56.833646 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: Oct 15 03:27:56.834528 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd168381-5348-474d-863e-137507f6c5b1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:56.848735 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 534/1065] 10.222.0.30 () {60 vars in 1159 bytes} [Fri Oct 15 03:27:56 2021] POST /identity/v3/domains => generated 267 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:27:59.108968 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416a17c-db88-4f53-a4d7-cb7f7434f39d None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:59.109518 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416a17c-db88-4f53-a4d7-cb7f7434f39d None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:59.109518 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416a17c-db88-4f53-a4d7-cb7f7434f39d None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:59.111263 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 532/1066] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:27:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:27:59.117642 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d40ba7-6be0-496f-a958-35f00bea4169 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:59.118009 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d40ba7-6be0-496f-a958-35f00bea4169 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:59.118191 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d40ba7-6be0-496f-a958-35f00bea4169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:59.136041 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-84d40ba7-6be0-496f-a958-35f00bea4169 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:27:59.137211 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-84d40ba7-6be0-496f-a958-35f00bea4169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:27:59.195087 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 535/1067] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:27:59 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:27:59.219782 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e416a17c-db88-4f53-a4d7-cb7f7434f39d None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:59.232490 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e416a17c-db88-4f53-a4d7-cb7f7434f39d None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:59.236752 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cb25e-c0ec-48a8-ac27-d7e1314484ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:59.237574 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cb25e-c0ec-48a8-ac27-d7e1314484ef admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:59.237854 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cb25e-c0ec-48a8-ac27-d7e1314484ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:59.238126 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cb25e-c0ec-48a8-ac27-d7e1314484ef admin admin] PATH_INFO: `/v3/domains/63d9870429914d55894fb79356ec41a0` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:59.248499 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056cb25e-c0ec-48a8-ac27-d7e1314484ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=63d9870429914d55894fb79356ec41a0)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:59.250454 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056cb25e-c0ec-48a8-ac27-d7e1314484ef admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:59.252095 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 533/1068] 10.222.0.30 () {56 vars in 1204 bytes} [Fri Oct 15 03:27:59 2021] GET /identity/v3/domains/63d9870429914d55894fb79356ec41a0 => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:27:59.258357 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d40ba7-6be0-496f-a958-35f00bea4169 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:27:59.267053 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d40ba7-6be0-496f-a958-35f00bea4169 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:27:59.271476 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c816b68-8983-4c3b-9961-c6f130ec038d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:27:59.272666 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c816b68-8983-4c3b-9961-c6f130ec038d admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:27:59.272946 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c816b68-8983-4c3b-9961-c6f130ec038d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:27:59.273215 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c816b68-8983-4c3b-9961-c6f130ec038d admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:27:59.273932 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c816b68-8983-4c3b-9961-c6f130ec038d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:27:59.275833 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c816b68-8983-4c3b-9961-c6f130ec038d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:27:59.303600 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 536/1069] 10.222.0.30 () {60 vars in 1162 bytes} [Fri Oct 15 03:27:59 2021] POST /identity/v3/projects => generated 361 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:28:01.545521 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a221cd-8f7d-4f0e-b275-7e24f8b3d8f9 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:01.546013 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a221cd-8f7d-4f0e-b275-7e24f8b3d8f9 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:01.546013 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a221cd-8f7d-4f0e-b275-7e24f8b3d8f9 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:01.547784 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 534/1070] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:28:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:28:01.554500 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5952c62-4f2f-44df-9f2c-857bd1fd1e26 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:01.555365 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5952c62-4f2f-44df-9f2c-857bd1fd1e26 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:01.555645 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5952c62-4f2f-44df-9f2c-857bd1fd1e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:01.573845 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-d5952c62-4f2f-44df-9f2c-857bd1fd1e26 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:28:01.575023 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-d5952c62-4f2f-44df-9f2c-857bd1fd1e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:28:01.630953 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 537/1071] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:28:01 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:28:01.656890 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a221cd-8f7d-4f0e-b275-7e24f8b3d8f9 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:28:01.669076 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a221cd-8f7d-4f0e-b275-7e24f8b3d8f9 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:28:01.673353 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b29b7-4567-47bc-90bf-f29622779507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:28:01.674171 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b29b7-4567-47bc-90bf-f29622779507 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:01.674452 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b29b7-4567-47bc-90bf-f29622779507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:01.674725 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b29b7-4567-47bc-90bf-f29622779507 admin admin] PATH_INFO: `/v3/domains/63d9870429914d55894fb79356ec41a0` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:01.675916 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b29b7-4567-47bc-90bf-f29622779507 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=63d9870429914d55894fb79356ec41a0)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:28:01.677849 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b29b7-4567-47bc-90bf-f29622779507 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:28:01.679995 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 535/1072] 10.222.0.30 () {56 vars in 1204 bytes} [Fri Oct 15 03:28:01 2021] GET /identity/v3/domains/63d9870429914d55894fb79356ec41a0 => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:28:01.685882 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5952c62-4f2f-44df-9f2c-857bd1fd1e26 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:28:01.694438 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5952c62-4f2f-44df-9f2c-857bd1fd1e26 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:28:01.698823 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1caef2-a60e-4cc9-b681-afa3de6b9fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:28:01.699456 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1caef2-a60e-4cc9-b681-afa3de6b9fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:01.699771 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1caef2-a60e-4cc9-b681-afa3de6b9fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:01.700047 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1caef2-a60e-4cc9-b681-afa3de6b9fd5 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:01.700763 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1caef2-a60e-4cc9-b681-afa3de6b9fd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:28:01.702646 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1caef2-a60e-4cc9-b681-afa3de6b9fd5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:28:01.724520 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 538/1073] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Oct 15 03:28:01 2021] POST /identity/v3/users => generated 311 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:28:04.009742 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecd046-d130-47d1-9640-725cd8d60ee2 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:04.010332 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecd046-d130-47d1-9640-725cd8d60ee2 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:04.010332 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecd046-d130-47d1-9640-725cd8d60ee2 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:04.012102 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 536/1074] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:28:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:28:04.017915 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608f522-ecc8-48c0-8454-64c012a611b5 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:04.018298 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608f522-ecc8-48c0-8454-64c012a611b5 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:04.018471 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608f522-ecc8-48c0-8454-64c012a611b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:04.036092 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-2608f522-ecc8-48c0-8454-64c012a611b5 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:28:04.037269 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-2608f522-ecc8-48c0-8454-64c012a611b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:28:04.045325 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 539/1075] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:28:04 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:28:04.070158 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecd046-d130-47d1-9640-725cd8d60ee2 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:28:04.081856 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecd046-d130-47d1-9640-725cd8d60ee2 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:28:04.086769 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacae72-9117-4d45-9a54-b26d0a12765f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:28:04.087521 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacae72-9117-4d45-9a54-b26d0a12765f admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:04.087842 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacae72-9117-4d45-9a54-b26d0a12765f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:04.088116 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacae72-9117-4d45-9a54-b26d0a12765f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:04.098802 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aacae72-9117-4d45-9a54-b26d0a12765f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:28:04.105671 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-1aacae72-9117-4d45-9a54-b26d0a12765f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:28:04.106852 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 537/1076] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:28:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:28:04.115336 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608f522-ecc8-48c0-8454-64c012a611b5 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:28:04.124965 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608f522-ecc8-48c0-8454-64c012a611b5 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:28:04.129407 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d48ce2-f470-49f9-9662-040e2920f5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:28:04.130052 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d48ce2-f470-49f9-9662-040e2920f5ac admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:04.130332 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d48ce2-f470-49f9-9662-040e2920f5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:04.130607 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d48ce2-f470-49f9-9662-040e2920f5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:04.131916 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d48ce2-f470-49f9-9662-040e2920f5ac admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:28:04.132220 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d48ce2-f470-49f9-9662-040e2920f5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:28:04.133937 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d48ce2-f470-49f9-9662-040e2920f5ac admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:28:04.141840 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 540/1077] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:28:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:28:04.148531 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacae72-9117-4d45-9a54-b26d0a12765f admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:28:04.157856 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacae72-9117-4d45-9a54-b26d0a12765f admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:28:04.162266 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83a93e-14f9-45a0-a999-b62ea3522b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:28:04.163086 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83a93e-14f9-45a0-a999-b62ea3522b2f admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:04.163364 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83a93e-14f9-45a0-a999-b62ea3522b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:04.163632 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83a93e-14f9-45a0-a999-b62ea3522b2f admin admin] PATH_INFO: `/v3/users/7e0b2cfe7dfc4d028c2c4e2c6fe25f99` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:04.176416 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83a93e-14f9-45a0-a999-b62ea3522b2f admin admin] RBAC: Authorizing `identity:get_user(user_id=7e0b2cfe7dfc4d028c2c4e2c6fe25f99)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:28:04.178523 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83a93e-14f9-45a0-a999-b62ea3522b2f admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:28:04.180124 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 538/1078] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:28:04 2021] GET /identity/v3/users/7e0b2cfe7dfc4d028c2c4e2c6fe25f99 => generated 311 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:28:04.186342 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d48ce2-f470-49f9-9662-040e2920f5ac admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:28:04.196206 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d48ce2-f470-49f9-9662-040e2920f5ac admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:28:04.200626 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cb065-67ed-41d2-bba4-0506467bd84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:28:04.201242 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cb065-67ed-41d2-bba4-0506467bd84b admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:04.201522 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cb065-67ed-41d2-bba4-0506467bd84b admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:04.201798 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cb065-67ed-41d2-bba4-0506467bd84b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:04.209331 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cb065-67ed-41d2-bba4-0506467bd84b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:28:04.211707 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cb065-67ed-41d2-bba4-0506467bd84b admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:28:04.220299 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 541/1079] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:28:04 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:28:04.226490 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83a93e-14f9-45a0-a999-b62ea3522b2f admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:28:04.235648 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83a93e-14f9-45a0-a999-b62ea3522b2f admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:28:04.240082 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee8ac9-1135-4e56-ac1d-92a7f0113171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:28:04.241409 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee8ac9-1135-4e56-ac1d-92a7f0113171 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:04.241683 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee8ac9-1135-4e56-ac1d-92a7f0113171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:04.241950 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee8ac9-1135-4e56-ac1d-92a7f0113171 admin admin] PATH_INFO: `/v3/projects/b0f0d452c0494e54aeddcd4eadc3d776` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:04.243110 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee8ac9-1135-4e56-ac1d-92a7f0113171 admin admin] RBAC: Authorizing `identity:get_project(project_id=b0f0d452c0494e54aeddcd4eadc3d776)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:28:04.245222 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee8ac9-1135-4e56-ac1d-92a7f0113171 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:28:04.246836 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 539/1080] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:28:04 2021] GET /identity/v3/projects/b0f0d452c0494e54aeddcd4eadc3d776 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:28:04.253192 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cb065-67ed-41d2-bba4-0506467bd84b admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:28:04.262499 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cb065-67ed-41d2-bba4-0506467bd84b admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:28:04.266930 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312505b-64b8-4c05-94ed-573b5ec23351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:28:04.267547 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312505b-64b8-4c05-94ed-573b5ec23351 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:04.267870 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312505b-64b8-4c05-94ed-573b5ec23351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:04.268146 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312505b-64b8-4c05-94ed-573b5ec23351 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:04.268971 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312505b-64b8-4c05-94ed-573b5ec23351 admin admin] RBAC: Adding query filter params (role.id=15ba70b0cba04962a6d0b80b50c07004, scope.project.id=b0f0d452c0494e54aeddcd4eadc3d776, user.id=7e0b2cfe7dfc4d028c2c4e2c6fe25f99) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:28:04.269277 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312505b-64b8-4c05-94ed-573b5ec23351 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:28:04.271084 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312505b-64b8-4c05-94ed-573b5ec23351 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:28:04.276215 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 542/1081] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:28:04 2021] GET /identity/v3/role_assignments?user.id=7e0b2cfe7dfc4d028c2c4e2c6fe25f99&scope.project.id=b0f0d452c0494e54aeddcd4eadc3d776&role.id=15ba70b0cba04962a6d0b80b50c07004 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:28:06.491368 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03928da4-4831-4248-b70e-a56282a1c4f2 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:06.491937 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03928da4-4831-4248-b70e-a56282a1c4f2 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:06.491937 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03928da4-4831-4248-b70e-a56282a1c4f2 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:06.493770 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 540/1082] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:28:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:28:06.499584 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4725c2d-798f-4537-bb92-0f6f5c8c7271 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:06.500063 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4725c2d-798f-4537-bb92-0f6f5c8c7271 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:06.500163 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4725c2d-798f-4537-bb92-0f6f5c8c7271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:06.517242 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-b4725c2d-798f-4537-bb92-0f6f5c8c7271 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:28:06.518422 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-b4725c2d-798f-4537-bb92-0f6f5c8c7271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:28:06.526571 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 543/1083] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:28:06 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:28:06.550383 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03928da4-4831-4248-b70e-a56282a1c4f2 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:28:06.562215 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03928da4-4831-4248-b70e-a56282a1c4f2 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:28:06.566516 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745cce7-274f-42dc-b1bb-35034dae77e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:28:06.567266 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745cce7-274f-42dc-b1bb-35034dae77e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:06.567550 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745cce7-274f-42dc-b1bb-35034dae77e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:06.567854 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745cce7-274f-42dc-b1bb-35034dae77e6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:06.577692 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745cce7-274f-42dc-b1bb-35034dae77e6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:28:06.584990 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-c745cce7-274f-42dc-b1bb-35034dae77e6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:28:06.586105 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 541/1084] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:28:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:28:06.592988 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4725c2d-798f-4537-bb92-0f6f5c8c7271 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:28:06.603826 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4725c2d-798f-4537-bb92-0f6f5c8c7271 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:28:06.608730 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec7c37-74a3-44f7-96d5-5363cf0a1a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:28:06.609372 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec7c37-74a3-44f7-96d5-5363cf0a1a16 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:06.609651 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec7c37-74a3-44f7-96d5-5363cf0a1a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:06.609926 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec7c37-74a3-44f7-96d5-5363cf0a1a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:06.610676 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec7c37-74a3-44f7-96d5-5363cf0a1a16 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:28:06.610976 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec7c37-74a3-44f7-96d5-5363cf0a1a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:28:06.612589 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec7c37-74a3-44f7-96d5-5363cf0a1a16 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:28:06.620575 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 544/1085] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:28:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:28:06.626921 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745cce7-274f-42dc-b1bb-35034dae77e6 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:28:06.636912 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745cce7-274f-42dc-b1bb-35034dae77e6 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:28:06.641420 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3e203-d35a-4a69-bc6c-553faa9966d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:28:06.642247 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3e203-d35a-4a69-bc6c-553faa9966d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:06.642528 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3e203-d35a-4a69-bc6c-553faa9966d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:06.642805 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3e203-d35a-4a69-bc6c-553faa9966d9 admin admin] PATH_INFO: `/v3/users/7e0b2cfe7dfc4d028c2c4e2c6fe25f99` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:06.644027 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3e203-d35a-4a69-bc6c-553faa9966d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=7e0b2cfe7dfc4d028c2c4e2c6fe25f99)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:28:06.646147 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3e203-d35a-4a69-bc6c-553faa9966d9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:28:06.648245 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 542/1086] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:28:06 2021] GET /identity/v3/users/7e0b2cfe7dfc4d028c2c4e2c6fe25f99 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:28:06.654296 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec7c37-74a3-44f7-96d5-5363cf0a1a16 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:28:06.664360 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec7c37-74a3-44f7-96d5-5363cf0a1a16 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:28:06.668807 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b2bee-e2e4-4ac5-867e-68b103c96dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:28:06.669629 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b2bee-e2e4-4ac5-867e-68b103c96dfb admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:06.669913 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b2bee-e2e4-4ac5-867e-68b103c96dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:06.670190 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b2bee-e2e4-4ac5-867e-68b103c96dfb admin admin] PATH_INFO: `/v3/projects/b0f0d452c0494e54aeddcd4eadc3d776` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:06.671361 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b2bee-e2e4-4ac5-867e-68b103c96dfb admin admin] RBAC: Authorizing `identity:get_project(project_id=b0f0d452c0494e54aeddcd4eadc3d776)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:28:06.673428 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b2bee-e2e4-4ac5-867e-68b103c96dfb admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:28:06.675169 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 545/1087] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:28:06 2021] GET /identity/v3/projects/b0f0d452c0494e54aeddcd4eadc3d776 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:28:06.680915 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3e203-d35a-4a69-bc6c-553faa9966d9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:28:06.689943 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3e203-d35a-4a69-bc6c-553faa9966d9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:28:06.694353 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ab258-bc2a-4679-9d9e-0af3acf2142a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:28:06.695166 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ab258-bc2a-4679-9d9e-0af3acf2142a admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:06.695449 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ab258-bc2a-4679-9d9e-0af3acf2142a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:06.695757 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ab258-bc2a-4679-9d9e-0af3acf2142a admin admin] PATH_INFO: `/v3/projects/b0f0d452c0494e54aeddcd4eadc3d776/users/7e0b2cfe7dfc4d028c2c4e2c6fe25f99/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:06.697674 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ab258-bc2a-4679-9d9e-0af3acf2142a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0f0d452c0494e54aeddcd4eadc3d776, user_id=7e0b2cfe7dfc4d028c2c4e2c6fe25f99, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:28:06.700276 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ab258-bc2a-4679-9d9e-0af3acf2142a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:28:06.713048 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 543/1088] 10.222.0.30 () {58 vars in 1460 bytes} [Fri Oct 15 03:28:06 2021] PUT /identity/v3/projects/b0f0d452c0494e54aeddcd4eadc3d776/users/7e0b2cfe7dfc4d028c2c4e2c6fe25f99/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:28:08.948855 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444cf18-2159-4fc3-9ecd-3b9ac5693429 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:08.949408 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444cf18-2159-4fc3-9ecd-3b9ac5693429 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:08.949408 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444cf18-2159-4fc3-9ecd-3b9ac5693429 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:08.951188 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 546/1089] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:28:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:28:08.956955 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c80da-1012-4aef-a839-fe2ed485d289 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:08.957381 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c80da-1012-4aef-a839-fe2ed485d289 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:08.957484 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c80da-1012-4aef-a839-fe2ed485d289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:08.975707 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-5b2c80da-1012-4aef-a839-fe2ed485d289 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:28:08.976874 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-5b2c80da-1012-4aef-a839-fe2ed485d289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:28:09.029937 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 544/1090] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:28:08 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:28:09.054726 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444cf18-2159-4fc3-9ecd-3b9ac5693429 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:28:09.066495 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444cf18-2159-4fc3-9ecd-3b9ac5693429 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:28:09.071318 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6529571-1183-4213-bc9f-ebaa1cab3629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:28:09.072109 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6529571-1183-4213-bc9f-ebaa1cab3629 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:09.072394 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6529571-1183-4213-bc9f-ebaa1cab3629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:09.072672 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6529571-1183-4213-bc9f-ebaa1cab3629 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:09.082417 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6529571-1183-4213-bc9f-ebaa1cab3629 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:28:09.089142 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-d6529571-1183-4213-bc9f-ebaa1cab3629 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:28:09.090246 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 547/1091] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:28:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:28:09.096420 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c80da-1012-4aef-a839-fe2ed485d289 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:28:09.105158 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c80da-1012-4aef-a839-fe2ed485d289 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:28:09.109515 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4237d4-4112-44cb-8c5b-225d7a939d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:28:09.110146 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4237d4-4112-44cb-8c5b-225d7a939d57 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:09.110424 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4237d4-4112-44cb-8c5b-225d7a939d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:09.110697 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4237d4-4112-44cb-8c5b-225d7a939d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:09.111429 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4237d4-4112-44cb-8c5b-225d7a939d57 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:28:09.111756 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4237d4-4112-44cb-8c5b-225d7a939d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:28:09.113331 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4237d4-4112-44cb-8c5b-225d7a939d57 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:28:09.121615 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 545/1092] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:28:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:28:09.128801 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6529571-1183-4213-bc9f-ebaa1cab3629 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:28:09.138572 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6529571-1183-4213-bc9f-ebaa1cab3629 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:28:09.143049 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8caa2-aa20-4228-937e-f18c5c6a856e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:28:09.143900 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8caa2-aa20-4228-937e-f18c5c6a856e admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:09.144180 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8caa2-aa20-4228-937e-f18c5c6a856e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:09.144452 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8caa2-aa20-4228-937e-f18c5c6a856e admin admin] PATH_INFO: `/v3/users/7e0b2cfe7dfc4d028c2c4e2c6fe25f99` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:09.145620 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8caa2-aa20-4228-937e-f18c5c6a856e admin admin] RBAC: Authorizing `identity:get_user(user_id=7e0b2cfe7dfc4d028c2c4e2c6fe25f99)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:28:09.147762 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8caa2-aa20-4228-937e-f18c5c6a856e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:28:09.149304 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 548/1093] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:28:09 2021] GET /identity/v3/users/7e0b2cfe7dfc4d028c2c4e2c6fe25f99 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:28:09.155239 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4237d4-4112-44cb-8c5b-225d7a939d57 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:28:09.164670 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4237d4-4112-44cb-8c5b-225d7a939d57 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:28:09.169050 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd3333-05be-4347-9f7f-631b66c2ee1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:28:09.169647 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd3333-05be-4347-9f7f-631b66c2ee1a admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:09.169925 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd3333-05be-4347-9f7f-631b66c2ee1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:09.170196 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd3333-05be-4347-9f7f-631b66c2ee1a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:09.177527 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd3333-05be-4347-9f7f-631b66c2ee1a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:28:09.179925 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd3333-05be-4347-9f7f-631b66c2ee1a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:28:09.188319 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 546/1094] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:28:09 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:28:09.194233 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8caa2-aa20-4228-937e-f18c5c6a856e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:28:09.203436 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8caa2-aa20-4228-937e-f18c5c6a856e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:28:09.207811 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cffd9-2789-4fae-a02e-46a680e2831e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:28:09.208596 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cffd9-2789-4fae-a02e-46a680e2831e admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:09.208878 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cffd9-2789-4fae-a02e-46a680e2831e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:09.209151 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cffd9-2789-4fae-a02e-46a680e2831e admin admin] PATH_INFO: `/v3/projects/b0f0d452c0494e54aeddcd4eadc3d776` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:09.210308 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cffd9-2789-4fae-a02e-46a680e2831e admin admin] RBAC: Authorizing `identity:get_project(project_id=b0f0d452c0494e54aeddcd4eadc3d776)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:28:09.212341 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cffd9-2789-4fae-a02e-46a680e2831e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:28:09.213929 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 549/1095] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:28:09 2021] GET /identity/v3/projects/b0f0d452c0494e54aeddcd4eadc3d776 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:28:09.219914 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd3333-05be-4347-9f7f-631b66c2ee1a admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:28:09.228788 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd3333-05be-4347-9f7f-631b66c2ee1a admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:28:09.233263 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc2864-6285-4998-9f64-48d2dac0cf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:28:09.233866 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc2864-6285-4998-9f64-48d2dac0cf20 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:28:09.234144 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc2864-6285-4998-9f64-48d2dac0cf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:28:09.234413 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc2864-6285-4998-9f64-48d2dac0cf20 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:28:09.235225 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc2864-6285-4998-9f64-48d2dac0cf20 admin admin] RBAC: Adding query filter params (role.id=15ba70b0cba04962a6d0b80b50c07004, scope.project.id=b0f0d452c0494e54aeddcd4eadc3d776, user.id=7e0b2cfe7dfc4d028c2c4e2c6fe25f99) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:28:09.235527 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc2864-6285-4998-9f64-48d2dac0cf20 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:28:09.237357 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc2864-6285-4998-9f64-48d2dac0cf20 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:28:09.243872 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 547/1096] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:28:09 2021] GET /identity/v3/role_assignments?user.id=7e0b2cfe7dfc4d028c2c4e2c6fe25f99&scope.project.id=b0f0d452c0494e54aeddcd4eadc3d776&role.id=15ba70b0cba04962a6d0b80b50c07004 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:04.468751 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1611bf-ebcf-4b9c-ad31-87c75526b320 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:04.469403 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1611bf-ebcf-4b9c-ad31-87c75526b320 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:04.469403 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1611bf-ebcf-4b9c-ad31-87c75526b320 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:04.471654 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 550/1097] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:29:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:29:04.478565 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816d393-bb51-4a42-9819-c39e41d58905 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:04.479184 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816d393-bb51-4a42-9819-c39e41d58905 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:04.479184 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816d393-bb51-4a42-9819-c39e41d58905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:04.497380 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-1816d393-bb51-4a42-9819-c39e41d58905 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:29:04.498514 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-1816d393-bb51-4a42-9819-c39e41d58905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:29:04.515868 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 548/1098] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:29:04 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:29:04.532893 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1611bf-ebcf-4b9c-ad31-87c75526b320 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:04.550125 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1611bf-ebcf-4b9c-ad31-87c75526b320 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:04.555041 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802736fc-c6c6-4700-8357-2e9cb3fd14bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:04.556078 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802736fc-c6c6-4700-8357-2e9cb3fd14bd admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:04.556404 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802736fc-c6c6-4700-8357-2e9cb3fd14bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:04.556643 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802736fc-c6c6-4700-8357-2e9cb3fd14bd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:04.568819 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802736fc-c6c6-4700-8357-2e9cb3fd14bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:04.571350 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802736fc-c6c6-4700-8357-2e9cb3fd14bd admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:04.591599 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-802736fc-c6c6-4700-8357-2e9cb3fd14bd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:29:04.593144 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 551/1099] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:29:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:29:04.603075 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816d393-bb51-4a42-9819-c39e41d58905 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:04.617176 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816d393-bb51-4a42-9819-c39e41d58905 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:04.622977 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7074a2-b65b-43f0-ae47-ba7db402ef81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:04.624881 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7074a2-b65b-43f0-ae47-ba7db402ef81 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:04.625171 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7074a2-b65b-43f0-ae47-ba7db402ef81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:04.625451 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7074a2-b65b-43f0-ae47-ba7db402ef81 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:04.626219 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7074a2-b65b-43f0-ae47-ba7db402ef81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:04.626536 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7074a2-b65b-43f0-ae47-ba7db402ef81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:04.628479 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7074a2-b65b-43f0-ae47-ba7db402ef81 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:04.648645 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 549/1100] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:29:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:04.651504 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802736fc-c6c6-4700-8357-2e9cb3fd14bd admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:04.668806 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802736fc-c6c6-4700-8357-2e9cb3fd14bd admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:04.674614 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fe746-a062-4444-ad51-8e88e043fe53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:04.675423 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fe746-a062-4444-ad51-8e88e043fe53 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:04.675826 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fe746-a062-4444-ad51-8e88e043fe53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:04.676218 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fe746-a062-4444-ad51-8e88e043fe53 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:04.677217 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fe746-a062-4444-ad51-8e88e043fe53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:04.679417 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fe746-a062-4444-ad51-8e88e043fe53 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:04.718590 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 552/1101] 10.222.0.30 () {60 vars in 1153 bytes} [Fri Oct 15 03:29:04 2021] POST /identity/v3/users => generated 251 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:29:07.399395 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45762b1d-1a43-4ef0-806f-eeae1967485c None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:07.399974 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45762b1d-1a43-4ef0-806f-eeae1967485c None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:07.400089 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45762b1d-1a43-4ef0-806f-eeae1967485c None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:07.401994 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 550/1102] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:29:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:29:07.407830 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b39340-c9e9-4f38-b3eb-b4c82097ee8c None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:07.408365 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b39340-c9e9-4f38-b3eb-b4c82097ee8c None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:07.408493 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b39340-c9e9-4f38-b3eb-b4c82097ee8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:07.426608 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-33b39340-c9e9-4f38-b3eb-b4c82097ee8c None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:29:07.427843 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-33b39340-c9e9-4f38-b3eb-b4c82097ee8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:29:07.438106 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 553/1103] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:29:07 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:29:07.462303 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45762b1d-1a43-4ef0-806f-eeae1967485c None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:07.476656 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45762b1d-1a43-4ef0-806f-eeae1967485c None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:07.481415 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728dd92-4999-481e-9f54-8e722748b100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:07.482192 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728dd92-4999-481e-9f54-8e722748b100 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:07.482476 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728dd92-4999-481e-9f54-8e722748b100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:07.482761 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728dd92-4999-481e-9f54-8e722748b100 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:07.495630 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728dd92-4999-481e-9f54-8e722748b100 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:29:07.502498 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-6728dd92-4999-481e-9f54-8e722748b100 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 03:29:07.503894 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 551/1104] 10.222.0.30 () {56 vars in 1123 bytes} [Fri Oct 15 03:29:07 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:07.511007 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b39340-c9e9-4f38-b3eb-b4c82097ee8c None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:07.522135 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b39340-c9e9-4f38-b3eb-b4c82097ee8c None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:07.525133 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064e001-d947-4186-b3e7-da3199238f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:07.525759 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064e001-d947-4186-b3e7-da3199238f3b admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:07.526042 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064e001-d947-4186-b3e7-da3199238f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:07.526343 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064e001-d947-4186-b3e7-da3199238f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:07.527119 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3064e001-d947-4186-b3e7-da3199238f3b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:07.527391 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3064e001-d947-4186-b3e7-da3199238f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:07.530131 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3064e001-d947-4186-b3e7-da3199238f3b admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:07.543309 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 554/1105] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Oct 15 03:29:07 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:07.545220 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728dd92-4999-481e-9f54-8e722748b100 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:07.556263 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728dd92-4999-481e-9f54-8e722748b100 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:07.561009 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981a75e-f75e-48a6-868e-0232db05f242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:07.562000 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981a75e-f75e-48a6-868e-0232db05f242 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:07.562312 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981a75e-f75e-48a6-868e-0232db05f242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:07.562636 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981a75e-f75e-48a6-868e-0232db05f242 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:07.576192 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981a75e-f75e-48a6-868e-0232db05f242 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:07.578213 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981a75e-f75e-48a6-868e-0232db05f242 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:07.597093 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-8981a75e-f75e-48a6-868e-0232db05f242 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:29:07.598306 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 552/1106] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:29:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:07.605749 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064e001-d947-4186-b3e7-da3199238f3b admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:07.617097 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064e001-d947-4186-b3e7-da3199238f3b admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:07.622456 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268575e-bcf0-4802-82c2-04d54be6ee97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:07.623211 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268575e-bcf0-4802-82c2-04d54be6ee97 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:07.623563 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268575e-bcf0-4802-82c2-04d54be6ee97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:07.623938 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268575e-bcf0-4802-82c2-04d54be6ee97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:07.624756 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268575e-bcf0-4802-82c2-04d54be6ee97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:07.625102 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268575e-bcf0-4802-82c2-04d54be6ee97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:07.626965 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268575e-bcf0-4802-82c2-04d54be6ee97 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:07.641143 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 555/1107] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:29:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:29:07.647252 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981a75e-f75e-48a6-868e-0232db05f242 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:07.658602 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981a75e-f75e-48a6-868e-0232db05f242 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:07.663902 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3c202-87fa-4495-9d2a-41bed84ebf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:07.664939 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3c202-87fa-4495-9d2a-41bed84ebf20 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:07.665313 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3c202-87fa-4495-9d2a-41bed84ebf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:07.665667 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3c202-87fa-4495-9d2a-41bed84ebf20 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:07.673664 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3c202-87fa-4495-9d2a-41bed84ebf20 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:07.675744 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3c202-87fa-4495-9d2a-41bed84ebf20 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:07.689708 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-9cd3c202-87fa-4495-9d2a-41bed84ebf20 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 15 03:29:07.691237 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 553/1108] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:29:07 2021] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:07.698486 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268575e-bcf0-4802-82c2-04d54be6ee97 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:07.710027 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268575e-bcf0-4802-82c2-04d54be6ee97 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:07.715587 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975dcf8-da6e-46a7-8b2c-572a4ddb0a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:07.716376 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975dcf8-da6e-46a7-8b2c-572a4ddb0a8f admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:07.717666 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975dcf8-da6e-46a7-8b2c-572a4ddb0a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:07.717666 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975dcf8-da6e-46a7-8b2c-572a4ddb0a8f admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:07.718384 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975dcf8-da6e-46a7-8b2c-572a4ddb0a8f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:07.718731 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975dcf8-da6e-46a7-8b2c-572a4ddb0a8f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:07.721037 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975dcf8-da6e-46a7-8b2c-572a4ddb0a8f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:07.743162 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 556/1109] 10.222.0.30 () {56 vars in 1164 bytes} [Fri Oct 15 03:29:07 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:29:07.749584 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3c202-87fa-4495-9d2a-41bed84ebf20 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:07.762480 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3c202-87fa-4495-9d2a-41bed84ebf20 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:07.767922 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6c965-055c-4151-9016-75595cefadc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:07.768557 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6c965-055c-4151-9016-75595cefadc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:07.768841 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6c965-055c-4151-9016-75595cefadc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:07.769112 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6c965-055c-4151-9016-75595cefadc6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:07.778504 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6c965-055c-4151-9016-75595cefadc6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:07.780678 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6c965-055c-4151-9016-75595cefadc6 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:07.791010 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 554/1110] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:29:07 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:29:07.798732 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975dcf8-da6e-46a7-8b2c-572a4ddb0a8f admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:07.810645 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975dcf8-da6e-46a7-8b2c-572a4ddb0a8f admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:07.815956 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7710f9-a11b-4d8e-8d37-82ef8a07cfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:07.816859 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7710f9-a11b-4d8e-8d37-82ef8a07cfff admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:07.817145 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7710f9-a11b-4d8e-8d37-82ef8a07cfff admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:07.817434 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7710f9-a11b-4d8e-8d37-82ef8a07cfff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:07.831870 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7710f9-a11b-4d8e-8d37-82ef8a07cfff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:07.833801 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7710f9-a11b-4d8e-8d37-82ef8a07cfff admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:07.854140 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-0e7710f9-a11b-4d8e-8d37-82ef8a07cfff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:29:07.855453 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 557/1111] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:29:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:07.862263 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6c965-055c-4151-9016-75595cefadc6 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:07.873115 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6c965-055c-4151-9016-75595cefadc6 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:07.878472 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee8748-23c3-41ef-9095-1bac0eaa1442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:07.879139 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee8748-23c3-41ef-9095-1bac0eaa1442 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:07.879420 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee8748-23c3-41ef-9095-1bac0eaa1442 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:07.879765 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee8748-23c3-41ef-9095-1bac0eaa1442 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:07.880609 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee8748-23c3-41ef-9095-1bac0eaa1442 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:07.881000 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee8748-23c3-41ef-9095-1bac0eaa1442 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:07.883015 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee8748-23c3-41ef-9095-1bac0eaa1442 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:07.904457 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 555/1112] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:29:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:07.905816 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7710f9-a11b-4d8e-8d37-82ef8a07cfff admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:07.918049 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7710f9-a11b-4d8e-8d37-82ef8a07cfff admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:07.923305 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb4926-40c3-4919-8793-1e67cb00d0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:07.924269 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb4926-40c3-4919-8793-1e67cb00d0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:07.924577 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb4926-40c3-4919-8793-1e67cb00d0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:07.924991 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb4926-40c3-4919-8793-1e67cb00d0d4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:07.934197 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb4926-40c3-4919-8793-1e67cb00d0d4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:07.936365 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb4926-40c3-4919-8793-1e67cb00d0d4 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:07.950809 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-87fb4926-40c3-4919-8793-1e67cb00d0d4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:29:07.952299 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 558/1113] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:29:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:07.959081 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee8748-23c3-41ef-9095-1bac0eaa1442 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:07.970666 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee8748-23c3-41ef-9095-1bac0eaa1442 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:07.976566 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e39bd-99ba-4d91-876b-3c9ad60315ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:07.977337 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e39bd-99ba-4d91-876b-3c9ad60315ad admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:07.977673 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e39bd-99ba-4d91-876b-3c9ad60315ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:07.977967 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e39bd-99ba-4d91-876b-3c9ad60315ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:07.978847 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e39bd-99ba-4d91-876b-3c9ad60315ad admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:07.979185 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e39bd-99ba-4d91-876b-3c9ad60315ad admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:07.981277 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e39bd-99ba-4d91-876b-3c9ad60315ad admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:07.994774 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 556/1114] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:29:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:08.001410 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb4926-40c3-4919-8793-1e67cb00d0d4 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:08.012577 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb4926-40c3-4919-8793-1e67cb00d0d4 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:08.019220 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b46bcf-4fff-4456-a946-5e37d4a54117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:08.020008 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b46bcf-4fff-4456-a946-5e37d4a54117 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:08.020292 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b46bcf-4fff-4456-a946-5e37d4a54117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:08.020601 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b46bcf-4fff-4456-a946-5e37d4a54117 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:08.021566 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b46bcf-4fff-4456-a946-5e37d4a54117 admin admin] RBAC: Adding query filter params (role.id=04a530eb7b7e46d4a07b4c3b02cee3aa, scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user.id=bffc0480ffb942cdad426195eca0529e) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:08.021874 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b46bcf-4fff-4456-a946-5e37d4a54117 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:08.024394 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b46bcf-4fff-4456-a946-5e37d4a54117 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:08.031074 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 559/1115] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:29:08 2021] GET /identity/v3/role_assignments?user.id=bffc0480ffb942cdad426195eca0529e&scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20&role.id=04a530eb7b7e46d4a07b4c3b02cee3aa => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:29:10.431647 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149cd06-c2a5-44f0-b98c-33089a7b369f None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:10.432205 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149cd06-c2a5-44f0-b98c-33089a7b369f None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:10.432205 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149cd06-c2a5-44f0-b98c-33089a7b369f None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:10.434185 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 557/1116] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:29:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:29:10.441112 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4184bd-d4d7-4501-a1fd-2081a8239c7b None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:10.441570 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4184bd-d4d7-4501-a1fd-2081a8239c7b None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:10.441871 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4184bd-d4d7-4501-a1fd-2081a8239c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:10.462336 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-ed4184bd-d4d7-4501-a1fd-2081a8239c7b None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:29:10.463529 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-ed4184bd-d4d7-4501-a1fd-2081a8239c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:29:10.473117 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 560/1117] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:29:10 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:29:10.501251 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149cd06-c2a5-44f0-b98c-33089a7b369f None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:10.518117 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149cd06-c2a5-44f0-b98c-33089a7b369f None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:10.524293 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a92420-01f1-4783-9084-26162affe6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:10.525094 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a92420-01f1-4783-9084-26162affe6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:10.525376 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a92420-01f1-4783-9084-26162affe6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:10.525647 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a92420-01f1-4783-9084-26162affe6a3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:10.536105 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a92420-01f1-4783-9084-26162affe6a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:29:10.542956 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-10a92420-01f1-4783-9084-26162affe6a3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 03:29:10.545141 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 558/1118] 10.222.0.30 () {56 vars in 1123 bytes} [Fri Oct 15 03:29:10 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:10.550955 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4184bd-d4d7-4501-a1fd-2081a8239c7b None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:10.562562 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4184bd-d4d7-4501-a1fd-2081a8239c7b None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:10.568014 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650dedd-557c-456a-b48b-2ca4d55423e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:10.569170 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650dedd-557c-456a-b48b-2ca4d55423e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:10.569476 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650dedd-557c-456a-b48b-2ca4d55423e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:10.570456 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650dedd-557c-456a-b48b-2ca4d55423e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:10.571324 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650dedd-557c-456a-b48b-2ca4d55423e1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:10.571753 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650dedd-557c-456a-b48b-2ca4d55423e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:10.573564 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650dedd-557c-456a-b48b-2ca4d55423e1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:10.588668 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 561/1119] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Oct 15 03:29:10 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:10.590055 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a92420-01f1-4783-9084-26162affe6a3 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:10.602794 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a92420-01f1-4783-9084-26162affe6a3 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:10.607957 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76486bfd-986b-44e9-a191-f5450b796219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:10.610075 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76486bfd-986b-44e9-a191-f5450b796219 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:10.610379 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76486bfd-986b-44e9-a191-f5450b796219 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:10.610647 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76486bfd-986b-44e9-a191-f5450b796219 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:10.623613 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76486bfd-986b-44e9-a191-f5450b796219 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:10.625758 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76486bfd-986b-44e9-a191-f5450b796219 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:10.644920 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-76486bfd-986b-44e9-a191-f5450b796219 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:29:10.646149 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 559/1120] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:29:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:10.653461 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650dedd-557c-456a-b48b-2ca4d55423e1 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:10.665148 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650dedd-557c-456a-b48b-2ca4d55423e1 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:10.672220 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d98af4-200a-43dc-ace6-24246c68b256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:10.672911 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d98af4-200a-43dc-ace6-24246c68b256 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:10.673199 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d98af4-200a-43dc-ace6-24246c68b256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:10.673474 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d98af4-200a-43dc-ace6-24246c68b256 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:10.674213 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d98af4-200a-43dc-ace6-24246c68b256 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:10.674520 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d98af4-200a-43dc-ace6-24246c68b256 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:10.676158 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d98af4-200a-43dc-ace6-24246c68b256 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:10.691109 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 562/1121] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:29:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:29:10.698422 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76486bfd-986b-44e9-a191-f5450b796219 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:10.708376 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76486bfd-986b-44e9-a191-f5450b796219 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:10.715548 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91349238-d683-4097-9c9f-bd20e5b62ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:10.716681 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91349238-d683-4097-9c9f-bd20e5b62ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:10.716681 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91349238-d683-4097-9c9f-bd20e5b62ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:10.716957 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91349238-d683-4097-9c9f-bd20e5b62ce5 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:10.725937 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91349238-d683-4097-9c9f-bd20e5b62ce5 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:10.728821 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91349238-d683-4097-9c9f-bd20e5b62ce5 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:10.747129 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-91349238-d683-4097-9c9f-bd20e5b62ce5 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 15 03:29:10.748657 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 560/1122] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:29:10 2021] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:29:10.756479 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d98af4-200a-43dc-ace6-24246c68b256 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:10.768870 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d98af4-200a-43dc-ace6-24246c68b256 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:10.774340 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23262c82-84c1-459b-9bf9-0d7de8af3cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:10.775950 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23262c82-84c1-459b-9bf9-0d7de8af3cef admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:10.775950 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23262c82-84c1-459b-9bf9-0d7de8af3cef admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:10.775950 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23262c82-84c1-459b-9bf9-0d7de8af3cef admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:10.776472 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23262c82-84c1-459b-9bf9-0d7de8af3cef admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:10.776782 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23262c82-84c1-459b-9bf9-0d7de8af3cef admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:10.778674 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23262c82-84c1-459b-9bf9-0d7de8af3cef admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:10.798636 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 563/1123] 10.222.0.30 () {56 vars in 1164 bytes} [Fri Oct 15 03:29:10 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:10.805478 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91349238-d683-4097-9c9f-bd20e5b62ce5 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:10.816296 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91349238-d683-4097-9c9f-bd20e5b62ce5 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:10.821718 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ba73a-0f98-414d-8fe1-dac1f926c7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:10.822729 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ba73a-0f98-414d-8fe1-dac1f926c7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:10.822873 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ba73a-0f98-414d-8fe1-dac1f926c7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:10.823174 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ba73a-0f98-414d-8fe1-dac1f926c7a4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:10.835777 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ba73a-0f98-414d-8fe1-dac1f926c7a4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:10.837667 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ba73a-0f98-414d-8fe1-dac1f926c7a4 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:10.855670 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-c86ba73a-0f98-414d-8fe1-dac1f926c7a4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:29:10.857090 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 561/1124] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:29:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:10.863396 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23262c82-84c1-459b-9bf9-0d7de8af3cef admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:10.874419 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23262c82-84c1-459b-9bf9-0d7de8af3cef admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:10.879875 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46706f34-080b-43e8-8249-0fd354cd4094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:10.880591 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46706f34-080b-43e8-8249-0fd354cd4094 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:10.881266 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46706f34-080b-43e8-8249-0fd354cd4094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:10.881576 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46706f34-080b-43e8-8249-0fd354cd4094 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:10.883118 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46706f34-080b-43e8-8249-0fd354cd4094 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:10.883521 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46706f34-080b-43e8-8249-0fd354cd4094 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:10.885404 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46706f34-080b-43e8-8249-0fd354cd4094 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:10.899245 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 564/1125] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:29:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:10.906225 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ba73a-0f98-414d-8fe1-dac1f926c7a4 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:10.917850 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ba73a-0f98-414d-8fe1-dac1f926c7a4 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:10.922734 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0a30e-25cd-4443-b10e-9ba6d2c578fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:10.923529 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0a30e-25cd-4443-b10e-9ba6d2c578fb admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:10.923832 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0a30e-25cd-4443-b10e-9ba6d2c578fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:10.924110 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0a30e-25cd-4443-b10e-9ba6d2c578fb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:10.931590 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0a30e-25cd-4443-b10e-9ba6d2c578fb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:10.933597 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0a30e-25cd-4443-b10e-9ba6d2c578fb admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:10.946385 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-b6d0a30e-25cd-4443-b10e-9ba6d2c578fb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:29:10.947531 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 562/1126] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:29:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:29:10.954075 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46706f34-080b-43e8-8249-0fd354cd4094 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:10.964739 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46706f34-080b-43e8-8249-0fd354cd4094 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:10.969566 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e394f7c-a5d2-4cb0-8bb8-48a2df225bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:10.970207 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e394f7c-a5d2-4cb0-8bb8-48a2df225bef admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:10.970478 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e394f7c-a5d2-4cb0-8bb8-48a2df225bef admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:10.970751 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e394f7c-a5d2-4cb0-8bb8-48a2df225bef admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:10.971844 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e394f7c-a5d2-4cb0-8bb8-48a2df225bef admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:10.972151 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e394f7c-a5d2-4cb0-8bb8-48a2df225bef admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:10.973994 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e394f7c-a5d2-4cb0-8bb8-48a2df225bef admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:10.986632 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 565/1127] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:29:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:10.993288 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0a30e-25cd-4443-b10e-9ba6d2c578fb admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:11.003759 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0a30e-25cd-4443-b10e-9ba6d2c578fb admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:11.008285 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd0c1f-c59e-44d7-9a20-dbb77b40e987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:11.009080 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd0c1f-c59e-44d7-9a20-dbb77b40e987 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:11.009364 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd0c1f-c59e-44d7-9a20-dbb77b40e987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:11.009638 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd0c1f-c59e-44d7-9a20-dbb77b40e987 admin admin] PATH_INFO: `/v3/projects/9f95c04b0a7b4a2d8fbb4b547f70dc20/users/bffc0480ffb942cdad426195eca0529e/roles/04a530eb7b7e46d4a07b4c3b02cee3aa` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:11.024242 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd0c1f-c59e-44d7-9a20-dbb77b40e987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user_id=bffc0480ffb942cdad426195eca0529e, role_id=04a530eb7b7e46d4a07b4c3b02cee3aa)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:11.026894 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd0c1f-c59e-44d7-9a20-dbb77b40e987 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:11.039788 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 563/1128] 10.222.0.30 () {58 vars in 1460 bytes} [Fri Oct 15 03:29:10 2021] PUT /identity/v3/projects/9f95c04b0a7b4a2d8fbb4b547f70dc20/users/bffc0480ffb942cdad426195eca0529e/roles/04a530eb7b7e46d4a07b4c3b02cee3aa => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:29:13.484456 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e029eb-47ad-4f95-abf2-f24f78a47dad None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:13.485435 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e029eb-47ad-4f95-abf2-f24f78a47dad None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:13.485435 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e029eb-47ad-4f95-abf2-f24f78a47dad None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:13.486778 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 566/1129] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:29:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:29:13.493832 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e29887-66f9-44d0-8b48-dc887dc383a0 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:13.494246 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e29887-66f9-44d0-8b48-dc887dc383a0 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:13.494337 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e29887-66f9-44d0-8b48-dc887dc383a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:13.512992 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-27e29887-66f9-44d0-8b48-dc887dc383a0 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:29:13.514205 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-27e29887-66f9-44d0-8b48-dc887dc383a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:29:13.576138 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 564/1130] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:29:13 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:29:13.602545 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e029eb-47ad-4f95-abf2-f24f78a47dad None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:13.615456 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e029eb-47ad-4f95-abf2-f24f78a47dad None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:13.620481 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc3794-8a6a-4eac-ba5d-32d7db1de08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:13.621289 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc3794-8a6a-4eac-ba5d-32d7db1de08f admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:13.621546 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc3794-8a6a-4eac-ba5d-32d7db1de08f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:13.621871 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc3794-8a6a-4eac-ba5d-32d7db1de08f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:13.634687 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc3794-8a6a-4eac-ba5d-32d7db1de08f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:29:13.643026 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-e4cc3794-8a6a-4eac-ba5d-32d7db1de08f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 15 03:29:13.644383 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 567/1131] 10.222.0.30 () {56 vars in 1123 bytes} [Fri Oct 15 03:29:13 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:13.651805 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e29887-66f9-44d0-8b48-dc887dc383a0 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:13.661361 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e29887-66f9-44d0-8b48-dc887dc383a0 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:13.667161 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13da8e-8e91-4c2a-a484-24aa53461016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:13.667950 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13da8e-8e91-4c2a-a484-24aa53461016 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:13.668276 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13da8e-8e91-4c2a-a484-24aa53461016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:13.668504 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13da8e-8e91-4c2a-a484-24aa53461016 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:13.669402 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13da8e-8e91-4c2a-a484-24aa53461016 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:13.669772 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13da8e-8e91-4c2a-a484-24aa53461016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:13.671569 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13da8e-8e91-4c2a-a484-24aa53461016 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:13.687007 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 565/1132] 10.222.0.30 () {56 vars in 1124 bytes} [Fri Oct 15 03:29:13 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:13.688367 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc3794-8a6a-4eac-ba5d-32d7db1de08f admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:13.700032 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc3794-8a6a-4eac-ba5d-32d7db1de08f admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:13.705318 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb4b81-56f5-4e97-889b-c80801e77fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:13.706128 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb4b81-56f5-4e97-889b-c80801e77fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:13.706406 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb4b81-56f5-4e97-889b-c80801e77fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:13.706714 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb4b81-56f5-4e97-889b-c80801e77fc5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:13.720958 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb4b81-56f5-4e97-889b-c80801e77fc5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:13.723233 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb4b81-56f5-4e97-889b-c80801e77fc5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:13.746328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-26fb4b81-56f5-4e97-889b-c80801e77fc5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:29:13.747772 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 568/1133] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:29:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:13.754474 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13da8e-8e91-4c2a-a484-24aa53461016 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:13.767135 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13da8e-8e91-4c2a-a484-24aa53461016 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:13.773689 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c25fea-45c6-4f67-b805-e0a682919884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:13.775064 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c25fea-45c6-4f67-b805-e0a682919884 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:13.775064 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c25fea-45c6-4f67-b805-e0a682919884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:13.775064 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c25fea-45c6-4f67-b805-e0a682919884 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:13.775826 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c25fea-45c6-4f67-b805-e0a682919884 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:13.776129 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c25fea-45c6-4f67-b805-e0a682919884 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:13.778029 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c25fea-45c6-4f67-b805-e0a682919884 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:13.791549 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 566/1134] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:29:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:29:13.798244 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb4b81-56f5-4e97-889b-c80801e77fc5 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:13.808337 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb4b81-56f5-4e97-889b-c80801e77fc5 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:13.812983 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209168e3-2994-477f-b3d4-9083c72f55ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:13.813826 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209168e3-2994-477f-b3d4-9083c72f55ce admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:13.814117 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209168e3-2994-477f-b3d4-9083c72f55ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:13.814393 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209168e3-2994-477f-b3d4-9083c72f55ce admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:13.822891 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209168e3-2994-477f-b3d4-9083c72f55ce admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:13.825334 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209168e3-2994-477f-b3d4-9083c72f55ce admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:13.839948 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-209168e3-2994-477f-b3d4-9083c72f55ce admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 15 03:29:13.841362 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 569/1135] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:29:13 2021] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:13.848312 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c25fea-45c6-4f67-b805-e0a682919884 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:13.859896 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c25fea-45c6-4f67-b805-e0a682919884 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:13.865279 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c4c3d-f656-49dd-b584-4450b60f3640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:13.866037 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c4c3d-f656-49dd-b584-4450b60f3640 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:13.866346 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c4c3d-f656-49dd-b584-4450b60f3640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:13.866650 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c4c3d-f656-49dd-b584-4450b60f3640 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:13.867579 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c4c3d-f656-49dd-b584-4450b60f3640 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:13.867987 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c4c3d-f656-49dd-b584-4450b60f3640 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:13.869969 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c4c3d-f656-49dd-b584-4450b60f3640 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:13.888071 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 567/1136] 10.222.0.30 () {56 vars in 1164 bytes} [Fri Oct 15 03:29:13 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:29:13.896207 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209168e3-2994-477f-b3d4-9083c72f55ce admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:13.907517 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209168e3-2994-477f-b3d4-9083c72f55ce admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:13.912391 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ee156-4786-4f09-9c66-574369f42cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:13.913018 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ee156-4786-4f09-9c66-574369f42cfc admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:13.913455 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ee156-4786-4f09-9c66-574369f42cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:13.913717 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ee156-4786-4f09-9c66-574369f42cfc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:13.922225 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ee156-4786-4f09-9c66-574369f42cfc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:13.924062 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ee156-4786-4f09-9c66-574369f42cfc admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:13.933632 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 570/1137] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:29:13 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:29:13.940478 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c4c3d-f656-49dd-b584-4450b60f3640 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:13.951019 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c4c3d-f656-49dd-b584-4450b60f3640 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:13.956415 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377a676-a677-4a4d-b0df-2923ecd6baf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:13.957182 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377a676-a677-4a4d-b0df-2923ecd6baf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:13.957464 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377a676-a677-4a4d-b0df-2923ecd6baf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:13.957736 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377a676-a677-4a4d-b0df-2923ecd6baf3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:13.968060 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377a676-a677-4a4d-b0df-2923ecd6baf3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:13.969921 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377a676-a677-4a4d-b0df-2923ecd6baf3 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:13.987488 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-f377a676-a677-4a4d-b0df-2923ecd6baf3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:29:13.988675 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 568/1138] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:29:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:29:13.996236 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ee156-4786-4f09-9c66-574369f42cfc admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:14.006433 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ee156-4786-4f09-9c66-574369f42cfc admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:14.012125 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45f71f-2783-4595-be5d-3fd273a2cdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:14.012902 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45f71f-2783-4595-be5d-3fd273a2cdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:14.013238 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45f71f-2783-4595-be5d-3fd273a2cdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:14.013515 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45f71f-2783-4595-be5d-3fd273a2cdb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:14.014374 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45f71f-2783-4595-be5d-3fd273a2cdb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:14.014673 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45f71f-2783-4595-be5d-3fd273a2cdb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:14.016399 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45f71f-2783-4595-be5d-3fd273a2cdb8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:14.027955 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 571/1139] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:29:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:14.034657 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377a676-a677-4a4d-b0df-2923ecd6baf3 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:14.044071 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377a676-a677-4a4d-b0df-2923ecd6baf3 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:14.048987 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4f5f5-9f0b-42ab-a86d-d83eda459684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:14.049697 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4f5f5-9f0b-42ab-a86d-d83eda459684 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:14.050037 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4f5f5-9f0b-42ab-a86d-d83eda459684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:14.050255 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4f5f5-9f0b-42ab-a86d-d83eda459684 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:14.057903 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4f5f5-9f0b-42ab-a86d-d83eda459684 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:14.059876 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4f5f5-9f0b-42ab-a86d-d83eda459684 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:14.073147 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-7dd4f5f5-9f0b-42ab-a86d-d83eda459684 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:29:14.074340 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 569/1140] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:29:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:29:14.082195 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45f71f-2783-4595-be5d-3fd273a2cdb8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:14.093716 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45f71f-2783-4595-be5d-3fd273a2cdb8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:14.098743 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c5c50-f44a-42ad-a147-e1f8ef6f4156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:14.099480 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c5c50-f44a-42ad-a147-e1f8ef6f4156 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:14.100341 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c5c50-f44a-42ad-a147-e1f8ef6f4156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:14.100638 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c5c50-f44a-42ad-a147-e1f8ef6f4156 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:14.102112 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c5c50-f44a-42ad-a147-e1f8ef6f4156 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:14.102454 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c5c50-f44a-42ad-a147-e1f8ef6f4156 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:14.104645 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c5c50-f44a-42ad-a147-e1f8ef6f4156 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:14.118393 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 572/1141] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:29:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:14.125793 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4f5f5-9f0b-42ab-a86d-d83eda459684 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:14.137289 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4f5f5-9f0b-42ab-a86d-d83eda459684 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:14.142016 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23efef-3395-44f6-ae0a-9ee09790d6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:14.142717 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23efef-3395-44f6-ae0a-9ee09790d6cf admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:14.143033 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23efef-3395-44f6-ae0a-9ee09790d6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:14.143356 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23efef-3395-44f6-ae0a-9ee09790d6cf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:14.144273 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23efef-3395-44f6-ae0a-9ee09790d6cf admin admin] RBAC: Adding query filter params (role.id=04a530eb7b7e46d4a07b4c3b02cee3aa, scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user.id=bffc0480ffb942cdad426195eca0529e) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:14.144579 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23efef-3395-44f6-ae0a-9ee09790d6cf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:14.146417 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23efef-3395-44f6-ae0a-9ee09790d6cf admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:14.153502 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 570/1142] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:29:14 2021] GET /identity/v3/role_assignments?user.id=bffc0480ffb942cdad426195eca0529e&scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20&role.id=04a530eb7b7e46d4a07b4c3b02cee3aa => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:16.484755 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223ecb2-2373-4cb4-9171-f9dc8789bac4 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:16.485340 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223ecb2-2373-4cb4-9171-f9dc8789bac4 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:16.485340 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223ecb2-2373-4cb4-9171-f9dc8789bac4 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:16.487110 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 573/1143] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:29:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:29:16.494308 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db6fe9-29ab-44e9-82a0-a4a38e764e1a None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:16.494773 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db6fe9-29ab-44e9-82a0-a4a38e764e1a None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:16.494773 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db6fe9-29ab-44e9-82a0-a4a38e764e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:16.515265 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-18db6fe9-29ab-44e9-82a0-a4a38e764e1a None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:29:16.516856 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-18db6fe9-29ab-44e9-82a0-a4a38e764e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:29:16.525980 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 571/1144] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:29:16 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:29:16.554942 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223ecb2-2373-4cb4-9171-f9dc8789bac4 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:16.568911 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223ecb2-2373-4cb4-9171-f9dc8789bac4 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:16.575319 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe799fd-4c36-440a-a6e7-e03c2d6313cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:16.576146 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe799fd-4c36-440a-a6e7-e03c2d6313cb admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:16.576554 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe799fd-4c36-440a-a6e7-e03c2d6313cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:16.576857 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe799fd-4c36-440a-a6e7-e03c2d6313cb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:16.588877 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe799fd-4c36-440a-a6e7-e03c2d6313cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:29:16.595923 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-cbe799fd-4c36-440a-a6e7-e03c2d6313cb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:29:16.597377 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 574/1145] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:29:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:16.607063 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db6fe9-29ab-44e9-82a0-a4a38e764e1a None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:16.617326 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db6fe9-29ab-44e9-82a0-a4a38e764e1a None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:16.622748 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59854693-5fb3-4ab4-bb7a-40b86b62d456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:16.624286 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59854693-5fb3-4ab4-bb7a-40b86b62d456 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:16.624286 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59854693-5fb3-4ab4-bb7a-40b86b62d456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:16.624286 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59854693-5fb3-4ab4-bb7a-40b86b62d456 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:16.624806 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59854693-5fb3-4ab4-bb7a-40b86b62d456 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:16.625106 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59854693-5fb3-4ab4-bb7a-40b86b62d456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:16.626689 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59854693-5fb3-4ab4-bb7a-40b86b62d456 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:16.635469 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 572/1146] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:29:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:16.643315 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe799fd-4c36-440a-a6e7-e03c2d6313cb admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:16.655850 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe799fd-4c36-440a-a6e7-e03c2d6313cb admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:16.661048 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b495fcc-dadb-4f10-abba-1fc52fa5d764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:16.661851 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b495fcc-dadb-4f10-abba-1fc52fa5d764 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:16.662129 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b495fcc-dadb-4f10-abba-1fc52fa5d764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:16.662444 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b495fcc-dadb-4f10-abba-1fc52fa5d764 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:16.673946 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b495fcc-dadb-4f10-abba-1fc52fa5d764 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:16.675934 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b495fcc-dadb-4f10-abba-1fc52fa5d764 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:16.696321 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-4b495fcc-dadb-4f10-abba-1fc52fa5d764 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:29:16.697755 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 575/1147] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:29:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:16.704981 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59854693-5fb3-4ab4-bb7a-40b86b62d456 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:16.715992 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59854693-5fb3-4ab4-bb7a-40b86b62d456 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:16.722137 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fbce5-c660-436d-834a-e749683e593b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:16.723008 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fbce5-c660-436d-834a-e749683e593b admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:16.723323 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fbce5-c660-436d-834a-e749683e593b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:16.723737 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fbce5-c660-436d-834a-e749683e593b admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:16.724624 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fbce5-c660-436d-834a-e749683e593b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:16.725002 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fbce5-c660-436d-834a-e749683e593b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:16.727784 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fbce5-c660-436d-834a-e749683e593b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:16.743435 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 573/1148] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:29:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:29:16.749752 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b495fcc-dadb-4f10-abba-1fc52fa5d764 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:16.764046 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b495fcc-dadb-4f10-abba-1fc52fa5d764 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:16.771039 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e4b47-6c2c-4dbc-97aa-7d3690a43024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:16.773087 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e4b47-6c2c-4dbc-97aa-7d3690a43024 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:16.773367 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e4b47-6c2c-4dbc-97aa-7d3690a43024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:16.773640 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e4b47-6c2c-4dbc-97aa-7d3690a43024 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:16.782808 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e4b47-6c2c-4dbc-97aa-7d3690a43024 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:16.785400 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e4b47-6c2c-4dbc-97aa-7d3690a43024 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:16.802315 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-224e4b47-6c2c-4dbc-97aa-7d3690a43024 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 15 03:29:16.803471 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 576/1149] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:29:16 2021] GET /identity/v3/users/placement => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:16.810732 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fbce5-c660-436d-834a-e749683e593b admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:16.824028 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fbce5-c660-436d-834a-e749683e593b admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:16.828775 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b57ccf-cdf9-4dcc-972c-d51ebff109f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:16.829427 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b57ccf-cdf9-4dcc-972c-d51ebff109f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:16.829705 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b57ccf-cdf9-4dcc-972c-d51ebff109f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:16.829982 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b57ccf-cdf9-4dcc-972c-d51ebff109f6 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:16.830823 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b57ccf-cdf9-4dcc-972c-d51ebff109f6 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:16.831153 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b57ccf-cdf9-4dcc-972c-d51ebff109f6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:16.832977 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b57ccf-cdf9-4dcc-972c-d51ebff109f6 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:16.851269 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 574/1150] 10.222.0.30 () {56 vars in 1164 bytes} [Fri Oct 15 03:29:16 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:16.857725 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e4b47-6c2c-4dbc-97aa-7d3690a43024 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:16.869083 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e4b47-6c2c-4dbc-97aa-7d3690a43024 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:16.874428 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebf455-c30a-42c5-8995-9f3d3ba771c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:16.875371 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebf455-c30a-42c5-8995-9f3d3ba771c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:16.875642 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebf455-c30a-42c5-8995-9f3d3ba771c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:16.875970 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebf455-c30a-42c5-8995-9f3d3ba771c7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:16.886877 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebf455-c30a-42c5-8995-9f3d3ba771c7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:16.888703 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebf455-c30a-42c5-8995-9f3d3ba771c7 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:16.898137 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 577/1151] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:29:16 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:29:16.904679 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b57ccf-cdf9-4dcc-972c-d51ebff109f6 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:16.916649 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b57ccf-cdf9-4dcc-972c-d51ebff109f6 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:16.921224 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a67ee8-d3c0-4d6d-8b6f-5115a675e839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:16.922123 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a67ee8-d3c0-4d6d-8b6f-5115a675e839 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:16.922587 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a67ee8-d3c0-4d6d-8b6f-5115a675e839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:16.922866 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a67ee8-d3c0-4d6d-8b6f-5115a675e839 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:16.935040 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a67ee8-d3c0-4d6d-8b6f-5115a675e839 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:16.936883 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a67ee8-d3c0-4d6d-8b6f-5115a675e839 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:16.955801 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-a9a67ee8-d3c0-4d6d-8b6f-5115a675e839 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:29:16.957125 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 575/1152] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:29:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:16.963338 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebf455-c30a-42c5-8995-9f3d3ba771c7 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:16.974339 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebf455-c30a-42c5-8995-9f3d3ba771c7 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:16.980071 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f449e-6036-4b29-b8c2-99081fb87de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:16.980778 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f449e-6036-4b29-b8c2-99081fb87de3 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:16.981249 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f449e-6036-4b29-b8c2-99081fb87de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:16.981674 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f449e-6036-4b29-b8c2-99081fb87de3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:16.982527 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f449e-6036-4b29-b8c2-99081fb87de3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:16.982834 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f449e-6036-4b29-b8c2-99081fb87de3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:16.985030 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f449e-6036-4b29-b8c2-99081fb87de3 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:16.998760 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 578/1153] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:29:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:17.005734 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a67ee8-d3c0-4d6d-8b6f-5115a675e839 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:17.016061 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a67ee8-d3c0-4d6d-8b6f-5115a675e839 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:17.020953 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec80a00-4027-4f98-bb30-10786e71a463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:17.021824 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec80a00-4027-4f98-bb30-10786e71a463 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:17.022144 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec80a00-4027-4f98-bb30-10786e71a463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:17.022524 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec80a00-4027-4f98-bb30-10786e71a463 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:17.029861 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec80a00-4027-4f98-bb30-10786e71a463 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:17.032085 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec80a00-4027-4f98-bb30-10786e71a463 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:17.046300 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-9ec80a00-4027-4f98-bb30-10786e71a463 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:29:17.047771 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 576/1154] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:29:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:17.056362 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f449e-6036-4b29-b8c2-99081fb87de3 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:17.067851 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f449e-6036-4b29-b8c2-99081fb87de3 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:17.072940 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579d068-1d57-47b5-9e10-8cce93441348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:17.073571 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579d068-1d57-47b5-9e10-8cce93441348 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:17.073857 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579d068-1d57-47b5-9e10-8cce93441348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:17.074120 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579d068-1d57-47b5-9e10-8cce93441348 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:17.074913 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579d068-1d57-47b5-9e10-8cce93441348 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:17.075246 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579d068-1d57-47b5-9e10-8cce93441348 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:17.077611 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579d068-1d57-47b5-9e10-8cce93441348 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:17.097460 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 579/1155] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:29:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:17.099035 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec80a00-4027-4f98-bb30-10786e71a463 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:17.112577 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec80a00-4027-4f98-bb30-10786e71a463 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:17.117890 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff139058-683a-4524-bdbd-85f74b563756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:17.118590 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff139058-683a-4524-bdbd-85f74b563756 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:17.118985 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff139058-683a-4524-bdbd-85f74b563756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:17.119290 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff139058-683a-4524-bdbd-85f74b563756 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:17.120252 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff139058-683a-4524-bdbd-85f74b563756 admin admin] RBAC: Adding query filter params (role.id=15ba70b0cba04962a6d0b80b50c07004, scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user.id=bffc0480ffb942cdad426195eca0529e) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:17.120649 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff139058-683a-4524-bdbd-85f74b563756 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:17.122509 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff139058-683a-4524-bdbd-85f74b563756 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:17.127941 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 577/1156] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:29:17 2021] GET /identity/v3/role_assignments?user.id=bffc0480ffb942cdad426195eca0529e&scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20&role.id=15ba70b0cba04962a6d0b80b50c07004 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:19.489685 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a13770-9f34-4d06-8806-ecd77faf74a7 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:19.490266 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a13770-9f34-4d06-8806-ecd77faf74a7 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:19.490266 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a13770-9f34-4d06-8806-ecd77faf74a7 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:19.492401 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 580/1157] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:29:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:29:19.498220 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd848cdc-b9b4-4d21-b4b2-f24505c62a70 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:19.498700 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd848cdc-b9b4-4d21-b4b2-f24505c62a70 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:19.498799 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd848cdc-b9b4-4d21-b4b2-f24505c62a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:19.517230 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-dd848cdc-b9b4-4d21-b4b2-f24505c62a70 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:29:19.518418 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-dd848cdc-b9b4-4d21-b4b2-f24505c62a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:29:19.526946 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 578/1158] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:29:19 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:29:19.554545 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a13770-9f34-4d06-8806-ecd77faf74a7 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:19.568799 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a13770-9f34-4d06-8806-ecd77faf74a7 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:19.573875 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a865f2-d1f7-4d2c-8a04-dbea277303c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:19.574844 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a865f2-d1f7-4d2c-8a04-dbea277303c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:19.575232 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a865f2-d1f7-4d2c-8a04-dbea277303c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:19.575536 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a865f2-d1f7-4d2c-8a04-dbea277303c8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:19.587914 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a865f2-d1f7-4d2c-8a04-dbea277303c8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:29:19.596106 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-f0a865f2-d1f7-4d2c-8a04-dbea277303c8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:29:19.597532 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 581/1159] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:29:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:19.604800 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd848cdc-b9b4-4d21-b4b2-f24505c62a70 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:19.613737 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd848cdc-b9b4-4d21-b4b2-f24505c62a70 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:19.619945 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cea415-7553-456b-80db-b01e1664f311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:19.620609 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cea415-7553-456b-80db-b01e1664f311 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:19.620890 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cea415-7553-456b-80db-b01e1664f311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:19.621162 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cea415-7553-456b-80db-b01e1664f311 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:19.621927 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cea415-7553-456b-80db-b01e1664f311 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:19.622503 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cea415-7553-456b-80db-b01e1664f311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:19.623928 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cea415-7553-456b-80db-b01e1664f311 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:19.634262 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 579/1160] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:29:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:19.641018 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a865f2-d1f7-4d2c-8a04-dbea277303c8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:19.652924 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a865f2-d1f7-4d2c-8a04-dbea277303c8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:19.658361 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ed91a-5496-4598-af0d-0091d361a1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:19.659241 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ed91a-5496-4598-af0d-0091d361a1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:19.659594 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ed91a-5496-4598-af0d-0091d361a1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:19.659976 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ed91a-5496-4598-af0d-0091d361a1e9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:19.671154 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ed91a-5496-4598-af0d-0091d361a1e9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:19.673045 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ed91a-5496-4598-af0d-0091d361a1e9 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:19.693636 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-c31ed91a-5496-4598-af0d-0091d361a1e9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:29:19.694915 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 582/1161] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:29:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:19.702232 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cea415-7553-456b-80db-b01e1664f311 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:19.712511 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cea415-7553-456b-80db-b01e1664f311 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:19.718291 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a720a90-9e12-4441-afe2-dfef790efab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:19.719002 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a720a90-9e12-4441-afe2-dfef790efab9 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:19.719358 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a720a90-9e12-4441-afe2-dfef790efab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:19.719857 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a720a90-9e12-4441-afe2-dfef790efab9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:19.720838 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a720a90-9e12-4441-afe2-dfef790efab9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:19.721670 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a720a90-9e12-4441-afe2-dfef790efab9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:19.723615 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a720a90-9e12-4441-afe2-dfef790efab9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:19.739761 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 580/1162] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:29:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:19.746862 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ed91a-5496-4598-af0d-0091d361a1e9 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:19.757842 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ed91a-5496-4598-af0d-0091d361a1e9 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:19.763506 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9989d1-6f4d-44b1-b588-1547438e233d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:19.764466 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9989d1-6f4d-44b1-b588-1547438e233d admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:19.764772 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9989d1-6f4d-44b1-b588-1547438e233d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:19.765130 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9989d1-6f4d-44b1-b588-1547438e233d admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:19.774840 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9989d1-6f4d-44b1-b588-1547438e233d admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:19.777331 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9989d1-6f4d-44b1-b588-1547438e233d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:19.794660 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-2c9989d1-6f4d-44b1-b588-1547438e233d admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 15 03:29:19.796001 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 583/1163] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:29:19 2021] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:19.803120 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a720a90-9e12-4441-afe2-dfef790efab9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:19.814094 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a720a90-9e12-4441-afe2-dfef790efab9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:19.819458 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf45a3-118b-4240-85e8-d250f9590f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:19.820230 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf45a3-118b-4240-85e8-d250f9590f69 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:19.820513 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf45a3-118b-4240-85e8-d250f9590f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:19.820875 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf45a3-118b-4240-85e8-d250f9590f69 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:19.821731 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf45a3-118b-4240-85e8-d250f9590f69 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:19.822083 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf45a3-118b-4240-85e8-d250f9590f69 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:19.824468 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf45a3-118b-4240-85e8-d250f9590f69 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:19.844063 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 581/1164] 10.222.0.30 () {56 vars in 1164 bytes} [Fri Oct 15 03:29:19 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:19.851157 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9989d1-6f4d-44b1-b588-1547438e233d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:19.861390 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9989d1-6f4d-44b1-b588-1547438e233d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:19.867726 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f9792-8f63-4a86-8ca7-2b2aaf83406b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:19.868519 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f9792-8f63-4a86-8ca7-2b2aaf83406b admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:19.868800 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f9792-8f63-4a86-8ca7-2b2aaf83406b admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:19.869072 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f9792-8f63-4a86-8ca7-2b2aaf83406b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:19.879368 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f9792-8f63-4a86-8ca7-2b2aaf83406b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:19.881301 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f9792-8f63-4a86-8ca7-2b2aaf83406b admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:19.900701 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-959f9792-8f63-4a86-8ca7-2b2aaf83406b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:29:19.907342 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 584/1165] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:29:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:19.908495 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf45a3-118b-4240-85e8-d250f9590f69 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:19.918763 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf45a3-118b-4240-85e8-d250f9590f69 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:19.923425 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4e473-3cae-419d-9f53-e61eaa79b6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:19.924094 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4e473-3cae-419d-9f53-e61eaa79b6bd admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:19.924393 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4e473-3cae-419d-9f53-e61eaa79b6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:19.924638 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4e473-3cae-419d-9f53-e61eaa79b6bd admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:19.925357 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4e473-3cae-419d-9f53-e61eaa79b6bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:19.925676 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4e473-3cae-419d-9f53-e61eaa79b6bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:19.927280 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4e473-3cae-419d-9f53-e61eaa79b6bd admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:19.939568 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 582/1166] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:29:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:29:19.946403 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f9792-8f63-4a86-8ca7-2b2aaf83406b admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:19.956814 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f9792-8f63-4a86-8ca7-2b2aaf83406b admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:19.962430 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4e712-a97d-4cdb-bd9f-bbe892f84995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:19.963206 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4e712-a97d-4cdb-bd9f-bbe892f84995 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:19.963485 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4e712-a97d-4cdb-bd9f-bbe892f84995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:19.963790 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4e712-a97d-4cdb-bd9f-bbe892f84995 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:19.972258 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4e712-a97d-4cdb-bd9f-bbe892f84995 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:19.974219 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4e712-a97d-4cdb-bd9f-bbe892f84995 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:19.988935 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-adc4e712-a97d-4cdb-bd9f-bbe892f84995 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:29:19.990118 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 585/1167] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:29:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:19.999207 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4e473-3cae-419d-9f53-e61eaa79b6bd admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:20.013957 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4e473-3cae-419d-9f53-e61eaa79b6bd admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:20.020011 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d001faa-32c1-4636-895b-2949c412564a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:20.020701 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d001faa-32c1-4636-895b-2949c412564a admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:20.020988 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d001faa-32c1-4636-895b-2949c412564a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:20.021261 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d001faa-32c1-4636-895b-2949c412564a admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:20.022044 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d001faa-32c1-4636-895b-2949c412564a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:20.022416 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d001faa-32c1-4636-895b-2949c412564a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:20.025151 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d001faa-32c1-4636-895b-2949c412564a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:20.040067 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 583/1168] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:29:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:20.046853 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4e712-a97d-4cdb-bd9f-bbe892f84995 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:20.058320 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4e712-a97d-4cdb-bd9f-bbe892f84995 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:20.063246 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9450245-5a5d-49f9-9015-b35651473065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:20.064140 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9450245-5a5d-49f9-9015-b35651473065 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:20.064491 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9450245-5a5d-49f9-9015-b35651473065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:20.064825 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9450245-5a5d-49f9-9015-b35651473065 admin admin] PATH_INFO: `/v3/projects/9f95c04b0a7b4a2d8fbb4b547f70dc20/users/bffc0480ffb942cdad426195eca0529e/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:20.067063 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9450245-5a5d-49f9-9015-b35651473065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user_id=bffc0480ffb942cdad426195eca0529e, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:20.070468 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9450245-5a5d-49f9-9015-b35651473065 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:20.083368 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 586/1169] 10.222.0.30 () {58 vars in 1460 bytes} [Fri Oct 15 03:29:20 2021] PUT /identity/v3/projects/9f95c04b0a7b4a2d8fbb4b547f70dc20/users/bffc0480ffb942cdad426195eca0529e/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:29:22.379286 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3299e-cc4e-4989-8ca4-367a8d4a0629 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:22.379928 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3299e-cc4e-4989-8ca4-367a8d4a0629 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:22.379928 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3299e-cc4e-4989-8ca4-367a8d4a0629 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:22.381647 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 584/1170] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:29:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:29:22.387501 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097c655-df24-4290-b12c-3d44bfefdd9c None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:22.387922 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097c655-df24-4290-b12c-3d44bfefdd9c None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:22.388097 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097c655-df24-4290-b12c-3d44bfefdd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:22.405594 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-1097c655-df24-4290-b12c-3d44bfefdd9c None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:29:22.406753 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-1097c655-df24-4290-b12c-3d44bfefdd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:29:22.459633 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 587/1171] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:29:22 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:29:22.484616 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3299e-cc4e-4989-8ca4-367a8d4a0629 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:22.496493 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3299e-cc4e-4989-8ca4-367a8d4a0629 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:22.500722 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538408b5-35e1-461b-9e87-3898319c27d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:22.501477 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538408b5-35e1-461b-9e87-3898319c27d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:22.501758 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538408b5-35e1-461b-9e87-3898319c27d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:22.502031 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538408b5-35e1-461b-9e87-3898319c27d8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:22.511849 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538408b5-35e1-461b-9e87-3898319c27d8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 15 03:29:22.518538 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-538408b5-35e1-461b-9e87-3898319c27d8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 15 03:29:22.519660 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 585/1172] 10.222.0.30 () {56 vars in 1117 bytes} [Fri Oct 15 03:29:22 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:22.526226 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097c655-df24-4290-b12c-3d44bfefdd9c None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:22.534647 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097c655-df24-4290-b12c-3d44bfefdd9c None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:22.539603 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ed65f-03ba-40de-afb2-f42c54e8f52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:22.540262 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ed65f-03ba-40de-afb2-f42c54e8f52f admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:22.540540 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ed65f-03ba-40de-afb2-f42c54e8f52f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:22.540811 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ed65f-03ba-40de-afb2-f42c54e8f52f admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:22.541555 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ed65f-03ba-40de-afb2-f42c54e8f52f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:22.541853 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ed65f-03ba-40de-afb2-f42c54e8f52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:22.543420 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ed65f-03ba-40de-afb2-f42c54e8f52f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:22.551220 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 588/1173] 10.222.0.30 () {56 vars in 1120 bytes} [Fri Oct 15 03:29:22 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:22.557009 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538408b5-35e1-461b-9e87-3898319c27d8 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:22.566638 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538408b5-35e1-461b-9e87-3898319c27d8 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:22.571568 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01d0d7-3a99-430e-8351-421dfceb1797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:22.572323 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01d0d7-3a99-430e-8351-421dfceb1797 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:22.572603 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01d0d7-3a99-430e-8351-421dfceb1797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:22.572874 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01d0d7-3a99-430e-8351-421dfceb1797 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:22.582604 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01d0d7-3a99-430e-8351-421dfceb1797 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:22.584453 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01d0d7-3a99-430e-8351-421dfceb1797 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:22.602628 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-3d01d0d7-3a99-430e-8351-421dfceb1797 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:29:22.604262 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 586/1174] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:29:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:22.610329 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ed65f-03ba-40de-afb2-f42c54e8f52f admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:22.620261 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ed65f-03ba-40de-afb2-f42c54e8f52f admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:22.624725 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53768152-a9fa-4052-b6f6-0fc0430479d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:22.625346 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53768152-a9fa-4052-b6f6-0fc0430479d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:22.625624 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53768152-a9fa-4052-b6f6-0fc0430479d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:22.625896 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53768152-a9fa-4052-b6f6-0fc0430479d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:22.626606 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53768152-a9fa-4052-b6f6-0fc0430479d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:22.626903 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53768152-a9fa-4052-b6f6-0fc0430479d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:22.628505 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53768152-a9fa-4052-b6f6-0fc0430479d2 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:22.640357 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 589/1175] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:29:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:22.646150 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01d0d7-3a99-430e-8351-421dfceb1797 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:22.656002 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01d0d7-3a99-430e-8351-421dfceb1797 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:22.660450 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cbc14-bfdd-44e5-ac28-a74ff77002df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:22.661200 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cbc14-bfdd-44e5-ac28-a74ff77002df admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:22.661479 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cbc14-bfdd-44e5-ac28-a74ff77002df admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:22.661751 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cbc14-bfdd-44e5-ac28-a74ff77002df admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:22.668714 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095cbc14-bfdd-44e5-ac28-a74ff77002df admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:22.670695 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095cbc14-bfdd-44e5-ac28-a74ff77002df admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:22.684080 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-095cbc14-bfdd-44e5-ac28-a74ff77002df admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 15 03:29:22.685162 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 587/1176] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:29:22 2021] GET /identity/v3/users/placement => generated 87 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 15 03:29:22.690998 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53768152-a9fa-4052-b6f6-0fc0430479d2 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:22.700675 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53768152-a9fa-4052-b6f6-0fc0430479d2 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:22.705046 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e89fbb-62c3-430c-9bb0-78d09bb2d353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:22.705671 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e89fbb-62c3-430c-9bb0-78d09bb2d353 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:22.705947 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e89fbb-62c3-430c-9bb0-78d09bb2d353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:22.706218 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e89fbb-62c3-430c-9bb0-78d09bb2d353 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:22.707038 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e89fbb-62c3-430c-9bb0-78d09bb2d353 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:22.707338 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e89fbb-62c3-430c-9bb0-78d09bb2d353 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:22.709172 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e89fbb-62c3-430c-9bb0-78d09bb2d353 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:22.728466 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 590/1177] 10.222.0.30 () {56 vars in 1164 bytes} [Fri Oct 15 03:29:22 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:22.734764 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cbc14-bfdd-44e5-ac28-a74ff77002df admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:22.747238 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cbc14-bfdd-44e5-ac28-a74ff77002df admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:22.753181 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487f9c8-3bf7-4869-be7d-8a7623afb125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:22.754161 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487f9c8-3bf7-4869-be7d-8a7623afb125 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:22.754604 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487f9c8-3bf7-4869-be7d-8a7623afb125 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:22.754722 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487f9c8-3bf7-4869-be7d-8a7623afb125 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:22.766020 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487f9c8-3bf7-4869-be7d-8a7623afb125 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:22.768388 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487f9c8-3bf7-4869-be7d-8a7623afb125 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:22.780816 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 588/1178] 10.222.0.30 () {58 vars in 1324 bytes} [Fri Oct 15 03:29:22 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:29:22.787272 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e89fbb-62c3-430c-9bb0-78d09bb2d353 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:22.799052 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e89fbb-62c3-430c-9bb0-78d09bb2d353 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:22.805423 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74f10d-490e-4ea5-ab9d-1fa268653174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:22.806248 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74f10d-490e-4ea5-ab9d-1fa268653174 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:22.806530 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74f10d-490e-4ea5-ab9d-1fa268653174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:22.806803 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74f10d-490e-4ea5-ab9d-1fa268653174 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:22.817003 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74f10d-490e-4ea5-ab9d-1fa268653174 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:22.818855 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74f10d-490e-4ea5-ab9d-1fa268653174 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:22.835923 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-9a74f10d-490e-4ea5-ab9d-1fa268653174 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 15 03:29:22.837038 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 591/1179] 10.222.0.30 () {56 vars in 1129 bytes} [Fri Oct 15 03:29:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:22.843339 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487f9c8-3bf7-4869-be7d-8a7623afb125 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:22.852240 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487f9c8-3bf7-4869-be7d-8a7623afb125 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:22.856763 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d740c2-ce12-4554-8f57-c973b63f9829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:22.857392 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d740c2-ce12-4554-8f57-c973b63f9829 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:22.857672 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d740c2-ce12-4554-8f57-c973b63f9829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:22.857946 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d740c2-ce12-4554-8f57-c973b63f9829 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:22.858660 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d740c2-ce12-4554-8f57-c973b63f9829 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:22.858960 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d740c2-ce12-4554-8f57-c973b63f9829 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:22.860555 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d740c2-ce12-4554-8f57-c973b63f9829 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:22.871422 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 589/1180] 10.222.0.30 () {56 vars in 1130 bytes} [Fri Oct 15 03:29:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:22.877062 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74f10d-490e-4ea5-ab9d-1fa268653174 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:22.886853 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74f10d-490e-4ea5-ab9d-1fa268653174 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:22.891334 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7619c15-d1f5-4402-949a-d9b0152c1989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:22.892104 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7619c15-d1f5-4402-949a-d9b0152c1989 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:22.892389 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7619c15-d1f5-4402-949a-d9b0152c1989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:22.892664 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7619c15-d1f5-4402-949a-d9b0152c1989 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:22.899908 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7619c15-d1f5-4402-949a-d9b0152c1989 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:22.901830 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7619c15-d1f5-4402-949a-d9b0152c1989 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:22.914378 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-d7619c15-d1f5-4402-949a-d9b0152c1989 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 15 03:29:22.915469 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 592/1181] 10.222.0.30 () {56 vars in 1132 bytes} [Fri Oct 15 03:29:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:22.921495 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d740c2-ce12-4554-8f57-c973b63f9829 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:22.931112 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d740c2-ce12-4554-8f57-c973b63f9829 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:22.935512 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36963698-7e16-4ebd-b05a-62dca17a02ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:22.936155 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36963698-7e16-4ebd-b05a-62dca17a02ed admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:22.936437 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36963698-7e16-4ebd-b05a-62dca17a02ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:22.936709 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36963698-7e16-4ebd-b05a-62dca17a02ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:22.937480 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36963698-7e16-4ebd-b05a-62dca17a02ed admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:22.937786 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36963698-7e16-4ebd-b05a-62dca17a02ed admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:22.939573 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36963698-7e16-4ebd-b05a-62dca17a02ed admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:22.951799 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 590/1182] 10.222.0.30 () {56 vars in 1169 bytes} [Fri Oct 15 03:29:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:22.957938 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7619c15-d1f5-4402-949a-d9b0152c1989 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:22.967706 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7619c15-d1f5-4402-949a-d9b0152c1989 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:22.972508 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24840173-0953-46ad-9e65-bb3040a75bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:22.973105 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24840173-0953-46ad-9e65-bb3040a75bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:22.973385 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24840173-0953-46ad-9e65-bb3040a75bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:22.973658 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24840173-0953-46ad-9e65-bb3040a75bf1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:22.974473 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24840173-0953-46ad-9e65-bb3040a75bf1 admin admin] RBAC: Adding query filter params (role.id=15ba70b0cba04962a6d0b80b50c07004, scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20, user.id=bffc0480ffb942cdad426195eca0529e) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:22.974778 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24840173-0953-46ad-9e65-bb3040a75bf1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:22.976635 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24840173-0953-46ad-9e65-bb3040a75bf1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:22.982081 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 593/1183] 10.222.0.30 () {56 vars in 1395 bytes} [Fri Oct 15 03:29:22 2021] GET /identity/v3/role_assignments?user.id=bffc0480ffb942cdad426195eca0529e&scope.project.id=9f95c04b0a7b4a2d8fbb4b547f70dc20&role.id=15ba70b0cba04962a6d0b80b50c07004 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:29:25.193558 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d92811-8c77-42a1-b738-76276c5c5909 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:25.194112 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d92811-8c77-42a1-b738-76276c5c5909 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:25.194228 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d92811-8c77-42a1-b738-76276c5c5909 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:25.196460 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 591/1184] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:29:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:29:25.202166 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cd7e5-f6b2-4f74-964d-36486ab4e23e None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:25.202562 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cd7e5-f6b2-4f74-964d-36486ab4e23e None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:25.202726 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cd7e5-f6b2-4f74-964d-36486ab4e23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:25.219858 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-535cd7e5-f6b2-4f74-964d-36486ab4e23e None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:29:25.221320 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-535cd7e5-f6b2-4f74-964d-36486ab4e23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:29:25.228923 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 594/1185] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:29:25 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:29:25.251612 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d92811-8c77-42a1-b738-76276c5c5909 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:25.264097 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d92811-8c77-42a1-b738-76276c5c5909 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:25.268307 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ad23d-a0d3-4da0-b544-66a7dd4219d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:25.269063 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ad23d-a0d3-4da0-b544-66a7dd4219d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:25.269339 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ad23d-a0d3-4da0-b544-66a7dd4219d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:25.269607 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ad23d-a0d3-4da0-b544-66a7dd4219d5 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:25.270249 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ad23d-a0d3-4da0-b544-66a7dd4219d5 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:25.271858 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ad23d-a0d3-4da0-b544-66a7dd4219d5 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:25.282397 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-693ad23d-a0d3-4da0-b544-66a7dd4219d5 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 15 03:29:25.283487 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 592/1186] 10.222.0.30 () {56 vars in 1138 bytes} [Fri Oct 15 03:29:25 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:25.289788 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cd7e5-f6b2-4f74-964d-36486ab4e23e None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:25.298542 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cd7e5-f6b2-4f74-964d-36486ab4e23e None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:25.303043 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45d6e7-45be-44a6-a253-798c268b4bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:25.304220 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45d6e7-45be-44a6-a253-798c268b4bbb admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:25.304503 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45d6e7-45be-44a6-a253-798c268b4bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:25.304778 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45d6e7-45be-44a6-a253-798c268b4bbb admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:25.305489 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45d6e7-45be-44a6-a253-798c268b4bbb admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:25.305793 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45d6e7-45be-44a6-a253-798c268b4bbb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:25.307379 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45d6e7-45be-44a6-a253-798c268b4bbb admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:25.312075 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 595/1187] 10.222.0.30 () {56 vars in 1137 bytes} [Fri Oct 15 03:29:25 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:25.317709 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ad23d-a0d3-4da0-b544-66a7dd4219d5 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:25.327247 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ad23d-a0d3-4da0-b544-66a7dd4219d5 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:25.331594 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cd4af-46fb-4bec-8169-cd0995c0cdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:25.332218 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cd4af-46fb-4bec-8169-cd0995c0cdd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:25.332495 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cd4af-46fb-4bec-8169-cd0995c0cdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:25.332764 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cd4af-46fb-4bec-8169-cd0995c0cdd5 admin admin] PATH_INFO: `/v3/services` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:25.333445 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cd4af-46fb-4bec-8169-cd0995c0cdd5 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:25.333740 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cd4af-46fb-4bec-8169-cd0995c0cdd5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:25.335290 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cd4af-46fb-4bec-8169-cd0995c0cdd5 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:25.339428 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 593/1188] 10.222.0.30 () {56 vars in 1137 bytes} [Fri Oct 15 03:29:25 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:27.574297 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e406b-a438-4d88-858f-99f91292493e None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:27.574793 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e406b-a438-4d88-858f-99f91292493e None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:27.574793 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e406b-a438-4d88-858f-99f91292493e None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:27.576598 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 596/1189] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:29:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:29:27.582500 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324e00c-afd4-4e73-9045-8c2ef5d55cd3 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:27.582895 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324e00c-afd4-4e73-9045-8c2ef5d55cd3 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:27.583042 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324e00c-afd4-4e73-9045-8c2ef5d55cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:27.600424 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-0324e00c-afd4-4e73-9045-8c2ef5d55cd3 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:29:27.601598 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-0324e00c-afd4-4e73-9045-8c2ef5d55cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:29:27.609083 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 594/1190] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:29:27 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:29:27.633539 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e406b-a438-4d88-858f-99f91292493e None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:27.645956 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e406b-a438-4d88-858f-99f91292493e None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:27.650967 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b76fb-fab5-4114-aeea-f0a9cc3aa2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:27.651583 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b76fb-fab5-4114-aeea-f0a9cc3aa2b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:27.651891 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b76fb-fab5-4114-aeea-f0a9cc3aa2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:27.652166 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b76fb-fab5-4114-aeea-f0a9cc3aa2b5 admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:27.652918 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b76fb-fab5-4114-aeea-f0a9cc3aa2b5 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:27.654498 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b76fb-fab5-4114-aeea-f0a9cc3aa2b5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:27.667505 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 597/1191] 10.222.0.30 () {60 vars in 1162 bytes} [Fri Oct 15 03:29:27 2021] POST /identity/v3/services => generated 246 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:29:29.891813 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d563358-47fd-4269-8720-171ca025f563 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:29.892350 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d563358-47fd-4269-8720-171ca025f563 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:29.892350 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d563358-47fd-4269-8720-171ca025f563 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:29.894128 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 595/1192] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:29:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:29:29.900422 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911fda6-60e8-4f4c-a7cf-ccf3522dc3a3 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:29.900833 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911fda6-60e8-4f4c-a7cf-ccf3522dc3a3 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:29.900969 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a911fda6-60e8-4f4c-a7cf-ccf3522dc3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:29.919362 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-a911fda6-60e8-4f4c-a7cf-ccf3522dc3a3 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:29:29.920565 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-a911fda6-60e8-4f4c-a7cf-ccf3522dc3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:29:29.936763 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 598/1193] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:29:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:29:29.960358 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d563358-47fd-4269-8720-171ca025f563 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:29.972296 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d563358-47fd-4269-8720-171ca025f563 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:29.977593 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b4671-f0d3-4666-8334-346b3d12beac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:29.978572 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b4671-f0d3-4666-8334-346b3d12beac admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:29.979054 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b4671-f0d3-4666-8334-346b3d12beac admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:29.979526 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b4671-f0d3-4666-8334-346b3d12beac admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:29.980511 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b4671-f0d3-4666-8334-346b3d12beac admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:29.983009 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b4671-f0d3-4666-8334-346b3d12beac admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:29.994338 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-984b4671-f0d3-4666-8334-346b3d12beac admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 15 03:29:29.995438 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 596/1194] 10.222.0.30 () {56 vars in 1138 bytes} [Fri Oct 15 03:29:29 2021] GET /identity/v3/services/placement => generated 90 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:30.001770 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911fda6-60e8-4f4c-a7cf-ccf3522dc3a3 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:30.010463 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a911fda6-60e8-4f4c-a7cf-ccf3522dc3a3 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:30.014961 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd257ab-cb11-4933-9c1b-423103fdc293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:30.015591 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd257ab-cb11-4933-9c1b-423103fdc293 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:30.015898 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd257ab-cb11-4933-9c1b-423103fdc293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:30.016169 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd257ab-cb11-4933-9c1b-423103fdc293 admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:30.016877 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd257ab-cb11-4933-9c1b-423103fdc293 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:30.017173 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd257ab-cb11-4933-9c1b-423103fdc293 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:30.018740 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd257ab-cb11-4933-9c1b-423103fdc293 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:30.025553 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 599/1195] 10.222.0.30 () {56 vars in 1137 bytes} [Fri Oct 15 03:29:30 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:30.031916 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b4671-f0d3-4666-8334-346b3d12beac admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:30.042075 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b4671-f0d3-4666-8334-346b3d12beac admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:30.046533 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208445ca-97e8-4bb2-b0ca-d8f20b876e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:30.047157 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208445ca-97e8-4bb2-b0ca-d8f20b876e34 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:30.047442 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208445ca-97e8-4bb2-b0ca-d8f20b876e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:30.047742 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208445ca-97e8-4bb2-b0ca-d8f20b876e34 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:30.048535 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208445ca-97e8-4bb2-b0ca-d8f20b876e34 admin admin] RBAC: Adding query filter params (interface=public, service_id=05c34b20062c4a2dbc1be9bae408852f, region_id=RegionOne) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:30.048841 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208445ca-97e8-4bb2-b0ca-d8f20b876e34 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:30.050415 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208445ca-97e8-4bb2-b0ca-d8f20b876e34 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:30.056134 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 597/1196] 10.222.0.30 () {56 vars in 1272 bytes} [Fri Oct 15 03:29:30 2021] GET /identity/v3/endpoints?service_id=05c34b20062c4a2dbc1be9bae408852f&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:30.061937 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd257ab-cb11-4933-9c1b-423103fdc293 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:30.071839 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd257ab-cb11-4933-9c1b-423103fdc293 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:30.076268 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5101bf2-a160-4633-b067-8c6a40291c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:30.076895 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5101bf2-a160-4633-b067-8c6a40291c1c admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:30.077173 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5101bf2-a160-4633-b067-8c6a40291c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:30.077442 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5101bf2-a160-4633-b067-8c6a40291c1c admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:30.078123 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5101bf2-a160-4633-b067-8c6a40291c1c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:30.079707 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5101bf2-a160-4633-b067-8c6a40291c1c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:30.086510 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 600/1197] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Oct 15 03:29:30 2021] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:29:32.316943 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe60015-8667-4f79-ade6-b44b973d0ef0 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:32.317425 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe60015-8667-4f79-ade6-b44b973d0ef0 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:32.317538 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe60015-8667-4f79-ade6-b44b973d0ef0 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:32.319805 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 598/1198] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:29:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:29:32.325651 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2534f6-3c3c-4a5a-a819-6943da187690 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:32.326052 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2534f6-3c3c-4a5a-a819-6943da187690 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:32.326202 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2534f6-3c3c-4a5a-a819-6943da187690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:32.344774 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-7b2534f6-3c3c-4a5a-a819-6943da187690 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:29:32.345950 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-7b2534f6-3c3c-4a5a-a819-6943da187690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:29:32.353863 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 601/1199] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:29:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:29:32.377231 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe60015-8667-4f79-ade6-b44b973d0ef0 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:32.389438 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe60015-8667-4f79-ade6-b44b973d0ef0 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:32.393687 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4f863-948f-4f7e-ad4a-96d65f4d52ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:32.394443 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4f863-948f-4f7e-ad4a-96d65f4d52ab admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:32.394722 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4f863-948f-4f7e-ad4a-96d65f4d52ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:32.394993 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4f863-948f-4f7e-ad4a-96d65f4d52ab admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:32.395644 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4f863-948f-4f7e-ad4a-96d65f4d52ab admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:32.397884 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4f863-948f-4f7e-ad4a-96d65f4d52ab admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:32.408429 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING keystone.server.flask.application [None req-c0c4f863-948f-4f7e-ad4a-96d65f4d52ab admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 15 03:29:32.409513 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 599/1200] 10.222.0.30 () {56 vars in 1138 bytes} [Fri Oct 15 03:29:32 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 15 03:29:32.415576 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2534f6-3c3c-4a5a-a819-6943da187690 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:32.424197 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2534f6-3c3c-4a5a-a819-6943da187690 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:32.428663 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90817c68-ffb2-4238-a542-2230b54caa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:32.429290 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90817c68-ffb2-4238-a542-2230b54caa61 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:32.429570 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90817c68-ffb2-4238-a542-2230b54caa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:32.429844 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90817c68-ffb2-4238-a542-2230b54caa61 admin admin] PATH_INFO: `/v3/services` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:32.430548 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90817c68-ffb2-4238-a542-2230b54caa61 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:29:32.430853 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90817c68-ffb2-4238-a542-2230b54caa61 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:32.432471 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90817c68-ffb2-4238-a542-2230b54caa61 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:32.437561 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 602/1201] 10.222.0.30 () {56 vars in 1137 bytes} [Fri Oct 15 03:29:32 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:29:32.443087 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4f863-948f-4f7e-ad4a-96d65f4d52ab admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:29:32.453084 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4f863-948f-4f7e-ad4a-96d65f4d52ab admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:29:32.457470 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04671a-3228-497d-9f22-890b23d3599e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:29:32.458061 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04671a-3228-497d-9f22-890b23d3599e admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:29:32.458340 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04671a-3228-497d-9f22-890b23d3599e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:29:32.458611 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04671a-3228-497d-9f22-890b23d3599e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:29:32.459346 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04671a-3228-497d-9f22-890b23d3599e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:29:32.461460 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04671a-3228-497d-9f22-890b23d3599e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:29:32.478837 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 600/1202] 10.222.0.30 () {60 vars in 1165 bytes} [Fri Oct 15 03:29:32 2021] POST /identity/v3/endpoints => generated 331 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:30:35.368608 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5038922-6881-4c2e-ab61-73707d18f1cf None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:35.369187 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5038922-6881-4c2e-ab61-73707d18f1cf None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:35.369187 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5038922-6881-4c2e-ab61-73707d18f1cf None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:35.371309 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 603/1203] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:30:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:30:35.377043 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c235e-d190-4435-b448-16f7d2b79bc2 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:35.377885 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c235e-d190-4435-b448-16f7d2b79bc2 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:35.378324 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c235e-d190-4435-b448-16f7d2b79bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:35.508864 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-463c235e-d190-4435-b448-16f7d2b79bc2 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:30:35.510140 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-463c235e-d190-4435-b448-16f7d2b79bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:35.651762 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 601/1204] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:30:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:30:35.668249 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5038922-6881-4c2e-ab61-73707d18f1cf None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:30:35.670066 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-d5038922-6881-4c2e-ab61-73707d18f1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:35.830793 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5038922-6881-4c2e-ab61-73707d18f1cf None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:30:35.946100 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8a2c3-99c4-4c01-900a-d534adbee98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:30:35.946930 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8a2c3-99c4-4c01-900a-d534adbee98c admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:35.947208 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8a2c3-99c4-4c01-900a-d534adbee98c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:35.947478 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8a2c3-99c4-4c01-900a-d534adbee98c admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:35.949581 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8a2c3-99c4-4c01-900a-d534adbee98c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:30:35.952854 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8a2c3-99c4-4c01-900a-d534adbee98c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:30:36.009124 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 604/1205] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Oct 15 03:30:35 2021] GET /identity/v3/projects => generated 2553 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:30:38.376475 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674992ae-7719-4a29-a5b9-6f0c5a855c0c None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:38.377039 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674992ae-7719-4a29-a5b9-6f0c5a855c0c None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:38.377039 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674992ae-7719-4a29-a5b9-6f0c5a855c0c None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:38.379122 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 602/1206] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:30:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:30:38.385142 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10877ba7-9713-4faa-88ed-7c7d4e5f18f4 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:38.385527 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10877ba7-9713-4faa-88ed-7c7d4e5f18f4 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:38.385682 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10877ba7-9713-4faa-88ed-7c7d4e5f18f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:38.454749 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-10877ba7-9713-4faa-88ed-7c7d4e5f18f4 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:30:38.455970 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-10877ba7-9713-4faa-88ed-7c7d4e5f18f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:38.546396 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 605/1207] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:30:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:30:38.600885 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add00614-bae5-4684-b011-ca7858ae5ed9 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:38.601168 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add00614-bae5-4684-b011-ca7858ae5ed9 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:38.601444 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add00614-bae5-4684-b011-ca7858ae5ed9 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:38.603213 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 603/1208] 10.222.0.30 () {54 vars in 963 bytes} [Fri Oct 15 03:30:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:30:38.609379 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8a388-0f5c-46fa-b405-5bc903907f04 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:38.609663 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8a388-0f5c-46fa-b405-5bc903907f04 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:38.609938 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8a388-0f5c-46fa-b405-5bc903907f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:38.682099 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-b7b8a388-0f5c-46fa-b405-5bc903907f04 None None] MFA Rules not processed for user `3ea75b4f9132494388b223a309a40640`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:30:38.683290 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-b7b8a388-0f5c-46fa-b405-5bc903907f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:38.754036 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 606/1209] 10.222.0.30 () {58 vars in 1060 bytes} [Fri Oct 15 03:30:38 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:30:38.763342 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add00614-bae5-4684-b011-ca7858ae5ed9 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:30:38.764878 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-add00614-bae5-4684-b011-ca7858ae5ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:38.866380 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add00614-bae5-4684-b011-ca7858ae5ed9 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:30:38.940522 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e81bf5-30ee-4f71-911c-17bec5aca5f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:30:38.941163 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e81bf5-30ee-4f71-911c-17bec5aca5f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:38.941445 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e81bf5-30ee-4f71-911c-17bec5aca5f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:38.941719 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e81bf5-30ee-4f71-911c-17bec5aca5f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:38.943397 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-47e81bf5-30ee-4f71-911c-17bec5aca5f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:39.046318 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e81bf5-30ee-4f71-911c-17bec5aca5f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:30:39.047772 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e81bf5-30ee-4f71-911c-17bec5aca5f5 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:30:39.064665 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 604/1210] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:30:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:30:41.537608 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58425fc2-9d0c-46ac-a26c-45738a54d18f None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:41.538131 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58425fc2-9d0c-46ac-a26c-45738a54d18f None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:41.538131 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58425fc2-9d0c-46ac-a26c-45738a54d18f None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:41.539954 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 607/1211] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:30:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:30:41.546067 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c2d27-6489-47f3-92c3-430378c277b8 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:41.546465 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c2d27-6489-47f3-92c3-430378c277b8 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:41.546613 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c2d27-6489-47f3-92c3-430378c277b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:41.607894 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-663c2d27-6489-47f3-92c3-430378c277b8 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:30:41.609075 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-663c2d27-6489-47f3-92c3-430378c277b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:41.698030 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 605/1212] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:30:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:30:41.738449 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58425fc2-9d0c-46ac-a26c-45738a54d18f None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:30:41.740039 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-58425fc2-9d0c-46ac-a26c-45738a54d18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:41.841178 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58425fc2-9d0c-46ac-a26c-45738a54d18f None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:30:41.910894 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d07fdc-a1b1-4468-bc7c-ac270ae451b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:30:41.912223 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d07fdc-a1b1-4468-bc7c-ac270ae451b5 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:41.912508 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d07fdc-a1b1-4468-bc7c-ac270ae451b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:41.912781 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d07fdc-a1b1-4468-bc7c-ac270ae451b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:41.914409 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-b0d07fdc-a1b1-4468-bc7c-ac270ae451b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:42.019693 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d07fdc-a1b1-4468-bc7c-ac270ae451b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:30:42.021709 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d07fdc-a1b1-4468-bc7c-ac270ae451b5 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:30:42.040183 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 608/1213] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:30:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:30:44.582368 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a6589-8bbf-4938-9167-89f9e980d9fb None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:44.582878 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a6589-8bbf-4938-9167-89f9e980d9fb None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:44.582878 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a6589-8bbf-4938-9167-89f9e980d9fb None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:44.584668 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 606/1214] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:30:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:30:44.590460 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1479a7b-b700-4660-8034-d16501974288 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:44.590882 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1479a7b-b700-4660-8034-d16501974288 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:44.591023 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1479a7b-b700-4660-8034-d16501974288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:44.655056 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-c1479a7b-b700-4660-8034-d16501974288 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:30:44.656278 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-c1479a7b-b700-4660-8034-d16501974288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:44.746149 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 609/1215] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:30:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:30:44.782019 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a6589-8bbf-4938-9167-89f9e980d9fb None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:30:44.783534 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-677a6589-8bbf-4938-9167-89f9e980d9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:44.902390 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a6589-8bbf-4938-9167-89f9e980d9fb None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:30:44.988982 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579691c-acd5-48aa-a0fe-f92898dcd650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:30:44.990343 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579691c-acd5-48aa-a0fe-f92898dcd650 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:44.990620 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579691c-acd5-48aa-a0fe-f92898dcd650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:44.990892 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579691c-acd5-48aa-a0fe-f92898dcd650 admin admin] PATH_INFO: `/v3/projects/098453151f33456db2f118ed4fac105c` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:45.000243 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579691c-acd5-48aa-a0fe-f92898dcd650 admin admin] RBAC: Authorizing `identity:get_project(project_id=098453151f33456db2f118ed4fac105c)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:30:45.002290 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579691c-acd5-48aa-a0fe-f92898dcd650 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:30:45.003979 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 607/1216] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:30:44 2021] GET /identity/v3/projects/098453151f33456db2f118ed4fac105c => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:30:45.017452 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1479a7b-b700-4660-8034-d16501974288 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:30:45.018649 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-c1479a7b-b700-4660-8034-d16501974288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:45.102688 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1479a7b-b700-4660-8034-d16501974288 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:30:45.170192 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c791746-e3d2-4e7b-b30b-7401a57ec495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:30:45.170751 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c791746-e3d2-4e7b-b30b-7401a57ec495 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:45.171028 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c791746-e3d2-4e7b-b30b-7401a57ec495 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:45.171297 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c791746-e3d2-4e7b-b30b-7401a57ec495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:45.172916 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-6c791746-e3d2-4e7b-b30b-7401a57ec495 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:45.273551 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c791746-e3d2-4e7b-b30b-7401a57ec495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:30:45.274967 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c791746-e3d2-4e7b-b30b-7401a57ec495 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:30:45.292308 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 610/1217] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:30:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:30:48.021574 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8ea9e-7167-4a5b-aac4-3667af3431e5 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:48.022185 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8ea9e-7167-4a5b-aac4-3667af3431e5 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:48.022185 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8ea9e-7167-4a5b-aac4-3667af3431e5 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:48.023929 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 608/1218] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:30:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:30:48.029927 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53aae3-8f64-4552-9b1b-2a74d7ece1c0 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:48.030362 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53aae3-8f64-4552-9b1b-2a74d7ece1c0 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:48.030494 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53aae3-8f64-4552-9b1b-2a74d7ece1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:48.092207 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-fe53aae3-8f64-4552-9b1b-2a74d7ece1c0 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:30:48.093338 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-fe53aae3-8f64-4552-9b1b-2a74d7ece1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:48.185530 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 611/1219] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:30:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:30:48.228097 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8ea9e-7167-4a5b-aac4-3667af3431e5 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:30:48.229591 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-fda8ea9e-7167-4a5b-aac4-3667af3431e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:48.348208 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8ea9e-7167-4a5b-aac4-3667af3431e5 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:30:48.436906 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3e8e9-26f6-4b69-a14e-d46d1594d1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:30:48.437743 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3e8e9-26f6-4b69-a14e-d46d1594d1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:48.438022 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3e8e9-26f6-4b69-a14e-d46d1594d1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:48.438296 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3e8e9-26f6-4b69-a14e-d46d1594d1b0 admin admin] PATH_INFO: `/v3/projects/098453151f33456db2f118ed4fac105c` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:48.448279 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3e8e9-26f6-4b69-a14e-d46d1594d1b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=098453151f33456db2f118ed4fac105c)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:30:48.450334 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3e8e9-26f6-4b69-a14e-d46d1594d1b0 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:30:48.452044 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 609/1220] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:30:48 2021] GET /identity/v3/projects/098453151f33456db2f118ed4fac105c => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:30:48.480403 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72d866-21a7-4660-a025-8d3ce3b2b822 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:48.480686 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72d866-21a7-4660-a025-8d3ce3b2b822 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:48.480957 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72d866-21a7-4660-a025-8d3ce3b2b822 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:48.482779 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 612/1221] 10.222.0.30 () {54 vars in 963 bytes} [Fri Oct 15 03:30:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:30:48.488830 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01cafd-60b7-4f0a-9ff8-3c8961c590dd None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:48.489113 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01cafd-60b7-4f0a-9ff8-3c8961c590dd None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:48.489897 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01cafd-60b7-4f0a-9ff8-3c8961c590dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:48.560126 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-af01cafd-60b7-4f0a-9ff8-3c8961c590dd None None] MFA Rules not processed for user `3ea75b4f9132494388b223a309a40640`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:30:48.561324 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-af01cafd-60b7-4f0a-9ff8-3c8961c590dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:48.632934 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 610/1222] 10.222.0.30 () {58 vars in 1060 bytes} [Fri Oct 15 03:30:48 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:30:48.641977 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72d866-21a7-4660-a025-8d3ce3b2b822 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:30:48.643516 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-7e72d866-21a7-4660-a025-8d3ce3b2b822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:48.741253 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72d866-21a7-4660-a025-8d3ce3b2b822 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:30:48.809955 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853e117-2e15-490f-a18e-4f486c6081e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:30:48.810582 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853e117-2e15-490f-a18e-4f486c6081e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:48.810860 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853e117-2e15-490f-a18e-4f486c6081e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:48.811129 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853e117-2e15-490f-a18e-4f486c6081e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:48.812765 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-3853e117-2e15-490f-a18e-4f486c6081e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:48.914694 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853e117-2e15-490f-a18e-4f486c6081e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:30:48.916079 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853e117-2e15-490f-a18e-4f486c6081e3 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:30:48.933577 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 613/1223] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:30:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:30:52.298449 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b773a-02e4-4351-a761-6fac26d118b7 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:52.299004 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b773a-02e4-4351-a761-6fac26d118b7 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:52.299004 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b773a-02e4-4351-a761-6fac26d118b7 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:52.300853 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 611/1224] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:30:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:30:52.307895 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d0b10-8bda-4f74-9879-1741b63611e2 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:52.308413 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d0b10-8bda-4f74-9879-1741b63611e2 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:52.308623 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d0b10-8bda-4f74-9879-1741b63611e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:52.377957 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-b24d0b10-8bda-4f74-9879-1741b63611e2 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:30:52.379167 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-b24d0b10-8bda-4f74-9879-1741b63611e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:52.476521 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 614/1225] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:30:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:30:52.514699 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b773a-02e4-4351-a761-6fac26d118b7 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:30:52.516234 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-b45b773a-02e4-4351-a761-6fac26d118b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:52.613778 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b773a-02e4-4351-a761-6fac26d118b7 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:30:52.685576 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4658fb-d72b-4634-89eb-32c831b05c7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:30:52.686209 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4658fb-d72b-4634-89eb-32c831b05c7d service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:52.686485 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4658fb-d72b-4634-89eb-32c831b05c7d service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:52.686752 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4658fb-d72b-4634-89eb-32c831b05c7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:52.688391 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-3e4658fb-d72b-4634-89eb-32c831b05c7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:52.793557 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4658fb-d72b-4634-89eb-32c831b05c7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:30:52.794917 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4658fb-d72b-4634-89eb-32c831b05c7d service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:30:52.812274 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 612/1226] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:30:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:30:55.142478 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e712cef-d6a0-470f-8cc6-c7732560fe79 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:55.142997 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e712cef-d6a0-470f-8cc6-c7732560fe79 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:55.142997 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e712cef-d6a0-470f-8cc6-c7732560fe79 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:55.144773 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 615/1227] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:30:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:30:55.151412 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230f292-0db5-4ef1-9f29-818c5840136a None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:55.151862 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230f292-0db5-4ef1-9f29-818c5840136a None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:55.152162 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230f292-0db5-4ef1-9f29-818c5840136a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:55.214227 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-6230f292-0db5-4ef1-9f29-818c5840136a None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:30:55.215425 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-6230f292-0db5-4ef1-9f29-818c5840136a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:55.309127 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 613/1228] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:30:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:30:55.346537 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e712cef-d6a0-470f-8cc6-c7732560fe79 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:30:55.348072 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-5e712cef-d6a0-470f-8cc6-c7732560fe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:55.446770 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e712cef-d6a0-470f-8cc6-c7732560fe79 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:30:55.519055 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97397472-712f-49f6-bc02-d8d169a4e5cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:30:55.519784 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97397472-712f-49f6-bc02-d8d169a4e5cc service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:55.520100 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97397472-712f-49f6-bc02-d8d169a4e5cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:55.520429 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97397472-712f-49f6-bc02-d8d169a4e5cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:55.522134 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-97397472-712f-49f6-bc02-d8d169a4e5cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:55.627354 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97397472-712f-49f6-bc02-d8d169a4e5cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:30:55.628819 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97397472-712f-49f6-bc02-d8d169a4e5cc service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:30:55.646018 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 616/1229] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:30:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:30:57.935135 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a8f27-8e27-45cc-80b7-03177c1ba861 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:57.935744 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a8f27-8e27-45cc-80b7-03177c1ba861 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:57.935842 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a8f27-8e27-45cc-80b7-03177c1ba861 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:57.937823 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 614/1230] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:30:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:30:57.944050 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3ade0-3330-417b-8f94-d4f0d6941e60 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:57.944432 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3ade0-3330-417b-8f94-d4f0d6941e60 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:57.944597 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3ade0-3330-417b-8f94-d4f0d6941e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:58.013210 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-95f3ade0-3330-417b-8f94-d4f0d6941e60 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:30:58.014418 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-95f3ade0-3330-417b-8f94-d4f0d6941e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:58.107868 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 617/1231] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:30:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:30:58.140954 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a8f27-8e27-45cc-80b7-03177c1ba861 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:30:58.142526 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-f63a8f27-8e27-45cc-80b7-03177c1ba861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:58.263205 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a8f27-8e27-45cc-80b7-03177c1ba861 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:30:58.351101 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd1f08-475e-4451-9ee9-5b8bfbb309b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:30:58.351976 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd1f08-475e-4451-9ee9-5b8bfbb309b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:58.352256 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd1f08-475e-4451-9ee9-5b8bfbb309b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:58.352527 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd1f08-475e-4451-9ee9-5b8bfbb309b1 admin admin] PATH_INFO: `/v3/projects/098453151f33456db2f118ed4fac105c` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:58.362147 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd1f08-475e-4451-9ee9-5b8bfbb309b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=098453151f33456db2f118ed4fac105c)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:30:58.364752 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd1f08-475e-4451-9ee9-5b8bfbb309b1 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:30:58.366451 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 615/1232] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:30:58 2021] GET /identity/v3/projects/098453151f33456db2f118ed4fac105c => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:30:58.378558 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3ade0-3330-417b-8f94-d4f0d6941e60 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:30:58.380456 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-95f3ade0-3330-417b-8f94-d4f0d6941e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:58.465974 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3ade0-3330-417b-8f94-d4f0d6941e60 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:30:58.540771 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee69636-457c-48b4-b281-7ead75340937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:30:58.541408 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee69636-457c-48b4-b281-7ead75340937 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:30:58.541689 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee69636-457c-48b4-b281-7ead75340937 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:30:58.541960 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee69636-457c-48b4-b281-7ead75340937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:30:58.543594 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-8ee69636-457c-48b4-b281-7ead75340937 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:30:58.647784 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee69636-457c-48b4-b281-7ead75340937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:30:58.649156 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee69636-457c-48b4-b281-7ead75340937 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:30:58.666757 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 618/1233] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:30:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:31:01.169621 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dee9ae-6ece-4c5e-bc9c-407697c7f97e None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:01.170201 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dee9ae-6ece-4c5e-bc9c-407697c7f97e None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:01.170201 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dee9ae-6ece-4c5e-bc9c-407697c7f97e None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:01.172093 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 616/1234] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:31:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:01.178140 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbef0c-5d13-44d4-9b46-47ccf0451c42 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:01.178545 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbef0c-5d13-44d4-9b46-47ccf0451c42 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:01.178693 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbef0c-5d13-44d4-9b46-47ccf0451c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:01.241421 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-6dfbef0c-5d13-44d4-9b46-47ccf0451c42 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:01.242800 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-6dfbef0c-5d13-44d4-9b46-47ccf0451c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:01.333499 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 619/1235] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:31:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:31:01.371009 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dee9ae-6ece-4c5e-bc9c-407697c7f97e None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:31:01.372562 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-f8dee9ae-6ece-4c5e-bc9c-407697c7f97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:01.470024 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dee9ae-6ece-4c5e-bc9c-407697c7f97e None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:31:01.538376 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1e4a8-69f2-4232-82f4-76d5ecbf6af0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:31:01.539003 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1e4a8-69f2-4232-82f4-76d5ecbf6af0 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:01.539281 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1e4a8-69f2-4232-82f4-76d5ecbf6af0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:01.539550 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1e4a8-69f2-4232-82f4-76d5ecbf6af0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:01.541212 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-f0e1e4a8-69f2-4232-82f4-76d5ecbf6af0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:01.642338 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1e4a8-69f2-4232-82f4-76d5ecbf6af0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:31:01.643793 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1e4a8-69f2-4232-82f4-76d5ecbf6af0 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:31:01.661307 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 617/1236] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:31:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:31:03.940983 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b3ccb-cda1-4c0d-b976-511a5cdd7e08 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:03.941509 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b3ccb-cda1-4c0d-b976-511a5cdd7e08 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:03.941617 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b3ccb-cda1-4c0d-b976-511a5cdd7e08 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:03.943940 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 620/1237] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:31:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:03.949721 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758675d-adf6-48ce-bacf-169447df4d63 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:03.950123 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758675d-adf6-48ce-bacf-169447df4d63 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:03.950277 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758675d-adf6-48ce-bacf-169447df4d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:04.014251 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-b758675d-adf6-48ce-bacf-169447df4d63 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:04.015454 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-b758675d-adf6-48ce-bacf-169447df4d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:04.106048 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 618/1238] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:31:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:31:04.149383 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b3ccb-cda1-4c0d-b976-511a5cdd7e08 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:31:04.150917 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-9b1b3ccb-cda1-4c0d-b976-511a5cdd7e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:04.248194 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b3ccb-cda1-4c0d-b976-511a5cdd7e08 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:31:04.316912 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a4f84-85c3-4095-84a9-ebf183f7bd27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:31:04.318086 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a4f84-85c3-4095-84a9-ebf183f7bd27 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:04.318364 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a4f84-85c3-4095-84a9-ebf183f7bd27 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:04.318637 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a4f84-85c3-4095-84a9-ebf183f7bd27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:04.320279 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-518a4f84-85c3-4095-84a9-ebf183f7bd27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:04.423007 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a4f84-85c3-4095-84a9-ebf183f7bd27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:31:04.424391 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a4f84-85c3-4095-84a9-ebf183f7bd27 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:31:04.442710 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 621/1239] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:31:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:31:07.031150 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b3f7c-e0f6-4b21-baa2-c2b4bccdbf7a None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:07.031745 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b3f7c-e0f6-4b21-baa2-c2b4bccdbf7a None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:07.031745 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b3f7c-e0f6-4b21-baa2-c2b4bccdbf7a None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:07.033507 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 619/1240] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:31:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:07.039500 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca9223-e4e0-47b4-82f1-e663a53524d5 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:07.040004 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca9223-e4e0-47b4-82f1-e663a53524d5 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:07.040116 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca9223-e4e0-47b4-82f1-e663a53524d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:07.106577 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-57ca9223-e4e0-47b4-82f1-e663a53524d5 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:07.107776 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-57ca9223-e4e0-47b4-82f1-e663a53524d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:07.204678 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 622/1241] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:31:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:31:07.242651 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b3f7c-e0f6-4b21-baa2-c2b4bccdbf7a None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:31:07.244806 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-b00b3f7c-e0f6-4b21-baa2-c2b4bccdbf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:07.337385 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b3f7c-e0f6-4b21-baa2-c2b4bccdbf7a None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:31:07.340845 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbb343-a760-4b09-b8c8-60bd10b7dac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:31:07.341478 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbb343-a760-4b09-b8c8-60bd10b7dac6 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:07.341756 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbb343-a760-4b09-b8c8-60bd10b7dac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:07.342030 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbb343-a760-4b09-b8c8-60bd10b7dac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:07.350862 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bbb343-a760-4b09-b8c8-60bd10b7dac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:31:07.352302 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bbb343-a760-4b09-b8c8-60bd10b7dac6 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:31:07.361164 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 620/1242] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:31:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:31:11.582686 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11443f46-c58f-499b-9641-d5ea2c1fe718 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:11.583225 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11443f46-c58f-499b-9641-d5ea2c1fe718 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:11.583225 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11443f46-c58f-499b-9641-d5ea2c1fe718 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:11.584971 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 623/1243] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:31:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:11.590940 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64090bb-5f7a-46f3-a2f2-131faec6cf45 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:11.591360 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64090bb-5f7a-46f3-a2f2-131faec6cf45 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:11.591563 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64090bb-5f7a-46f3-a2f2-131faec6cf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:11.609607 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-a64090bb-5f7a-46f3-a2f2-131faec6cf45 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:11.610884 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-a64090bb-5f7a-46f3-a2f2-131faec6cf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:11.619096 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 621/1244] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:31:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:31:11.659218 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11443f46-c58f-499b-9641-d5ea2c1fe718 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:31:11.670104 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11443f46-c58f-499b-9641-d5ea2c1fe718 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:31:11.673519 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f5c8f-29f4-4854-8cfb-036bd5d6547d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:31:11.674136 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f5c8f-29f4-4854-8cfb-036bd5d6547d service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:11.674541 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f5c8f-29f4-4854-8cfb-036bd5d6547d service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:11.674817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f5c8f-29f4-4854-8cfb-036bd5d6547d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:11.683368 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f5c8f-29f4-4854-8cfb-036bd5d6547d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:31:11.684822 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f5c8f-29f4-4854-8cfb-036bd5d6547d service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:31:11.693746 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 624/1245] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:31:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:31:14.486982 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dd757-aa00-429d-91d0-8747596c88a3 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:14.487556 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dd757-aa00-429d-91d0-8747596c88a3 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:14.487556 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dd757-aa00-429d-91d0-8747596c88a3 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:14.489329 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 622/1246] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:31:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:14.495243 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea31e86-7ce8-4a48-8fa6-039b0e378675 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:14.495642 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea31e86-7ce8-4a48-8fa6-039b0e378675 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:14.495803 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea31e86-7ce8-4a48-8fa6-039b0e378675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:14.513584 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-4ea31e86-7ce8-4a48-8fa6-039b0e378675 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:14.514762 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-4ea31e86-7ce8-4a48-8fa6-039b0e378675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:14.523218 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 625/1247] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:31:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:31:14.561213 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dd757-aa00-429d-91d0-8747596c88a3 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:31:14.562872 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-1a0dd757-aa00-429d-91d0-8747596c88a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:14.575926 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dd757-aa00-429d-91d0-8747596c88a3 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:31:14.579337 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19432f-8320-4c8c-b355-d5d4af50d87d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:31:14.579994 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19432f-8320-4c8c-b355-d5d4af50d87d service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:14.580278 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19432f-8320-4c8c-b355-d5d4af50d87d service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:14.580552 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19432f-8320-4c8c-b355-d5d4af50d87d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:14.590284 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19432f-8320-4c8c-b355-d5d4af50d87d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:31:14.591721 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19432f-8320-4c8c-b355-d5d4af50d87d service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:31:14.601272 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 623/1248] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:31:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:31:19.167124 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850fd39-57bb-4cb9-8fa1-3bbde3df21fa None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:19.167663 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850fd39-57bb-4cb9-8fa1-3bbde3df21fa None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:19.167663 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850fd39-57bb-4cb9-8fa1-3bbde3df21fa None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:19.169533 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 626/1249] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:31:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:19.175807 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ed5dd-e542-44e7-9525-1cda7d5d4931 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:19.176248 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ed5dd-e542-44e7-9525-1cda7d5d4931 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:19.176401 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ed5dd-e542-44e7-9525-1cda7d5d4931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:19.194908 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-a42ed5dd-e542-44e7-9525-1cda7d5d4931 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:19.196151 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-a42ed5dd-e542-44e7-9525-1cda7d5d4931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:19.204046 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 624/1250] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:31:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:31:19.245335 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850fd39-57bb-4cb9-8fa1-3bbde3df21fa None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:31:19.255910 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850fd39-57bb-4cb9-8fa1-3bbde3df21fa None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:31:19.259377 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2812b2-e8cc-4d78-8e3b-c5ba0973b4f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:31:19.260422 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2812b2-e8cc-4d78-8e3b-c5ba0973b4f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:19.260422 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2812b2-e8cc-4d78-8e3b-c5ba0973b4f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:19.260627 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2812b2-e8cc-4d78-8e3b-c5ba0973b4f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:19.271631 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2812b2-e8cc-4d78-8e3b-c5ba0973b4f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:31:19.273101 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2812b2-e8cc-4d78-8e3b-c5ba0973b4f0 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:31:19.282516 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 627/1251] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:31:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:31:24.442370 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979ae27-da62-4b21-ad9d-0a34a78ab951 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:24.443402 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979ae27-da62-4b21-ad9d-0a34a78ab951 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:24.443868 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979ae27-da62-4b21-ad9d-0a34a78ab951 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:24.446239 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 625/1252] 10.222.0.30 () {54 vars in 921 bytes} [Fri Oct 15 03:31:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:24.452655 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1a7d3-f3f3-499a-885a-0772a049a153 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:24.453141 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1a7d3-f3f3-499a-885a-0772a049a153 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:24.453254 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1a7d3-f3f3-499a-885a-0772a049a153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:24.533997 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-39b1a7d3-f3f3-499a-885a-0772a049a153 None None] MFA Rules not processed for user `bffc0480ffb942cdad426195eca0529e`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:24.535645 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-39b1a7d3-f3f3-499a-885a-0772a049a153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:24.633115 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 628/1253] 10.222.0.30 () {58 vars in 1018 bytes} [Fri Oct 15 03:31:24 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:31:28.851374 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e4893-c6be-4e9b-a2b2-8226734b694d None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:28.851374 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e4893-c6be-4e9b-a2b2-8226734b694d None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:28.851374 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e4893-c6be-4e9b-a2b2-8226734b694d None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:28.851374 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 626/1254] 10.222.0.30 () {54 vars in 921 bytes} [Fri Oct 15 03:31:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:28.856771 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965819b-81c4-4e76-a5cd-801f27847585 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:28.857225 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965819b-81c4-4e76-a5cd-801f27847585 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:28.857307 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965819b-81c4-4e76-a5cd-801f27847585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:28.877475 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-c965819b-81c4-4e76-a5cd-801f27847585 None None] MFA Rules not processed for user `bffc0480ffb942cdad426195eca0529e`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:28.879554 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-c965819b-81c4-4e76-a5cd-801f27847585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:28.888466 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 629/1255] 10.222.0.30 () {58 vars in 1018 bytes} [Fri Oct 15 03:31:28 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:31:30.347005 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f425e-1a8f-4343-b99a-c14660678388 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:30.347547 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f425e-1a8f-4343-b99a-c14660678388 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:30.347642 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f425e-1a8f-4343-b99a-c14660678388 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:30.349413 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 627/1256] 10.222.0.30 () {54 vars in 921 bytes} [Fri Oct 15 03:31:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:30.354766 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b90f76-3bcf-435f-ac7c-7838437f7cfe None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:30.355175 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b90f76-3bcf-435f-ac7c-7838437f7cfe None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:30.355454 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b90f76-3bcf-435f-ac7c-7838437f7cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:30.373180 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-a3b90f76-3bcf-435f-ac7c-7838437f7cfe None None] MFA Rules not processed for user `bffc0480ffb942cdad426195eca0529e`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:30.374369 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-a3b90f76-3bcf-435f-ac7c-7838437f7cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:30.384123 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 630/1257] 10.222.0.30 () {58 vars in 1018 bytes} [Fri Oct 15 03:31:30 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:31:34.189560 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907e502-9860-4c34-b2d3-f0f2885bc015 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:34.190068 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907e502-9860-4c34-b2d3-f0f2885bc015 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:34.190068 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907e502-9860-4c34-b2d3-f0f2885bc015 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:34.192977 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 628/1258] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:31:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:34.198817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ad59c-a7d0-4e5b-a507-e466bd577ba3 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:34.199216 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ad59c-a7d0-4e5b-a507-e466bd577ba3 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:34.199372 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ad59c-a7d0-4e5b-a507-e466bd577ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:34.217411 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-3d3ad59c-a7d0-4e5b-a507-e466bd577ba3 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:34.218620 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-3d3ad59c-a7d0-4e5b-a507-e466bd577ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:34.227117 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 631/1259] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:31:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:31:34.278388 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccb9fa-7e4f-464e-9df9-aa045d71f24c None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:34.278710 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccb9fa-7e4f-464e-9df9-aa045d71f24c None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:34.278972 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccb9fa-7e4f-464e-9df9-aa045d71f24c None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:34.280793 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 629/1260] 10.222.0.30 () {54 vars in 960 bytes} [Fri Oct 15 03:31:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:34.288440 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f90c86-0b8e-4f67-9166-4367cb9a06b9 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:34.288723 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f90c86-0b8e-4f67-9166-4367cb9a06b9 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:34.289181 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f90c86-0b8e-4f67-9166-4367cb9a06b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:34.339041 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-44f90c86-0b8e-4f67-9166-4367cb9a06b9 None None] MFA Rules not processed for user `3d71a1bd93b04249b2b8e6a054de44c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:34.341110 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-44f90c86-0b8e-4f67-9166-4367cb9a06b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:34.425941 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 632/1261] 10.222.0.30 () {58 vars in 1057 bytes} [Fri Oct 15 03:31:34 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:31:34.434222 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccb9fa-7e4f-464e-9df9-aa045d71f24c None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:31:34.449161 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccb9fa-7e4f-464e-9df9-aa045d71f24c None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:31:34.454445 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5a0d3-5c35-4349-9140-59f6363f47aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:31:34.455075 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5a0d3-5c35-4349-9140-59f6363f47aa service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:34.455358 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5a0d3-5c35-4349-9140-59f6363f47aa service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:34.455635 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5a0d3-5c35-4349-9140-59f6363f47aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:34.482696 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5a0d3-5c35-4349-9140-59f6363f47aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:31:34.485919 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5a0d3-5c35-4349-9140-59f6363f47aa service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:31:34.496495 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 630/1262] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:31:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:31:36.997432 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8575c1-afdc-48b4-b261-ee1374a8a637 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:36.997952 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8575c1-afdc-48b4-b261-ee1374a8a637 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:36.998048 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8575c1-afdc-48b4-b261-ee1374a8a637 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:36.999809 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 633/1263] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:31:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:37.005828 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fd57b-5d07-467f-b913-b405906335c3 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:37.006260 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fd57b-5d07-467f-b913-b405906335c3 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:37.006378 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fd57b-5d07-467f-b913-b405906335c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:37.024274 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-504fd57b-5d07-467f-b913-b405906335c3 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:37.025462 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-504fd57b-5d07-467f-b913-b405906335c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:37.033442 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 631/1264] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:31:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:31:37.079790 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8575c1-afdc-48b4-b261-ee1374a8a637 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:31:37.094145 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8575c1-afdc-48b4-b261-ee1374a8a637 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:31:37.100526 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6f258-5879-4f10-a7fb-c1eba6836507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:31:37.101249 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6f258-5879-4f10-a7fb-c1eba6836507 service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:37.101726 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6f258-5879-4f10-a7fb-c1eba6836507 service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:37.102096 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6f258-5879-4f10-a7fb-c1eba6836507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:37.109949 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6f258-5879-4f10-a7fb-c1eba6836507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:31:37.111638 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6f258-5879-4f10-a7fb-c1eba6836507 service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:31:37.121561 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 634/1265] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:31:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:31:39.675523 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd38fdc-3abc-4f77-b805-6ed1534ea842 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:39.676083 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd38fdc-3abc-4f77-b805-6ed1534ea842 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:39.676191 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd38fdc-3abc-4f77-b805-6ed1534ea842 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:39.677880 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 632/1266] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:31:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:39.685126 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad7838-3ce2-4f3f-aafe-027636653b92 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:39.685935 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad7838-3ce2-4f3f-aafe-027636653b92 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:39.686209 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad7838-3ce2-4f3f-aafe-027636653b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:39.705844 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-cbad7838-3ce2-4f3f-aafe-027636653b92 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:39.707560 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-cbad7838-3ce2-4f3f-aafe-027636653b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:39.716460 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 635/1267] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:31:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:31:39.764355 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b19a8e-8fe1-4d6f-9ed0-b74b599dd1ee None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:39.764579 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b19a8e-8fe1-4d6f-9ed0-b74b599dd1ee None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:39.764856 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b19a8e-8fe1-4d6f-9ed0-b74b599dd1ee None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:39.766773 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 633/1268] 10.222.0.30 () {54 vars in 960 bytes} [Fri Oct 15 03:31:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:39.773006 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02944e10-b900-4827-b1bf-b7318a173b0f None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:39.773288 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02944e10-b900-4827-b1bf-b7318a173b0f None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:39.773562 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02944e10-b900-4827-b1bf-b7318a173b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:39.794996 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-02944e10-b900-4827-b1bf-b7318a173b0f None None] MFA Rules not processed for user `3d71a1bd93b04249b2b8e6a054de44c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:39.796528 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-02944e10-b900-4827-b1bf-b7318a173b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:39.806551 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 636/1269] 10.222.0.30 () {58 vars in 1057 bytes} [Fri Oct 15 03:31:39 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:31:39.814683 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b19a8e-8fe1-4d6f-9ed0-b74b599dd1ee None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:31:39.833968 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b19a8e-8fe1-4d6f-9ed0-b74b599dd1ee None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:31:39.840429 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede89c0-07e0-4293-8676-d1edf9e38a12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:31:39.841071 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede89c0-07e0-4293-8676-d1edf9e38a12 service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:39.841686 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede89c0-07e0-4293-8676-d1edf9e38a12 service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:39.841686 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede89c0-07e0-4293-8676-d1edf9e38a12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:39.852177 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede89c0-07e0-4293-8676-d1edf9e38a12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:31:39.854637 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede89c0-07e0-4293-8676-d1edf9e38a12 service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:31:39.865295 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 634/1270] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:31:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:31:41.980352 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d4cb3-6017-4346-90c7-d75bb3056cd6 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:41.981349 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d4cb3-6017-4346-90c7-d75bb3056cd6 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:41.986804 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d4cb3-6017-4346-90c7-d75bb3056cd6 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:41.989737 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 637/1271] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:31:41 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:41.995546 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f436cf-550f-4e2c-844a-d6c43c39b067 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:41.996398 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f436cf-550f-4e2c-844a-d6c43c39b067 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:41.996863 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f436cf-550f-4e2c-844a-d6c43c39b067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:42.032793 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-82f436cf-550f-4e2c-844a-d6c43c39b067 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:42.034506 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-82f436cf-550f-4e2c-844a-d6c43c39b067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:42.050476 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 635/1272] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:31:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:31:42.110062 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5eb5ed-5c52-4e0f-8407-a59ad57d0443 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:42.110566 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5eb5ed-5c52-4e0f-8407-a59ad57d0443 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:42.110990 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5eb5ed-5c52-4e0f-8407-a59ad57d0443 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:42.113272 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 638/1273] 10.222.0.30 () {54 vars in 962 bytes} [Fri Oct 15 03:31:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:42.123485 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373416a0-abaf-45a6-82bc-e1dc86381990 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:42.124108 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373416a0-abaf-45a6-82bc-e1dc86381990 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:42.126954 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373416a0-abaf-45a6-82bc-e1dc86381990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:42.187542 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-373416a0-abaf-45a6-82bc-e1dc86381990 None None] MFA Rules not processed for user `4edffc4b89f74ce590a2dd7b8fc904bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:42.189295 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-373416a0-abaf-45a6-82bc-e1dc86381990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:42.215559 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff8f9d-3502-4c22-aee3-786251cd6789 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:42.215873 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff8f9d-3502-4c22-aee3-786251cd6789 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:42.216330 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff8f9d-3502-4c22-aee3-786251cd6789 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:42.218165 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 639/1274] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:31:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:31:42.224903 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6b29a-6644-4019-aa0d-98bb4fe8715b None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:42.225432 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6b29a-6644-4019-aa0d-98bb4fe8715b None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:42.225874 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6b29a-6644-4019-aa0d-98bb4fe8715b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:42.245337 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-2cd6b29a-6644-4019-aa0d-98bb4fe8715b None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:42.246957 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-2cd6b29a-6644-4019-aa0d-98bb4fe8715b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:42.257127 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 640/1275] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:31:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:31:42.292336 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 636/1276] 10.222.0.30 () {58 vars in 1059 bytes} [Fri Oct 15 03:31:42 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:31:42.301936 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6b29a-6644-4019-aa0d-98bb4fe8715b None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:31:42.309219 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373416a0-abaf-45a6-82bc-e1dc86381990 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:31:42.317748 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6b29a-6644-4019-aa0d-98bb4fe8715b None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:31:42.323294 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73517621-42ed-43f2-bac1-9bb2b8be0906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:31:42.324002 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73517621-42ed-43f2-bac1-9bb2b8be0906 service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:42.324846 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73517621-42ed-43f2-bac1-9bb2b8be0906 service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:42.325111 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73517621-42ed-43f2-bac1-9bb2b8be0906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:42.333765 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373416a0-abaf-45a6-82bc-e1dc86381990 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:31:42.341085 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa0626-e37a-48a8-a6ba-2ea28eb988e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:31:42.342254 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa0626-e37a-48a8-a6ba-2ea28eb988e6 service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:42.342678 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa0626-e37a-48a8-a6ba-2ea28eb988e6 service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:42.343035 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa0626-e37a-48a8-a6ba-2ea28eb988e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:42.343966 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73517621-42ed-43f2-bac1-9bb2b8be0906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:31:42.345821 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73517621-42ed-43f2-bac1-9bb2b8be0906 service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:31:42.352314 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa0626-e37a-48a8-a6ba-2ea28eb988e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:31:42.353903 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa0626-e37a-48a8-a6ba-2ea28eb988e6 service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:31:42.357151 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 641/1277] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:31:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:31:42.363806 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 637/1278] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:31:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:31:44.682388 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d12ad-39da-4340-91bf-dec622eea78b None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:44.682892 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d12ad-39da-4340-91bf-dec622eea78b None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:44.682892 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d12ad-39da-4340-91bf-dec622eea78b None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:44.684809 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 642/1279] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:31:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:44.690446 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca0d72-7aa6-4f50-9406-8905f05e7aec None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:44.691410 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca0d72-7aa6-4f50-9406-8905f05e7aec None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:44.691644 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca0d72-7aa6-4f50-9406-8905f05e7aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:44.708819 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-5eca0d72-7aa6-4f50-9406-8905f05e7aec None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:44.710008 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-5eca0d72-7aa6-4f50-9406-8905f05e7aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:44.717717 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 638/1280] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:31:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:31:44.763454 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d12ad-39da-4340-91bf-dec622eea78b None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:31:44.777475 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d12ad-39da-4340-91bf-dec622eea78b None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:31:44.782836 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdf1de-c45e-43ca-baf7-d2b9d740685f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:31:44.783493 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdf1de-c45e-43ca-baf7-d2b9d740685f service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:44.783840 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdf1de-c45e-43ca-baf7-d2b9d740685f service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:44.784120 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdf1de-c45e-43ca-baf7-d2b9d740685f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:44.791945 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdf1de-c45e-43ca-baf7-d2b9d740685f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:31:44.793523 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdf1de-c45e-43ca-baf7-d2b9d740685f service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:31:44.803095 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 643/1281] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:31:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:31:47.077390 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ff9b3-c8c9-4501-a2fb-883a4e9750e9 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:47.077924 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ff9b3-c8c9-4501-a2fb-883a4e9750e9 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:47.077924 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ff9b3-c8c9-4501-a2fb-883a4e9750e9 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:47.079728 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 639/1282] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:31:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:47.086196 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfcbc0-78d8-4e2f-b1a5-ffd3bcde5e35 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:47.086587 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfcbc0-78d8-4e2f-b1a5-ffd3bcde5e35 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:47.086769 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfcbc0-78d8-4e2f-b1a5-ffd3bcde5e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:47.105109 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-3fcfcbc0-78d8-4e2f-b1a5-ffd3bcde5e35 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:47.106297 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-3fcfcbc0-78d8-4e2f-b1a5-ffd3bcde5e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:47.114324 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 644/1283] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:31:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:31:47.160444 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ff9b3-c8c9-4501-a2fb-883a4e9750e9 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:31:47.174706 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ff9b3-c8c9-4501-a2fb-883a4e9750e9 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:31:47.180424 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749dc6c4-42e4-42f9-9e0b-c84a00cfd382 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:31:47.181265 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749dc6c4-42e4-42f9-9e0b-c84a00cfd382 service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:47.181732 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749dc6c4-42e4-42f9-9e0b-c84a00cfd382 service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:47.182205 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749dc6c4-42e4-42f9-9e0b-c84a00cfd382 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:47.190693 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749dc6c4-42e4-42f9-9e0b-c84a00cfd382 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:31:47.192533 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749dc6c4-42e4-42f9-9e0b-c84a00cfd382 service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:31:47.203749 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 640/1284] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:31:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:31:49.512102 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9d5f5-683a-43c1-a3a7-bad89676bb56 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:49.512669 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9d5f5-683a-43c1-a3a7-bad89676bb56 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:49.512669 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9d5f5-683a-43c1-a3a7-bad89676bb56 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:49.514448 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 645/1285] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:31:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:49.520415 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836077a-f06a-40f9-83bf-b8a98617d8fc None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:49.520880 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836077a-f06a-40f9-83bf-b8a98617d8fc None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:49.521036 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836077a-f06a-40f9-83bf-b8a98617d8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:49.538955 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-e836077a-f06a-40f9-83bf-b8a98617d8fc None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:49.540362 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e836077a-f06a-40f9-83bf-b8a98617d8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:49.548037 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 641/1286] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:31:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:31:49.605273 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9d5f5-683a-43c1-a3a7-bad89676bb56 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:31:49.625391 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9d5f5-683a-43c1-a3a7-bad89676bb56 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:31:49.632979 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19e0f4-c70f-4b4e-b607-b42cf6cb3e45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:31:49.633886 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19e0f4-c70f-4b4e-b607-b42cf6cb3e45 service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:49.634258 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19e0f4-c70f-4b4e-b607-b42cf6cb3e45 service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:49.634627 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19e0f4-c70f-4b4e-b607-b42cf6cb3e45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:49.643854 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19e0f4-c70f-4b4e-b607-b42cf6cb3e45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:31:49.645444 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19e0f4-c70f-4b4e-b607-b42cf6cb3e45 service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:31:49.654874 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 646/1287] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:31:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:31:51.928347 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da76715-d3e8-40ed-bcd0-6927ac389524 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:51.929113 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da76715-d3e8-40ed-bcd0-6927ac389524 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:51.929113 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da76715-d3e8-40ed-bcd0-6927ac389524 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:51.930631 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 642/1288] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:31:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:51.936833 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df814f-b18d-45f5-81be-73f0d4bedceb None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:51.937481 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df814f-b18d-45f5-81be-73f0d4bedceb None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:51.937481 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df814f-b18d-45f5-81be-73f0d4bedceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:51.955293 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-56df814f-b18d-45f5-81be-73f0d4bedceb None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:51.956561 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-56df814f-b18d-45f5-81be-73f0d4bedceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:51.964581 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 647/1289] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:31:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:31:52.011388 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da76715-d3e8-40ed-bcd0-6927ac389524 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:31:52.025760 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da76715-d3e8-40ed-bcd0-6927ac389524 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:31:52.031246 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe2cc7-d6a7-44b1-ab7e-ebcf0f4cccf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:31:52.031902 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe2cc7-d6a7-44b1-ab7e-ebcf0f4cccf2 service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:52.032189 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe2cc7-d6a7-44b1-ab7e-ebcf0f4cccf2 service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:52.032469 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe2cc7-d6a7-44b1-ab7e-ebcf0f4cccf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:52.041252 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe2cc7-d6a7-44b1-ab7e-ebcf0f4cccf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:31:52.042889 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe2cc7-d6a7-44b1-ab7e-ebcf0f4cccf2 service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:31:52.052845 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 643/1290] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:31:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:31:54.697086 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88395001-34ee-4b35-ac5e-d3de2608f26d None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:54.697628 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88395001-34ee-4b35-ac5e-d3de2608f26d None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:54.697720 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88395001-34ee-4b35-ac5e-d3de2608f26d None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:54.699953 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 648/1291] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:31:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:54.708186 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53183b-0c8c-464c-bbe6-b9a049a8809c None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:54.708616 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53183b-0c8c-464c-bbe6-b9a049a8809c None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:54.708872 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53183b-0c8c-464c-bbe6-b9a049a8809c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:54.729547 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-9c53183b-0c8c-464c-bbe6-b9a049a8809c None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:54.730782 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-9c53183b-0c8c-464c-bbe6-b9a049a8809c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:54.738920 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 644/1292] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:31:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:31:54.805157 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88395001-34ee-4b35-ac5e-d3de2608f26d None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:31:54.819800 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88395001-34ee-4b35-ac5e-d3de2608f26d None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:31:54.825569 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439f964-91c0-4acd-a1ed-807dbf00bd53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:31:54.826208 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439f964-91c0-4acd-a1ed-807dbf00bd53 service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:54.826494 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439f964-91c0-4acd-a1ed-807dbf00bd53 service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:54.826771 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439f964-91c0-4acd-a1ed-807dbf00bd53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:54.835795 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439f964-91c0-4acd-a1ed-807dbf00bd53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:31:54.837382 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439f964-91c0-4acd-a1ed-807dbf00bd53 service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:31:54.846998 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 649/1293] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:31:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:31:57.145586 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f648a44-9a5e-4fef-80ea-7a938d3f5b64 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:57.146149 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f648a44-9a5e-4fef-80ea-7a938d3f5b64 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:57.146149 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f648a44-9a5e-4fef-80ea-7a938d3f5b64 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:57.147936 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 645/1294] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:31:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:57.154013 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735cdf3-29a2-4f38-bd41-a852317b90c6 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:57.154434 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735cdf3-29a2-4f38-bd41-a852317b90c6 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:57.154596 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735cdf3-29a2-4f38-bd41-a852317b90c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:57.172207 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-5735cdf3-29a2-4f38-bd41-a852317b90c6 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:57.173385 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-5735cdf3-29a2-4f38-bd41-a852317b90c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:57.181962 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 650/1295] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:31:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:31:57.223425 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca81f75-bd60-48d5-aa7d-08c8be8b0227 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:57.223814 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca81f75-bd60-48d5-aa7d-08c8be8b0227 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:57.224099 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca81f75-bd60-48d5-aa7d-08c8be8b0227 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:57.225856 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 646/1296] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:31:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:57.228026 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735cdf3-29a2-4f38-bd41-a852317b90c6 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:31:57.232986 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0b085-9be0-41f9-8455-bcf53b397079 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:57.233266 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0b085-9be0-41f9-8455-bcf53b397079 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:57.233723 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0b085-9be0-41f9-8455-bcf53b397079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:57.242602 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735cdf3-29a2-4f38-bd41-a852317b90c6 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:31:57.248820 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6996e3-882f-4d9f-925f-2c42db15fc0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:31:57.249463 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6996e3-882f-4d9f-925f-2c42db15fc0b service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:57.249750 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6996e3-882f-4d9f-925f-2c42db15fc0b service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:57.250025 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6996e3-882f-4d9f-925f-2c42db15fc0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:57.251034 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-9af0b085-9be0-41f9-8455-bcf53b397079 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:57.252241 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-9af0b085-9be0-41f9-8455-bcf53b397079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:57.259137 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6996e3-882f-4d9f-925f-2c42db15fc0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:31:57.260383 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 647/1297] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:31:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:31:57.260787 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6996e3-882f-4d9f-925f-2c42db15fc0b service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:31:57.270545 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 651/1298] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:31:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:31:57.317516 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0ea86-6837-402c-8249-b34a609aa8fe None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:57.317906 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0ea86-6837-402c-8249-b34a609aa8fe None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:57.318186 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0ea86-6837-402c-8249-b34a609aa8fe None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:57.320017 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 648/1299] 10.222.0.30 () {54 vars in 962 bytes} [Fri Oct 15 03:31:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:31:57.326061 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00819f05-e6eb-4dcb-bfe0-b9762c9ed0fa None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:57.326337 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00819f05-e6eb-4dcb-bfe0-b9762c9ed0fa None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:57.326673 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00819f05-e6eb-4dcb-bfe0-b9762c9ed0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:57.381122 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-00819f05-e6eb-4dcb-bfe0-b9762c9ed0fa None None] MFA Rules not processed for user `456c83b8619847279927251ca48fca37`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:57.382349 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-00819f05-e6eb-4dcb-bfe0-b9762c9ed0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:57.445566 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 652/1300] 10.222.0.30 () {58 vars in 1059 bytes} [Fri Oct 15 03:31:57 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:31:57.453662 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0ea86-6837-402c-8249-b34a609aa8fe None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:31:57.464692 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0ea86-6837-402c-8249-b34a609aa8fe None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:31:57.468317 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d3d70-2870-466b-bc39-d029429000f9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456c83b8619847279927251ca48fca37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:31:57.469223 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d3d70-2870-466b-bc39-d029429000f9 service glance] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:57.469501 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d3d70-2870-466b-bc39-d029429000f9 service glance] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:57.469769 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d3d70-2870-466b-bc39-d029429000f9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:57.481304 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d3d70-2870-466b-bc39-d029429000f9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:31:57.482794 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d3d70-2870-466b-bc39-d029429000f9 service glance] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:31:57.494128 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 649/1301] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:31:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:31:57.933615 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7eca34-15b4-40b6-b725-412d0cf860b7 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:57.933927 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7eca34-15b4-40b6-b725-412d0cf860b7 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:57.934229 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7eca34-15b4-40b6-b725-412d0cf860b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:57.981504 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-ee7eca34-15b4-40b6-b725-412d0cf860b7 None None] MFA Rules not processed for user `3f598b94a850413494da575188706cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:57.982612 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-ee7eca34-15b4-40b6-b725-412d0cf860b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:58.043583 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 653/1302] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Oct 15 03:31:57 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:31:58.086210 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dd286-4be1-474f-981d-493c11c20989 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:58.086498 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dd286-4be1-474f-981d-493c11c20989 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:58.086778 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dd286-4be1-474f-981d-493c11c20989 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:58.088609 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 650/1303] 10.222.0.30 () {54 vars in 942 bytes} [Fri Oct 15 03:31:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:58.095313 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75910799-3cb6-474f-b4a2-989bbdb2650a None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:58.095608 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75910799-3cb6-474f-b4a2-989bbdb2650a None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:58.095934 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75910799-3cb6-474f-b4a2-989bbdb2650a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:58.143081 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-75910799-3cb6-474f-b4a2-989bbdb2650a None None] MFA Rules not processed for user `dfdf0fb38dd04c75a1c874913ea1bf98`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:58.144905 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-75910799-3cb6-474f-b4a2-989bbdb2650a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:58.213722 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 654/1304] 10.222.0.30 () {58 vars in 1039 bytes} [Fri Oct 15 03:31:58 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:31:58.223501 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67dd286-4be1-474f-981d-493c11c20989 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:31:58.237020 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67dd286-4be1-474f-981d-493c11c20989 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:31:58.242608 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbe639-d046-4988-8f75-e1d058c7f751 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfdf0fb38dd04c75a1c874913ea1bf98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:31:58.243517 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbe639-d046-4988-8f75-e1d058c7f751 service swift] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:58.243517 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbe639-d046-4988-8f75-e1d058c7f751 service swift] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:58.243809 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbe639-d046-4988-8f75-e1d058c7f751 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:58.251888 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbe639-d046-4988-8f75-e1d058c7f751 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:31:58.254103 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbe639-d046-4988-8f75-e1d058c7f751 service swift] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:31:58.261849 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 651/1305] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Oct 15 03:31:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 15 03:31:59.591824 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d058340-b9e7-4b1b-b602-72b24eb8dbae None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:59.592460 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d058340-b9e7-4b1b-b602-72b24eb8dbae None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:59.592460 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d058340-b9e7-4b1b-b602-72b24eb8dbae None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:59.594481 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 655/1306] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:31:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:31:59.600760 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787476a5-66be-4f61-b3b4-edaf9824f8b4 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:59.601208 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787476a5-66be-4f61-b3b4-edaf9824f8b4 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:59.601311 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787476a5-66be-4f61-b3b4-edaf9824f8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:59.619872 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-787476a5-66be-4f61-b3b4-edaf9824f8b4 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:31:59.621400 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-787476a5-66be-4f61-b3b4-edaf9824f8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:31:59.630086 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 652/1307] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:31:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:31:59.677327 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d058340-b9e7-4b1b-b602-72b24eb8dbae None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:31:59.691599 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d058340-b9e7-4b1b-b602-72b24eb8dbae None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:31:59.697013 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aead0b8-57b1-47ef-8b3e-4780b1795650 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:31:59.697663 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aead0b8-57b1-47ef-8b3e-4780b1795650 service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:31:59.697940 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aead0b8-57b1-47ef-8b3e-4780b1795650 service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:31:59.698209 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aead0b8-57b1-47ef-8b3e-4780b1795650 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:31:59.707317 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aead0b8-57b1-47ef-8b3e-4780b1795650 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:31:59.708933 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aead0b8-57b1-47ef-8b3e-4780b1795650 service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:31:59.719864 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 656/1308] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:31:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:32:02.031349 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb16d8-a88c-433f-a085-b72e5ce41efa None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:02.032325 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb16d8-a88c-433f-a085-b72e5ce41efa None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:02.032668 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb16d8-a88c-433f-a085-b72e5ce41efa None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:02.034603 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 653/1309] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:32:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:32:02.040609 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc53f40-873d-493b-bfad-0d515ed180f4 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:02.041070 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc53f40-873d-493b-bfad-0d515ed180f4 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:02.041183 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc53f40-873d-493b-bfad-0d515ed180f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:02.064228 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-3bc53f40-873d-493b-bfad-0d515ed180f4 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:32:02.066299 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-3bc53f40-873d-493b-bfad-0d515ed180f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:32:02.074800 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 657/1310] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:32:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:32:02.121021 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb16d8-a88c-433f-a085-b72e5ce41efa None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:02.138308 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb16d8-a88c-433f-a085-b72e5ce41efa None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:02.143834 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e72162-42a9-4b98-b1a0-548c13bf012c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:02.144461 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e72162-42a9-4b98-b1a0-548c13bf012c service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:02.144927 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e72162-42a9-4b98-b1a0-548c13bf012c service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:02.145203 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e72162-42a9-4b98-b1a0-548c13bf012c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:02.153384 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e72162-42a9-4b98-b1a0-548c13bf012c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:02.154952 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e72162-42a9-4b98-b1a0-548c13bf012c service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:02.164659 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 654/1311] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:32:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:32:15.798343 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7b0bf-5ec1-4ca8-b6ad-efe75c3c6fb6 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:15.798903 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7b0bf-5ec1-4ca8-b6ad-efe75c3c6fb6 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:15.798903 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7b0bf-5ec1-4ca8-b6ad-efe75c3c6fb6 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:15.800803 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 658/1312] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:32:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:32:15.806774 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caabe4d-9fa5-43d8-be07-86d8dcef33ca None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:15.807184 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caabe4d-9fa5-43d8-be07-86d8dcef33ca None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:15.807328 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caabe4d-9fa5-43d8-be07-86d8dcef33ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:15.824869 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-9caabe4d-9fa5-43d8-be07-86d8dcef33ca None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:32:15.826048 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-9caabe4d-9fa5-43d8-be07-86d8dcef33ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:32:15.834158 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 655/1313] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:32:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:32:15.858208 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7b0bf-5ec1-4ca8-b6ad-efe75c3c6fb6 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:15.870388 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7b0bf-5ec1-4ca8-b6ad-efe75c3c6fb6 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:15.874793 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e866a57-2b96-4477-a617-3c23f4caacd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:15.875416 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e866a57-2b96-4477-a617-3c23f4caacd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:15.875717 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e866a57-2b96-4477-a617-3c23f4caacd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:15.875994 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e866a57-2b96-4477-a617-3c23f4caacd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:15.876724 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e866a57-2b96-4477-a617-3c23f4caacd7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:15.879054 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e866a57-2b96-4477-a617-3c23f4caacd7 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:15.892467 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 659/1314] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Oct 15 03:32:15 2021] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:32:18.071180 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d22ad-b35d-4596-9469-2fd48d64d619 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:18.071728 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d22ad-b35d-4596-9469-2fd48d64d619 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:18.071728 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d22ad-b35d-4596-9469-2fd48d64d619 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:18.073655 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 656/1315] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:32:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:32:18.079350 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80594cc8-b424-49be-bfe2-2c588832909b None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:18.079793 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80594cc8-b424-49be-bfe2-2c588832909b None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:18.079952 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80594cc8-b424-49be-bfe2-2c588832909b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:18.098055 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-80594cc8-b424-49be-bfe2-2c588832909b None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:32:18.099233 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-80594cc8-b424-49be-bfe2-2c588832909b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:32:18.106927 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 660/1316] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:32:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:32:18.130879 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d22ad-b35d-4596-9469-2fd48d64d619 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:18.142654 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d22ad-b35d-4596-9469-2fd48d64d619 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:18.147540 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea14aa-5b74-4037-9c9d-3120f8c6d498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:18.148456 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea14aa-5b74-4037-9c9d-3120f8c6d498 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:18.148736 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea14aa-5b74-4037-9c9d-3120f8c6d498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:18.149007 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea14aa-5b74-4037-9c9d-3120f8c6d498 admin admin] PATH_INFO: `/v3/projects/098453151f33456db2f118ed4fac105c` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:18.159207 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea14aa-5b74-4037-9c9d-3120f8c6d498 admin admin] RBAC: Authorizing `identity:get_project(project_id=098453151f33456db2f118ed4fac105c)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:18.161274 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea14aa-5b74-4037-9c9d-3120f8c6d498 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:18.162932 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 657/1317] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:32:18 2021] GET /identity/v3/projects/098453151f33456db2f118ed4fac105c => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:32:18.169507 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80594cc8-b424-49be-bfe2-2c588832909b None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:18.178438 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80594cc8-b424-49be-bfe2-2c588832909b None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:18.182969 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f16ed9-5664-49a8-b4a0-8496f3d20094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:18.183594 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f16ed9-5664-49a8-b4a0-8496f3d20094 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:18.183916 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f16ed9-5664-49a8-b4a0-8496f3d20094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:18.184191 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f16ed9-5664-49a8-b4a0-8496f3d20094 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:18.184963 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f16ed9-5664-49a8-b4a0-8496f3d20094 admin admin] RBAC: Adding query filter params (scope.project.id=098453151f33456db2f118ed4fac105c) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:32:18.185274 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f16ed9-5664-49a8-b4a0-8496f3d20094 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:18.187130 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f16ed9-5664-49a8-b4a0-8496f3d20094 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:18.195321 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 661/1318] 10.222.0.30 () {56 vars in 1231 bytes} [Fri Oct 15 03:32:18 2021] GET /identity/v3/role_assignments?scope.project.id=098453151f33456db2f118ed4fac105c => generated 1934 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:32:18.201282 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea14aa-5b74-4037-9c9d-3120f8c6d498 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:18.211402 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea14aa-5b74-4037-9c9d-3120f8c6d498 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:18.215954 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572ac0c-1aa0-4752-a2e2-28b2c3d1f9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:18.216788 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572ac0c-1aa0-4752-a2e2-28b2c3d1f9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:18.217098 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572ac0c-1aa0-4752-a2e2-28b2c3d1f9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:18.217371 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572ac0c-1aa0-4752-a2e2-28b2c3d1f9e9 admin admin] PATH_INFO: `/v3/users/54e89668dd2f4bda9877cf539179b3ec` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:18.218556 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572ac0c-1aa0-4752-a2e2-28b2c3d1f9e9 admin admin] RBAC: Authorizing `identity:get_user(user_id=54e89668dd2f4bda9877cf539179b3ec)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:18.220642 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572ac0c-1aa0-4752-a2e2-28b2c3d1f9e9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:18.222211 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 658/1319] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:32:18 2021] GET /identity/v3/users/54e89668dd2f4bda9877cf539179b3ec => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:32:18.228209 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f16ed9-5664-49a8-b4a0-8496f3d20094 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:18.237684 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f16ed9-5664-49a8-b4a0-8496f3d20094 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:18.242173 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc899a85-0251-4dd9-a006-00f018274873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:18.243482 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc899a85-0251-4dd9-a006-00f018274873 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:18.243482 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc899a85-0251-4dd9-a006-00f018274873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:18.243717 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc899a85-0251-4dd9-a006-00f018274873 admin admin] PATH_INFO: `/v3/users/0189ce49a9fd434894ac7b5f5b829fa6` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:18.257158 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc899a85-0251-4dd9-a006-00f018274873 admin admin] RBAC: Authorizing `identity:get_user(user_id=0189ce49a9fd434894ac7b5f5b829fa6)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:18.259279 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc899a85-0251-4dd9-a006-00f018274873 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:18.260926 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 662/1320] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:32:18 2021] GET /identity/v3/users/0189ce49a9fd434894ac7b5f5b829fa6 => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:32:20.576397 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097627b0-bb39-4564-b87b-28cded08ee8e None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:20.576948 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097627b0-bb39-4564-b87b-28cded08ee8e None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:20.576948 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097627b0-bb39-4564-b87b-28cded08ee8e None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:20.578639 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 659/1321] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:32:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:32:20.584680 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bec34c-8371-40e7-96fd-958225a671ec None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:20.585106 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bec34c-8371-40e7-96fd-958225a671ec None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:20.585240 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bec34c-8371-40e7-96fd-958225a671ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:20.603597 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-68bec34c-8371-40e7-96fd-958225a671ec None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:32:20.604808 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-68bec34c-8371-40e7-96fd-958225a671ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:32:20.613173 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 663/1322] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:32:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:32:20.638947 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097627b0-bb39-4564-b87b-28cded08ee8e None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:20.651523 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097627b0-bb39-4564-b87b-28cded08ee8e None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:20.655962 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd19ae1-3697-4be1-b361-801e98aa6497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:20.656786 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd19ae1-3697-4be1-b361-801e98aa6497 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:20.657066 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd19ae1-3697-4be1-b361-801e98aa6497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:20.657338 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd19ae1-3697-4be1-b361-801e98aa6497 admin admin] PATH_INFO: `/v3/projects/38d38c962f4f466f9c11db2457ea0b1e` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:20.659212 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd19ae1-3697-4be1-b361-801e98aa6497 admin admin] RBAC: Authorizing `identity:get_project(project_id=38d38c962f4f466f9c11db2457ea0b1e)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:20.661034 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd19ae1-3697-4be1-b361-801e98aa6497 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:20.662655 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 660/1323] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:32:20 2021] GET /identity/v3/projects/38d38c962f4f466f9c11db2457ea0b1e => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:32:20.669152 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bec34c-8371-40e7-96fd-958225a671ec None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:20.677951 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bec34c-8371-40e7-96fd-958225a671ec None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:20.682382 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2589355-0514-49d0-8412-38f1524a2303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:20.683012 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2589355-0514-49d0-8412-38f1524a2303 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:20.683276 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2589355-0514-49d0-8412-38f1524a2303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:20.683548 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2589355-0514-49d0-8412-38f1524a2303 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:20.684354 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2589355-0514-49d0-8412-38f1524a2303 admin admin] RBAC: Adding query filter params (scope.project.id=38d38c962f4f466f9c11db2457ea0b1e) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:32:20.684658 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2589355-0514-49d0-8412-38f1524a2303 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:20.686489 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2589355-0514-49d0-8412-38f1524a2303 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:20.691899 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 664/1324] 10.222.0.30 () {56 vars in 1231 bytes} [Fri Oct 15 03:32:20 2021] GET /identity/v3/role_assignments?scope.project.id=38d38c962f4f466f9c11db2457ea0b1e => generated 879 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:32:20.697799 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd19ae1-3697-4be1-b361-801e98aa6497 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:20.707633 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd19ae1-3697-4be1-b361-801e98aa6497 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:20.713102 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc3654-e329-43a5-85bb-1cda897e3c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:20.713926 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc3654-e329-43a5-85bb-1cda897e3c80 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:20.714202 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc3654-e329-43a5-85bb-1cda897e3c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:20.714473 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc3654-e329-43a5-85bb-1cda897e3c80 admin admin] PATH_INFO: `/v3/users/54e89668dd2f4bda9877cf539179b3ec` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:20.715644 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc3654-e329-43a5-85bb-1cda897e3c80 admin admin] RBAC: Authorizing `identity:get_user(user_id=54e89668dd2f4bda9877cf539179b3ec)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:20.717434 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc3654-e329-43a5-85bb-1cda897e3c80 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:20.719280 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 661/1325] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:32:20 2021] GET /identity/v3/users/54e89668dd2f4bda9877cf539179b3ec => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:32:22.968423 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be557e0-bc5a-40e3-9efe-a35e20340f00 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:22.969235 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be557e0-bc5a-40e3-9efe-a35e20340f00 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:22.969354 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be557e0-bc5a-40e3-9efe-a35e20340f00 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:22.971045 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 665/1326] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:32:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:32:22.976972 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d4c73-a6dc-4b5e-8806-5c21c22d28f5 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:22.977366 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d4c73-a6dc-4b5e-8806-5c21c22d28f5 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:22.977521 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d4c73-a6dc-4b5e-8806-5c21c22d28f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:22.995179 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-932d4c73-a6dc-4b5e-8806-5c21c22d28f5 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:32:22.996391 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-932d4c73-a6dc-4b5e-8806-5c21c22d28f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:32:23.004618 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 662/1327] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:32:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:32:23.028182 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be557e0-bc5a-40e3-9efe-a35e20340f00 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:23.040493 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be557e0-bc5a-40e3-9efe-a35e20340f00 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:23.044873 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14618649-7901-4c09-b2e3-8050cd8d80e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:23.045714 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14618649-7901-4c09-b2e3-8050cd8d80e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:23.045995 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14618649-7901-4c09-b2e3-8050cd8d80e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:23.046266 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14618649-7901-4c09-b2e3-8050cd8d80e5 admin admin] PATH_INFO: `/v3/projects/5c8d02ef9d024b498892abc56eb06cec` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:23.057283 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14618649-7901-4c09-b2e3-8050cd8d80e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=5c8d02ef9d024b498892abc56eb06cec)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:23.059337 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14618649-7901-4c09-b2e3-8050cd8d80e5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:23.061042 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 666/1328] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:32:23 2021] GET /identity/v3/projects/5c8d02ef9d024b498892abc56eb06cec => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:32:23.068155 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d4c73-a6dc-4b5e-8806-5c21c22d28f5 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:23.076971 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d4c73-a6dc-4b5e-8806-5c21c22d28f5 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:23.081617 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27e42b-c6cf-488e-b9ae-1dab62835da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:23.082240 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27e42b-c6cf-488e-b9ae-1dab62835da8 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:23.082521 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27e42b-c6cf-488e-b9ae-1dab62835da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:23.082793 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27e42b-c6cf-488e-b9ae-1dab62835da8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:23.083552 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27e42b-c6cf-488e-b9ae-1dab62835da8 admin admin] RBAC: Adding query filter params (scope.project.id=5c8d02ef9d024b498892abc56eb06cec) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:32:23.083883 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27e42b-c6cf-488e-b9ae-1dab62835da8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:23.085714 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27e42b-c6cf-488e-b9ae-1dab62835da8 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:23.092290 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 663/1329] 10.222.0.30 () {56 vars in 1231 bytes} [Fri Oct 15 03:32:23 2021] GET /identity/v3/role_assignments?scope.project.id=5c8d02ef9d024b498892abc56eb06cec => generated 877 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:32:23.098682 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14618649-7901-4c09-b2e3-8050cd8d80e5 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:23.108061 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14618649-7901-4c09-b2e3-8050cd8d80e5 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:23.113162 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f3fda-c6fc-44fa-979d-70576f6315ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:23.113989 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f3fda-c6fc-44fa-979d-70576f6315ed admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:23.114271 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f3fda-c6fc-44fa-979d-70576f6315ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:23.114544 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f3fda-c6fc-44fa-979d-70576f6315ed admin admin] PATH_INFO: `/v3/users/84eaf49bfb284d669bf6fb22cef9be39` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:23.131984 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f3fda-c6fc-44fa-979d-70576f6315ed admin admin] RBAC: Authorizing `identity:get_user(user_id=84eaf49bfb284d669bf6fb22cef9be39)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:23.134149 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f3fda-c6fc-44fa-979d-70576f6315ed admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:23.135933 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 667/1330] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:32:23 2021] GET /identity/v3/users/84eaf49bfb284d669bf6fb22cef9be39 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:32:23.142042 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27e42b-c6cf-488e-b9ae-1dab62835da8 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:23.151450 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27e42b-c6cf-488e-b9ae-1dab62835da8 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:23.156200 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9aa3be-4ff3-47cb-a5fb-110eeef19071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:23.157046 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9aa3be-4ff3-47cb-a5fb-110eeef19071 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:23.157331 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9aa3be-4ff3-47cb-a5fb-110eeef19071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:23.157607 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9aa3be-4ff3-47cb-a5fb-110eeef19071 admin admin] PATH_INFO: `/v3/users/0158485ebd394f2fa640bde26ae9d5af` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:23.170755 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9aa3be-4ff3-47cb-a5fb-110eeef19071 admin admin] RBAC: Authorizing `identity:get_user(user_id=0158485ebd394f2fa640bde26ae9d5af)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:23.172925 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9aa3be-4ff3-47cb-a5fb-110eeef19071 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:23.175035 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 664/1331] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:32:23 2021] GET /identity/v3/users/0158485ebd394f2fa640bde26ae9d5af => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:32:25.480145 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace548c1-c542-4c8e-906c-1fcda277dd03 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:25.480699 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace548c1-c542-4c8e-906c-1fcda277dd03 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:25.480699 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace548c1-c542-4c8e-906c-1fcda277dd03 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:25.482487 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 668/1332] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:32:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:32:25.488391 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00c412-22ad-46c8-ad37-41d633ac40a5 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:25.489007 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00c412-22ad-46c8-ad37-41d633ac40a5 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:25.489007 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00c412-22ad-46c8-ad37-41d633ac40a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:25.509261 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-8c00c412-22ad-46c8-ad37-41d633ac40a5 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:32:25.510386 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-8c00c412-22ad-46c8-ad37-41d633ac40a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:32:25.521153 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 665/1333] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:32:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:32:25.548011 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace548c1-c542-4c8e-906c-1fcda277dd03 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:25.561877 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace548c1-c542-4c8e-906c-1fcda277dd03 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:25.567344 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51093d26-b98b-46d7-bc54-85f4714639dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:25.568200 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51093d26-b98b-46d7-bc54-85f4714639dd admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:25.568478 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51093d26-b98b-46d7-bc54-85f4714639dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:25.568766 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51093d26-b98b-46d7-bc54-85f4714639dd admin admin] PATH_INFO: `/v3/projects/8920535d049b4db8ad55269dd481924a` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:25.579039 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51093d26-b98b-46d7-bc54-85f4714639dd admin admin] RBAC: Authorizing `identity:get_project(project_id=8920535d049b4db8ad55269dd481924a)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:25.581744 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51093d26-b98b-46d7-bc54-85f4714639dd admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:25.583438 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 669/1334] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:32:25 2021] GET /identity/v3/projects/8920535d049b4db8ad55269dd481924a => generated 312 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:32:25.590156 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00c412-22ad-46c8-ad37-41d633ac40a5 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:25.599490 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00c412-22ad-46c8-ad37-41d633ac40a5 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:25.605649 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8d540-e1fe-4839-8fcb-b3dae34e6566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:25.606656 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8d540-e1fe-4839-8fcb-b3dae34e6566 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:25.606941 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8d540-e1fe-4839-8fcb-b3dae34e6566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:25.607346 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8d540-e1fe-4839-8fcb-b3dae34e6566 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:25.608859 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8d540-e1fe-4839-8fcb-b3dae34e6566 admin admin] RBAC: Adding query filter params (scope.project.id=8920535d049b4db8ad55269dd481924a) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:32:25.609421 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8d540-e1fe-4839-8fcb-b3dae34e6566 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:25.613074 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8d540-e1fe-4839-8fcb-b3dae34e6566 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:25.620655 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 666/1335] 10.222.0.30 () {56 vars in 1231 bytes} [Fri Oct 15 03:32:25 2021] GET /identity/v3/role_assignments?scope.project.id=8920535d049b4db8ad55269dd481924a => generated 526 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:32:25.628092 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51093d26-b98b-46d7-bc54-85f4714639dd admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:25.640648 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51093d26-b98b-46d7-bc54-85f4714639dd admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:25.647362 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11224c08-f96b-4ba5-875f-10559312e3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:25.648236 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11224c08-f96b-4ba5-875f-10559312e3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:25.648519 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11224c08-f96b-4ba5-875f-10559312e3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:25.648788 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11224c08-f96b-4ba5-875f-10559312e3a1 admin admin] PATH_INFO: `/v3/users/0189ce49a9fd434894ac7b5f5b829fa6` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:25.650069 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11224c08-f96b-4ba5-875f-10559312e3a1 admin admin] RBAC: Authorizing `identity:get_user(user_id=0189ce49a9fd434894ac7b5f5b829fa6)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:25.652922 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11224c08-f96b-4ba5-875f-10559312e3a1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:25.654507 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 670/1336] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:32:25 2021] GET /identity/v3/users/0189ce49a9fd434894ac7b5f5b829fa6 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:32:27.934132 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911153fb-c509-4e26-bc1a-c91299e73fee None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:27.934640 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911153fb-c509-4e26-bc1a-c91299e73fee None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:27.934733 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911153fb-c509-4e26-bc1a-c91299e73fee None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:27.936490 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 667/1337] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:32:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:32:27.942323 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2d19e-54ee-45c4-a9cc-31f8b2ab3c76 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:27.942725 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2d19e-54ee-45c4-a9cc-31f8b2ab3c76 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:27.942877 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2d19e-54ee-45c4-a9cc-31f8b2ab3c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:27.960253 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-edd2d19e-54ee-45c4-a9cc-31f8b2ab3c76 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:32:27.961438 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-edd2d19e-54ee-45c4-a9cc-31f8b2ab3c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:32:27.969339 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 671/1338] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:32:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:32:27.994172 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911153fb-c509-4e26-bc1a-c91299e73fee None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:28.006232 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911153fb-c509-4e26-bc1a-c91299e73fee None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:28.010620 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032046e-337d-4c57-8f12-a86df211d2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:28.011474 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032046e-337d-4c57-8f12-a86df211d2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:28.011789 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032046e-337d-4c57-8f12-a86df211d2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:28.012069 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032046e-337d-4c57-8f12-a86df211d2b5 admin admin] PATH_INFO: `/v3/projects/984f06ad9e80456fb94208662a6d8477` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:28.022522 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032046e-337d-4c57-8f12-a86df211d2b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=984f06ad9e80456fb94208662a6d8477)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:28.024601 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032046e-337d-4c57-8f12-a86df211d2b5 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:28.026516 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 668/1339] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:32:27 2021] GET /identity/v3/projects/984f06ad9e80456fb94208662a6d8477 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:32:28.032786 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2d19e-54ee-45c4-a9cc-31f8b2ab3c76 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:28.042214 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2d19e-54ee-45c4-a9cc-31f8b2ab3c76 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:28.046740 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f32677-3e3f-494a-acc4-fc5680b2279e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:28.047366 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f32677-3e3f-494a-acc4-fc5680b2279e admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:28.047648 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f32677-3e3f-494a-acc4-fc5680b2279e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:28.047955 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f32677-3e3f-494a-acc4-fc5680b2279e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:28.048730 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f32677-3e3f-494a-acc4-fc5680b2279e admin admin] RBAC: Adding query filter params (scope.project.id=984f06ad9e80456fb94208662a6d8477) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:32:28.049647 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f32677-3e3f-494a-acc4-fc5680b2279e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:28.051478 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f32677-3e3f-494a-acc4-fc5680b2279e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:28.057909 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 672/1340] 10.222.0.30 () {56 vars in 1231 bytes} [Fri Oct 15 03:32:28 2021] GET /identity/v3/role_assignments?scope.project.id=984f06ad9e80456fb94208662a6d8477 => generated 1934 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:32:28.063895 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032046e-337d-4c57-8f12-a86df211d2b5 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:28.073420 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032046e-337d-4c57-8f12-a86df211d2b5 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:28.077850 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97c044-952d-4b54-9cac-cb5ff6283407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:28.078660 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97c044-952d-4b54-9cac-cb5ff6283407 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:28.078942 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97c044-952d-4b54-9cac-cb5ff6283407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:28.079214 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97c044-952d-4b54-9cac-cb5ff6283407 admin admin] PATH_INFO: `/v3/users/18c8349d65bc47af85c514f69b5678ad` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:28.092023 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97c044-952d-4b54-9cac-cb5ff6283407 admin admin] RBAC: Authorizing `identity:get_user(user_id=18c8349d65bc47af85c514f69b5678ad)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:28.094388 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97c044-952d-4b54-9cac-cb5ff6283407 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:28.096506 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 669/1341] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:32:28 2021] GET /identity/v3/users/18c8349d65bc47af85c514f69b5678ad => generated 283 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:32:28.102846 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f32677-3e3f-494a-acc4-fc5680b2279e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:28.112946 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f32677-3e3f-494a-acc4-fc5680b2279e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:28.117565 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605aaee-53e9-48a6-adfb-856ff31c47fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:28.118333 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605aaee-53e9-48a6-adfb-856ff31c47fc admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:28.118617 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605aaee-53e9-48a6-adfb-856ff31c47fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:28.118894 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605aaee-53e9-48a6-adfb-856ff31c47fc admin admin] PATH_INFO: `/v3/users/54e89668dd2f4bda9877cf539179b3ec` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:28.120127 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605aaee-53e9-48a6-adfb-856ff31c47fc admin admin] RBAC: Authorizing `identity:get_user(user_id=54e89668dd2f4bda9877cf539179b3ec)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:28.121902 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605aaee-53e9-48a6-adfb-856ff31c47fc admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:28.123466 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 673/1342] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:32:28 2021] GET /identity/v3/users/54e89668dd2f4bda9877cf539179b3ec => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:32:30.419017 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31471bd-0057-4a02-ba9c-1830c8d66627 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:30.419661 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31471bd-0057-4a02-ba9c-1830c8d66627 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:30.419661 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31471bd-0057-4a02-ba9c-1830c8d66627 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:30.421497 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 670/1343] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:32:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:32:30.428199 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319b9c4-a0a6-4aaf-8892-6093c6c1e546 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:30.428674 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319b9c4-a0a6-4aaf-8892-6093c6c1e546 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:30.428818 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319b9c4-a0a6-4aaf-8892-6093c6c1e546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:30.447155 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-b319b9c4-a0a6-4aaf-8892-6093c6c1e546 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:32:30.448378 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-b319b9c4-a0a6-4aaf-8892-6093c6c1e546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:32:30.456138 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 674/1344] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:32:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:32:30.479598 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31471bd-0057-4a02-ba9c-1830c8d66627 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:30.492035 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31471bd-0057-4a02-ba9c-1830c8d66627 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:30.496666 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f3d7b-2dc0-43ce-abea-99a2b7b558c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:30.497421 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f3d7b-2dc0-43ce-abea-99a2b7b558c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:30.497697 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f3d7b-2dc0-43ce-abea-99a2b7b558c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:30.497968 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f3d7b-2dc0-43ce-abea-99a2b7b558c8 admin admin] PATH_INFO: `/v3/projects/a2ff851e44fe4891a95c7ce521f7d93f` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:30.508913 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f3d7b-2dc0-43ce-abea-99a2b7b558c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=a2ff851e44fe4891a95c7ce521f7d93f)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:30.511022 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f3d7b-2dc0-43ce-abea-99a2b7b558c8 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:30.512706 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 671/1345] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:32:30 2021] GET /identity/v3/projects/a2ff851e44fe4891a95c7ce521f7d93f => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:32:30.519141 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319b9c4-a0a6-4aaf-8892-6093c6c1e546 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:30.528039 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319b9c4-a0a6-4aaf-8892-6093c6c1e546 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:30.532533 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5a615-a118-43b4-87db-a49affa267c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:30.533160 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5a615-a118-43b4-87db-a49affa267c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:30.533437 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5a615-a118-43b4-87db-a49affa267c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:30.533708 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5a615-a118-43b4-87db-a49affa267c6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:30.534478 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5a615-a118-43b4-87db-a49affa267c6 admin admin] RBAC: Adding query filter params (scope.project.id=a2ff851e44fe4891a95c7ce521f7d93f) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:32:30.534779 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5a615-a118-43b4-87db-a49affa267c6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:30.536648 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5a615-a118-43b4-87db-a49affa267c6 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:30.541817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 675/1346] 10.222.0.30 () {56 vars in 1231 bytes} [Fri Oct 15 03:32:30 2021] GET /identity/v3/role_assignments?scope.project.id=a2ff851e44fe4891a95c7ce521f7d93f => generated 526 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:32:30.547776 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f3d7b-2dc0-43ce-abea-99a2b7b558c8 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:30.557580 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f3d7b-2dc0-43ce-abea-99a2b7b558c8 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:30.562020 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a17d2-a56b-4e17-b185-023bd0d57ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:30.562837 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a17d2-a56b-4e17-b185-023bd0d57ace admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:30.563112 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a17d2-a56b-4e17-b185-023bd0d57ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:30.563384 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a17d2-a56b-4e17-b185-023bd0d57ace admin admin] PATH_INFO: `/v3/users/0efe0817a0be48968b60b411fe16c694` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:30.576803 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a17d2-a56b-4e17-b185-023bd0d57ace admin admin] RBAC: Authorizing `identity:get_user(user_id=0efe0817a0be48968b60b411fe16c694)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:30.578896 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a17d2-a56b-4e17-b185-023bd0d57ace admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:30.580568 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 672/1347] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:32:30 2021] GET /identity/v3/users/0efe0817a0be48968b60b411fe16c694 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:32:32.827423 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ec6b2-d4e8-4ee6-bc25-02917f2190fa None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:32.828027 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ec6b2-d4e8-4ee6-bc25-02917f2190fa None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:32.828027 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ec6b2-d4e8-4ee6-bc25-02917f2190fa None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:32.829801 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 676/1348] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:32:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:32:32.836338 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d7abd-9c52-45ff-ad67-b40f6bd37528 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:32.836758 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d7abd-9c52-45ff-ad67-b40f6bd37528 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:32.836899 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d7abd-9c52-45ff-ad67-b40f6bd37528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:32.854966 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-2a3d7abd-9c52-45ff-ad67-b40f6bd37528 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:32:32.856180 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-2a3d7abd-9c52-45ff-ad67-b40f6bd37528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:32:32.863738 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 673/1349] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:32:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:32:32.887088 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ec6b2-d4e8-4ee6-bc25-02917f2190fa None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:32.899612 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ec6b2-d4e8-4ee6-bc25-02917f2190fa None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:32.904064 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53a132-73d5-42f6-8d43-3b9f22bfb679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:32.904881 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53a132-73d5-42f6-8d43-3b9f22bfb679 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:32.905161 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53a132-73d5-42f6-8d43-3b9f22bfb679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:32.905434 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53a132-73d5-42f6-8d43-3b9f22bfb679 admin admin] PATH_INFO: `/v3/projects/b0f0d452c0494e54aeddcd4eadc3d776` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:32.916281 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53a132-73d5-42f6-8d43-3b9f22bfb679 admin admin] RBAC: Authorizing `identity:get_project(project_id=b0f0d452c0494e54aeddcd4eadc3d776)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:32.918325 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53a132-73d5-42f6-8d43-3b9f22bfb679 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:32.920023 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 677/1350] 10.222.0.30 () {56 vars in 1207 bytes} [Fri Oct 15 03:32:32 2021] GET /identity/v3/projects/b0f0d452c0494e54aeddcd4eadc3d776 => generated 361 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:32:32.926489 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d7abd-9c52-45ff-ad67-b40f6bd37528 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:32.935275 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d7abd-9c52-45ff-ad67-b40f6bd37528 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:32.939910 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ff78b-0bfe-4f36-9589-aee4b9de8cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:32.940535 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ff78b-0bfe-4f36-9589-aee4b9de8cfb admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:32.940812 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ff78b-0bfe-4f36-9589-aee4b9de8cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:32.941080 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ff78b-0bfe-4f36-9589-aee4b9de8cfb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:32.941838 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ff78b-0bfe-4f36-9589-aee4b9de8cfb admin admin] RBAC: Adding query filter params (scope.project.id=b0f0d452c0494e54aeddcd4eadc3d776) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:32:32.942136 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ff78b-0bfe-4f36-9589-aee4b9de8cfb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:32.943987 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ff78b-0bfe-4f36-9589-aee4b9de8cfb admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:32.949280 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 674/1351] 10.222.0.30 () {56 vars in 1231 bytes} [Fri Oct 15 03:32:32 2021] GET /identity/v3/role_assignments?scope.project.id=b0f0d452c0494e54aeddcd4eadc3d776 => generated 526 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:32:32.955534 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53a132-73d5-42f6-8d43-3b9f22bfb679 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:32.964945 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53a132-73d5-42f6-8d43-3b9f22bfb679 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:32.969673 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22aa75d-091f-4d39-88db-b829e4e890b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:32.970483 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22aa75d-091f-4d39-88db-b829e4e890b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:32.971355 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22aa75d-091f-4d39-88db-b829e4e890b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:32.971624 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22aa75d-091f-4d39-88db-b829e4e890b0 admin admin] PATH_INFO: `/v3/users/7e0b2cfe7dfc4d028c2c4e2c6fe25f99` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:32.984517 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22aa75d-091f-4d39-88db-b829e4e890b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=7e0b2cfe7dfc4d028c2c4e2c6fe25f99)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:32.986618 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22aa75d-091f-4d39-88db-b829e4e890b0 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:32.988216 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 678/1352] 10.222.0.30 () {56 vars in 1198 bytes} [Fri Oct 15 03:32:32 2021] GET /identity/v3/users/7e0b2cfe7dfc4d028c2c4e2c6fe25f99 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:32:38.114130 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515e473-e9bd-4a3e-a6c0-67790b0e3ce0 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:38.114693 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515e473-e9bd-4a3e-a6c0-67790b0e3ce0 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:38.114693 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515e473-e9bd-4a3e-a6c0-67790b0e3ce0 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:38.116468 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 675/1353] 10.222.0.30 () {54 vars in 918 bytes} [Fri Oct 15 03:32:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:32:38.122338 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f1faf-a4fa-45ac-9e8e-886f89c961f8 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:38.122734 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f1faf-a4fa-45ac-9e8e-886f89c961f8 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:38.122891 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f1faf-a4fa-45ac-9e8e-886f89c961f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:38.140525 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-767f1faf-a4fa-45ac-9e8e-886f89c961f8 None None] MFA Rules not processed for user `bffc0480ffb942cdad426195eca0529e`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:32:38.141640 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-767f1faf-a4fa-45ac-9e8e-886f89c961f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:32:38.150492 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 679/1354] 10.222.0.30 () {58 vars in 1015 bytes} [Fri Oct 15 03:32:38 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:32:38.165900 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fc1ac-1414-4880-bc5c-5c355fffd1b7 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:38.166183 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fc1ac-1414-4880-bc5c-5c355fffd1b7 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:38.166455 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fc1ac-1414-4880-bc5c-5c355fffd1b7 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:38.168268 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 676/1355] 10.222.0.30 () {54 vars in 918 bytes} [Fri Oct 15 03:32:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:32:38.173233 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43727e6-6139-4ff2-941b-f8ba9d510e95 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:38.173514 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43727e6-6139-4ff2-941b-f8ba9d510e95 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:38.173786 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43727e6-6139-4ff2-941b-f8ba9d510e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:38.190742 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-d43727e6-6139-4ff2-941b-f8ba9d510e95 None None] MFA Rules not processed for user `3d71a1bd93b04249b2b8e6a054de44c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:32:38.191923 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-d43727e6-6139-4ff2-941b-f8ba9d510e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:32:38.200604 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 680/1356] 10.222.0.30 () {58 vars in 1015 bytes} [Fri Oct 15 03:32:38 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:32:41.059705 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96445b4-6ab8-40ab-b8d0-f37dd0576b51 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:41.060269 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96445b4-6ab8-40ab-b8d0-f37dd0576b51 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:41.060269 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96445b4-6ab8-40ab-b8d0-f37dd0576b51 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:41.062043 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 677/1357] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:32:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:32:41.068033 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da1430-548b-4d4a-aefd-c5c5a2fd9c53 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:41.068416 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da1430-548b-4d4a-aefd-c5c5a2fd9c53 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:41.068593 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da1430-548b-4d4a-aefd-c5c5a2fd9c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:41.086310 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-c1da1430-548b-4d4a-aefd-c5c5a2fd9c53 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:32:41.087487 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-c1da1430-548b-4d4a-aefd-c5c5a2fd9c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:32:41.095506 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 681/1358] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:32:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:32:41.138234 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96445b4-6ab8-40ab-b8d0-f37dd0576b51 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:41.152189 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96445b4-6ab8-40ab-b8d0-f37dd0576b51 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:41.157426 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd9081-5b86-4b1d-a5ba-f0f20a00ddf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:41.158040 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd9081-5b86-4b1d-a5ba-f0f20a00ddf5 service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:41.158318 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd9081-5b86-4b1d-a5ba-f0f20a00ddf5 service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:41.159197 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd9081-5b86-4b1d-a5ba-f0f20a00ddf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:41.166893 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd9081-5b86-4b1d-a5ba-f0f20a00ddf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:41.168476 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd9081-5b86-4b1d-a5ba-f0f20a00ddf5 service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:41.177346 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 678/1359] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:32:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:32:42.675480 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5853b2-ba3f-4cef-863d-a0ca11516f5e None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:42.676036 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5853b2-ba3f-4cef-863d-a0ca11516f5e None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:42.676036 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5853b2-ba3f-4cef-863d-a0ca11516f5e None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:42.677733 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 682/1360] 10.222.0.30 () {54 vars in 911 bytes} [Fri Oct 15 03:32:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:32:42.683491 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026e1db-4432-40ff-a395-451475d35494 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:42.683928 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026e1db-4432-40ff-a395-451475d35494 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:42.684081 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026e1db-4432-40ff-a395-451475d35494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:42.701885 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-6026e1db-4432-40ff-a395-451475d35494 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:32:42.703067 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-6026e1db-4432-40ff-a395-451475d35494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:32:42.710832 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 679/1361] 10.222.0.30 () {58 vars in 1008 bytes} [Fri Oct 15 03:32:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:32:42.865386 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5853b2-ba3f-4cef-863d-a0ca11516f5e None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:42.879331 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5853b2-ba3f-4cef-863d-a0ca11516f5e None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:42.884733 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e56d5-d813-4ca9-aa8f-22f920735363 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:42.885357 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e56d5-d813-4ca9-aa8f-22f920735363 service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:42.885638 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e56d5-d813-4ca9-aa8f-22f920735363 service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:42.885911 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e56d5-d813-4ca9-aa8f-22f920735363 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:42.893809 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e56d5-d813-4ca9-aa8f-22f920735363 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:42.895383 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e56d5-d813-4ca9-aa8f-22f920735363 service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:42.904474 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 683/1362] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:32:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:32:44.355255 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9d4ee-ae16-421e-8f24-0f91aaa55216 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:44.355839 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9d4ee-ae16-421e-8f24-0f91aaa55216 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:44.355839 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9d4ee-ae16-421e-8f24-0f91aaa55216 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:44.357621 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 680/1363] 10.222.0.30 () {54 vars in 911 bytes} [Fri Oct 15 03:32:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:32:44.363772 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be8be0-f538-4cc1-a946-735532551696 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:44.364184 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be8be0-f538-4cc1-a946-735532551696 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:44.364360 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be8be0-f538-4cc1-a946-735532551696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:44.381545 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-37be8be0-f538-4cc1-a946-735532551696 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:32:44.382736 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-37be8be0-f538-4cc1-a946-735532551696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:32:44.390416 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 684/1364] 10.222.0.30 () {58 vars in 1008 bytes} [Fri Oct 15 03:32:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:32:44.542242 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9d4ee-ae16-421e-8f24-0f91aaa55216 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:44.556736 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9d4ee-ae16-421e-8f24-0f91aaa55216 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:44.561976 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c42165-5926-44a1-80bb-80fc6ab2048d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:44.562595 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c42165-5926-44a1-80bb-80fc6ab2048d service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:44.562874 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c42165-5926-44a1-80bb-80fc6ab2048d service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:44.563141 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c42165-5926-44a1-80bb-80fc6ab2048d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:44.571220 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c42165-5926-44a1-80bb-80fc6ab2048d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:44.572863 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c42165-5926-44a1-80bb-80fc6ab2048d service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:44.582216 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 681/1365] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:32:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:32:46.014867 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d51014-87b3-4ae0-83be-237b2e225129 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:46.015441 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d51014-87b3-4ae0-83be-237b2e225129 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:46.015441 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d51014-87b3-4ae0-83be-237b2e225129 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:46.017299 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 685/1366] 10.222.0.30 () {54 vars in 911 bytes} [Fri Oct 15 03:32:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:32:46.023905 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309523b8-b5eb-4ad1-8245-7cc03b586714 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:46.024329 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309523b8-b5eb-4ad1-8245-7cc03b586714 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:46.024455 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309523b8-b5eb-4ad1-8245-7cc03b586714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:46.042111 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-309523b8-b5eb-4ad1-8245-7cc03b586714 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:32:46.043319 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-309523b8-b5eb-4ad1-8245-7cc03b586714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:32:46.051618 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 682/1367] 10.222.0.30 () {58 vars in 1008 bytes} [Fri Oct 15 03:32:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:32:46.203313 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d51014-87b3-4ae0-83be-237b2e225129 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:46.217963 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d51014-87b3-4ae0-83be-237b2e225129 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:46.224084 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923337c-ce0c-4877-959b-e8c7e6e3a4bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:46.224700 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923337c-ce0c-4877-959b-e8c7e6e3a4bc service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:46.224980 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923337c-ce0c-4877-959b-e8c7e6e3a4bc service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:46.225251 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923337c-ce0c-4877-959b-e8c7e6e3a4bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:46.232956 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923337c-ce0c-4877-959b-e8c7e6e3a4bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:46.234529 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923337c-ce0c-4877-959b-e8c7e6e3a4bc service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:46.243842 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 686/1368] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:32:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:32:47.674075 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fb789-a88c-4926-a7ce-5db06490e2b4 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:47.674582 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fb789-a88c-4926-a7ce-5db06490e2b4 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:47.674582 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fb789-a88c-4926-a7ce-5db06490e2b4 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:47.676356 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 683/1369] 10.222.0.30 () {54 vars in 911 bytes} [Fri Oct 15 03:32:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:32:47.681748 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe7f4f-8ed0-40d2-96ab-a92c67d48ca2 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:47.682177 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe7f4f-8ed0-40d2-96ab-a92c67d48ca2 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:47.682282 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe7f4f-8ed0-40d2-96ab-a92c67d48ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:47.699448 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-f0fe7f4f-8ed0-40d2-96ab-a92c67d48ca2 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:32:47.700642 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-f0fe7f4f-8ed0-40d2-96ab-a92c67d48ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:32:47.708691 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 687/1370] 10.222.0.30 () {58 vars in 1008 bytes} [Fri Oct 15 03:32:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:32:47.860457 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fb789-a88c-4926-a7ce-5db06490e2b4 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:47.874100 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fb789-a88c-4926-a7ce-5db06490e2b4 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:47.879334 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d1352-4a57-4bbc-b1af-773217b98452 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:47.879981 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d1352-4a57-4bbc-b1af-773217b98452 service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:47.880654 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d1352-4a57-4bbc-b1af-773217b98452 service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:47.880654 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d1352-4a57-4bbc-b1af-773217b98452 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:47.888496 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d1352-4a57-4bbc-b1af-773217b98452 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:47.890059 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d1352-4a57-4bbc-b1af-773217b98452 service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:47.899610 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 684/1371] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:32:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:32:49.280104 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdbcb3-b60c-49e4-bd09-e25efecae7bc None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:49.280631 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdbcb3-b60c-49e4-bd09-e25efecae7bc None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:49.280631 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdbcb3-b60c-49e4-bd09-e25efecae7bc None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:49.282444 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 688/1372] 10.222.0.30 () {54 vars in 911 bytes} [Fri Oct 15 03:32:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:32:49.288746 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1f352-0321-4bf3-bff3-ee86234a5151 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:49.289176 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1f352-0321-4bf3-bff3-ee86234a5151 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:49.289323 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1f352-0321-4bf3-bff3-ee86234a5151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:49.307194 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-aec1f352-0321-4bf3-bff3-ee86234a5151 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:32:49.308404 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-aec1f352-0321-4bf3-bff3-ee86234a5151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:32:49.316008 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 685/1373] 10.222.0.30 () {58 vars in 1008 bytes} [Fri Oct 15 03:32:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:32:49.469272 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdbcb3-b60c-49e4-bd09-e25efecae7bc None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:49.483931 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdbcb3-b60c-49e4-bd09-e25efecae7bc None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:49.489223 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acade55-9f20-4ef6-9194-a3a6f82ec2b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:49.489841 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acade55-9f20-4ef6-9194-a3a6f82ec2b5 service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:49.490121 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acade55-9f20-4ef6-9194-a3a6f82ec2b5 service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:49.490392 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acade55-9f20-4ef6-9194-a3a6f82ec2b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:49.498270 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acade55-9f20-4ef6-9194-a3a6f82ec2b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:49.499808 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acade55-9f20-4ef6-9194-a3a6f82ec2b5 service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:49.509326 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 689/1374] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:32:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:32:50.882616 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe2309-1ee4-4c6a-8e3c-1c98157e50a0 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:50.883178 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe2309-1ee4-4c6a-8e3c-1c98157e50a0 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:50.883178 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe2309-1ee4-4c6a-8e3c-1c98157e50a0 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:50.884955 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 686/1375] 10.222.0.30 () {54 vars in 911 bytes} [Fri Oct 15 03:32:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:32:50.890591 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd2a75-bcc8-45b8-b831-6245260c5c25 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:50.891010 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd2a75-bcc8-45b8-b831-6245260c5c25 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:50.891147 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd2a75-bcc8-45b8-b831-6245260c5c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:50.909497 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-e9cd2a75-bcc8-45b8-b831-6245260c5c25 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:32:50.910675 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-e9cd2a75-bcc8-45b8-b831-6245260c5c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:32:50.918290 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 690/1376] 10.222.0.30 () {58 vars in 1008 bytes} [Fri Oct 15 03:32:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:32:51.074183 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe2309-1ee4-4c6a-8e3c-1c98157e50a0 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:51.088782 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe2309-1ee4-4c6a-8e3c-1c98157e50a0 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:51.094504 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fc9c4-46fd-4dd7-aeca-9771d3ad9f1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:51.095125 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fc9c4-46fd-4dd7-aeca-9771d3ad9f1a service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:51.095439 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fc9c4-46fd-4dd7-aeca-9771d3ad9f1a service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:51.095942 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fc9c4-46fd-4dd7-aeca-9771d3ad9f1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:51.103779 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83fc9c4-46fd-4dd7-aeca-9771d3ad9f1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:51.105361 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83fc9c4-46fd-4dd7-aeca-9771d3ad9f1a service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:51.114285 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 687/1377] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:32:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:32:52.522047 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471f362-95bf-4104-b0cd-ccc386d047c2 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:52.522593 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471f362-95bf-4104-b0cd-ccc386d047c2 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:52.522593 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471f362-95bf-4104-b0cd-ccc386d047c2 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:52.524326 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 691/1378] 10.222.0.30 () {54 vars in 911 bytes} [Fri Oct 15 03:32:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:32:52.529916 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c64f35-dc18-43ba-8466-52ccb2762550 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:52.530324 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c64f35-dc18-43ba-8466-52ccb2762550 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:52.530470 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c64f35-dc18-43ba-8466-52ccb2762550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:52.547569 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-d0c64f35-dc18-43ba-8466-52ccb2762550 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:32:52.548876 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d0c64f35-dc18-43ba-8466-52ccb2762550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:32:52.556474 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 688/1379] 10.222.0.30 () {58 vars in 1008 bytes} [Fri Oct 15 03:32:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:32:52.707947 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471f362-95bf-4104-b0cd-ccc386d047c2 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:52.721963 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471f362-95bf-4104-b0cd-ccc386d047c2 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:52.727277 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff8d93-4b01-4fbc-af4b-30033761f3a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:52.727929 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff8d93-4b01-4fbc-af4b-30033761f3a5 service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:52.728211 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff8d93-4b01-4fbc-af4b-30033761f3a5 service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:52.728485 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff8d93-4b01-4fbc-af4b-30033761f3a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:52.736255 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff8d93-4b01-4fbc-af4b-30033761f3a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:52.737855 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff8d93-4b01-4fbc-af4b-30033761f3a5 service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:52.746830 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 692/1380] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:32:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:32:54.136689 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e105345-ec58-4b2d-bd24-17c3c5b2d402 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:54.137209 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e105345-ec58-4b2d-bd24-17c3c5b2d402 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:54.137209 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e105345-ec58-4b2d-bd24-17c3c5b2d402 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:54.138928 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 689/1381] 10.222.0.30 () {54 vars in 911 bytes} [Fri Oct 15 03:32:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:32:54.145138 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ed02e-d3e5-44eb-9a77-b9e13db68078 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:54.145576 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ed02e-d3e5-44eb-9a77-b9e13db68078 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:54.145670 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ed02e-d3e5-44eb-9a77-b9e13db68078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:54.162799 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-9f0ed02e-d3e5-44eb-9a77-b9e13db68078 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:32:54.164022 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-9f0ed02e-d3e5-44eb-9a77-b9e13db68078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:32:54.171584 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 693/1382] 10.222.0.30 () {58 vars in 1008 bytes} [Fri Oct 15 03:32:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:32:54.324101 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e105345-ec58-4b2d-bd24-17c3c5b2d402 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:54.337788 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e105345-ec58-4b2d-bd24-17c3c5b2d402 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:54.342922 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981d0e0-334c-4b56-b2cc-edaa69da2e96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:54.343837 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981d0e0-334c-4b56-b2cc-edaa69da2e96 service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:54.344113 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981d0e0-334c-4b56-b2cc-edaa69da2e96 service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:54.344382 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981d0e0-334c-4b56-b2cc-edaa69da2e96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:54.352598 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981d0e0-334c-4b56-b2cc-edaa69da2e96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:54.354167 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981d0e0-334c-4b56-b2cc-edaa69da2e96 service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:54.363731 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 690/1383] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:32:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:32:56.500106 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be2223-73df-4a1b-9212-8e952cba3dd5 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:56.500622 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be2223-73df-4a1b-9212-8e952cba3dd5 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:56.500622 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be2223-73df-4a1b-9212-8e952cba3dd5 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:56.502876 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 694/1384] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:32:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:32:56.508910 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d750607-1616-441e-a507-759f93d65dcd None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:56.509283 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d750607-1616-441e-a507-759f93d65dcd None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:56.509464 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d750607-1616-441e-a507-759f93d65dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:56.527472 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-5d750607-1616-441e-a507-759f93d65dcd None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:32:56.528667 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-5d750607-1616-441e-a507-759f93d65dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:32:56.536268 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 691/1385] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:32:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:32:56.575930 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be2223-73df-4a1b-9212-8e952cba3dd5 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:56.586760 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be2223-73df-4a1b-9212-8e952cba3dd5 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:56.590338 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1510e68-0d8f-42d8-8939-946460a60c37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:56.590959 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1510e68-0d8f-42d8-8939-946460a60c37 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:56.591233 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1510e68-0d8f-42d8-8939-946460a60c37 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:56.591505 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1510e68-0d8f-42d8-8939-946460a60c37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:56.601757 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1510e68-0d8f-42d8-8939-946460a60c37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:56.603372 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1510e68-0d8f-42d8-8939-946460a60c37 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:56.612939 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 695/1386] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:32:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:32:59.034783 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c65391-376c-42dc-b536-ecc3b903792e None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:59.035358 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c65391-376c-42dc-b536-ecc3b903792e None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:59.035358 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c65391-376c-42dc-b536-ecc3b903792e None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:59.037138 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 692/1387] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:32:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:32:59.043116 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246507d-c890-4a86-8b06-7e2926865826 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:59.043493 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246507d-c890-4a86-8b06-7e2926865826 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:59.043673 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246507d-c890-4a86-8b06-7e2926865826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:59.061574 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-6246507d-c890-4a86-8b06-7e2926865826 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:32:59.062778 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-6246507d-c890-4a86-8b06-7e2926865826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:32:59.070430 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 696/1388] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:32:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:32:59.111064 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c65391-376c-42dc-b536-ecc3b903792e None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:32:59.121447 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c65391-376c-42dc-b536-ecc3b903792e None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:32:59.124878 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61f2f5-223d-425a-9a33-9ea524a608fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:32:59.125492 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61f2f5-223d-425a-9a33-9ea524a608fd service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:32:59.125770 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61f2f5-223d-425a-9a33-9ea524a608fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:32:59.126037 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61f2f5-223d-425a-9a33-9ea524a608fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:32:59.135391 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61f2f5-223d-425a-9a33-9ea524a608fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:32:59.136847 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61f2f5-223d-425a-9a33-9ea524a608fd service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:32:59.146310 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 693/1389] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:32:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:33:01.763231 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0949950-56b3-431a-84c4-8064817b1598 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:01.763832 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0949950-56b3-431a-84c4-8064817b1598 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:01.763832 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0949950-56b3-431a-84c4-8064817b1598 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:01.765623 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 697/1390] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:33:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:33:01.772159 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffe583-97c1-42d7-9662-f40273be2701 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:01.772602 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffe583-97c1-42d7-9662-f40273be2701 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:01.772711 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffe583-97c1-42d7-9662-f40273be2701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:01.789754 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-55ffe583-97c1-42d7-9662-f40273be2701 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:33:01.790936 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-55ffe583-97c1-42d7-9662-f40273be2701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:33:01.799037 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 694/1391] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:33:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:33:01.839771 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0949950-56b3-431a-84c4-8064817b1598 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:33:01.850275 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0949950-56b3-431a-84c4-8064817b1598 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:33:01.853791 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d343c-cfd1-4952-a00c-e07d69bdb9b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:33:01.854410 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d343c-cfd1-4952-a00c-e07d69bdb9b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:01.854692 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d343c-cfd1-4952-a00c-e07d69bdb9b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:01.854960 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d343c-cfd1-4952-a00c-e07d69bdb9b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:01.863502 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d343c-cfd1-4952-a00c-e07d69bdb9b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:33:01.864960 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d343c-cfd1-4952-a00c-e07d69bdb9b4 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:33:01.873947 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 698/1392] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:33:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:33:04.233166 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f6bf2-dc55-49c0-a31e-b8eeff0dcb86 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:04.233693 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f6bf2-dc55-49c0-a31e-b8eeff0dcb86 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:04.233693 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f6bf2-dc55-49c0-a31e-b8eeff0dcb86 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:04.235410 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 695/1393] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:33:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:33:04.241429 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d14744-b76a-48a9-b755-91214da51667 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:04.241888 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d14744-b76a-48a9-b755-91214da51667 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:04.242002 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d14744-b76a-48a9-b755-91214da51667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:04.259405 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-b1d14744-b76a-48a9-b755-91214da51667 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:33:04.260622 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-b1d14744-b76a-48a9-b755-91214da51667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:33:04.268654 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 699/1394] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:33:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:33:04.307971 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f6bf2-dc55-49c0-a31e-b8eeff0dcb86 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:33:04.318230 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f6bf2-dc55-49c0-a31e-b8eeff0dcb86 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:33:04.321706 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88955698-00b5-4163-92b1-78cb7d20f312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:33:04.322325 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88955698-00b5-4163-92b1-78cb7d20f312 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:04.322606 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88955698-00b5-4163-92b1-78cb7d20f312 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:04.322876 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88955698-00b5-4163-92b1-78cb7d20f312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:04.331921 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88955698-00b5-4163-92b1-78cb7d20f312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:33:04.333339 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88955698-00b5-4163-92b1-78cb7d20f312 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:33:04.342350 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 696/1395] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:33:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:33:06.609700 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d3b8c-fc97-4eb2-b055-348377885b9f None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:06.610390 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d3b8c-fc97-4eb2-b055-348377885b9f None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:06.610390 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d3b8c-fc97-4eb2-b055-348377885b9f None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:06.612508 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 700/1396] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:33:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:33:06.618460 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea835ae-546b-499f-b229-6b8fb46251c6 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:06.618899 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea835ae-546b-499f-b229-6b8fb46251c6 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:06.618998 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea835ae-546b-499f-b229-6b8fb46251c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:06.636893 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-1ea835ae-546b-499f-b229-6b8fb46251c6 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:33:06.638076 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-1ea835ae-546b-499f-b229-6b8fb46251c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:33:06.645814 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 697/1397] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:33:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:33:06.684501 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d3b8c-fc97-4eb2-b055-348377885b9f None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:33:06.695501 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d3b8c-fc97-4eb2-b055-348377885b9f None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:33:06.699354 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88482d-5757-425c-89d3-f2e96d9b2880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:33:06.700018 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88482d-5757-425c-89d3-f2e96d9b2880 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:06.700297 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88482d-5757-425c-89d3-f2e96d9b2880 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:06.700766 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88482d-5757-425c-89d3-f2e96d9b2880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:06.710216 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88482d-5757-425c-89d3-f2e96d9b2880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:33:06.711639 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88482d-5757-425c-89d3-f2e96d9b2880 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:33:06.720930 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 701/1398] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:33:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:33:09.010309 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8ef74-16c7-4e49-9bf4-077f8ef0241b None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:09.010897 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8ef74-16c7-4e49-9bf4-077f8ef0241b None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:09.010897 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8ef74-16c7-4e49-9bf4-077f8ef0241b None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:09.012655 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 698/1399] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:33:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:33:09.018735 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291f341-3d4f-4f64-baac-238d31d86d9e None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:09.019167 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291f341-3d4f-4f64-baac-238d31d86d9e None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:09.019318 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291f341-3d4f-4f64-baac-238d31d86d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:09.036941 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-8291f341-3d4f-4f64-baac-238d31d86d9e None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:33:09.038104 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-8291f341-3d4f-4f64-baac-238d31d86d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:33:09.045623 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 702/1400] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:33:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:33:09.084697 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8ef74-16c7-4e49-9bf4-077f8ef0241b None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:33:09.095332 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8ef74-16c7-4e49-9bf4-077f8ef0241b None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:33:09.099378 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c4dde-eb7c-475f-ad42-535a867ee3b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:33:09.100033 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c4dde-eb7c-475f-ad42-535a867ee3b5 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:09.100317 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c4dde-eb7c-475f-ad42-535a867ee3b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:09.100595 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c4dde-eb7c-475f-ad42-535a867ee3b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:09.109209 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c4dde-eb7c-475f-ad42-535a867ee3b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:33:09.110646 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c4dde-eb7c-475f-ad42-535a867ee3b5 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:33:09.120401 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 699/1401] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:33:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:33:11.385505 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548da9f6-401e-496b-9227-67726ec3101b None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:11.386052 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548da9f6-401e-496b-9227-67726ec3101b None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:11.386052 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548da9f6-401e-496b-9227-67726ec3101b None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:11.387838 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 703/1402] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:33:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:33:11.393813 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b0cc1-b7ed-42c3-bd87-f2eda3fda726 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:11.394258 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b0cc1-b7ed-42c3-bd87-f2eda3fda726 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:11.394370 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b0cc1-b7ed-42c3-bd87-f2eda3fda726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:11.412014 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-236b0cc1-b7ed-42c3-bd87-f2eda3fda726 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:33:11.413190 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-236b0cc1-b7ed-42c3-bd87-f2eda3fda726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:33:11.420786 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 700/1403] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:33:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:33:11.458717 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548da9f6-401e-496b-9227-67726ec3101b None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:33:11.469227 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548da9f6-401e-496b-9227-67726ec3101b None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:33:11.473318 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ce607-ce78-48ac-ab07-7eb7e6bed35a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:33:11.473939 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ce607-ce78-48ac-ab07-7eb7e6bed35a service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:11.474219 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ce607-ce78-48ac-ab07-7eb7e6bed35a service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:11.474491 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ce607-ce78-48ac-ab07-7eb7e6bed35a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:11.483024 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ce607-ce78-48ac-ab07-7eb7e6bed35a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:33:11.484480 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ce607-ce78-48ac-ab07-7eb7e6bed35a service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:33:11.494207 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 704/1404] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:33:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:33:13.849164 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5690c-490d-4779-887b-96303d24ebea None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:13.849724 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5690c-490d-4779-887b-96303d24ebea None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:13.849724 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5690c-490d-4779-887b-96303d24ebea None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:13.851541 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 701/1405] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:33:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:33:13.857254 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e988c-fc1f-4dc8-9362-93a10caabd93 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:13.857670 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e988c-fc1f-4dc8-9362-93a10caabd93 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:13.857810 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e988c-fc1f-4dc8-9362-93a10caabd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:13.875609 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-402e988c-fc1f-4dc8-9362-93a10caabd93 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:33:13.877356 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-402e988c-fc1f-4dc8-9362-93a10caabd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:33:13.884988 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 705/1406] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:33:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:33:13.922818 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5690c-490d-4779-887b-96303d24ebea None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:33:13.933664 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5690c-490d-4779-887b-96303d24ebea None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:33:13.937201 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d6004-6d40-4f29-ac84-39284280d692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:33:13.937820 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d6004-6d40-4f29-ac84-39284280d692 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:13.938101 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d6004-6d40-4f29-ac84-39284280d692 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:13.938377 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d6004-6d40-4f29-ac84-39284280d692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:13.947899 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d6004-6d40-4f29-ac84-39284280d692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:33:13.949322 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d6004-6d40-4f29-ac84-39284280d692 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:33:13.958435 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 702/1407] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:33:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:33:16.207248 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048c51d-99ca-4ce5-b905-196b546e8c93 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:16.207794 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048c51d-99ca-4ce5-b905-196b546e8c93 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:16.207794 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048c51d-99ca-4ce5-b905-196b546e8c93 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:16.209518 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 706/1408] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:33:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:33:16.215432 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f3c74-8aaa-4cbc-805a-00673406532d None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:16.215901 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f3c74-8aaa-4cbc-805a-00673406532d None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:16.216001 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f3c74-8aaa-4cbc-805a-00673406532d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:16.234536 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-7b7f3c74-8aaa-4cbc-805a-00673406532d None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:33:16.235893 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7b7f3c74-8aaa-4cbc-805a-00673406532d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:33:16.244383 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 703/1409] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:33:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:33:16.282140 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048c51d-99ca-4ce5-b905-196b546e8c93 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:33:16.293123 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048c51d-99ca-4ce5-b905-196b546e8c93 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:33:16.296658 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626e228-879d-4017-bc77-185182076ce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:33:16.297277 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626e228-879d-4017-bc77-185182076ce5 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:16.297557 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626e228-879d-4017-bc77-185182076ce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:16.297838 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626e228-879d-4017-bc77-185182076ce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:16.306729 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626e228-879d-4017-bc77-185182076ce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:33:16.308185 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626e228-879d-4017-bc77-185182076ce5 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:33:16.317748 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 707/1410] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:33:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:33:18.546431 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1637b8-f047-4eb7-9689-6d25839c7f90 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:18.546956 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1637b8-f047-4eb7-9689-6d25839c7f90 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:18.546956 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1637b8-f047-4eb7-9689-6d25839c7f90 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:18.549278 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 704/1411] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:33:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:33:18.555178 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7fd00-6404-42c3-9a5d-317d10bcadd3 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:18.555610 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7fd00-6404-42c3-9a5d-317d10bcadd3 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:18.555736 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7fd00-6404-42c3-9a5d-317d10bcadd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:18.573504 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-47f7fd00-6404-42c3-9a5d-317d10bcadd3 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:33:18.574665 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-47f7fd00-6404-42c3-9a5d-317d10bcadd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:33:18.582331 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 708/1412] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:33:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:33:18.620369 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1637b8-f047-4eb7-9689-6d25839c7f90 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:33:18.631115 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1637b8-f047-4eb7-9689-6d25839c7f90 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:33:18.634590 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa9325-4fdf-40a5-a9f6-5642ffca31bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:33:18.635208 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa9325-4fdf-40a5-a9f6-5642ffca31bd service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:18.635489 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa9325-4fdf-40a5-a9f6-5642ffca31bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:18.635792 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa9325-4fdf-40a5-a9f6-5642ffca31bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:18.644353 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa9325-4fdf-40a5-a9f6-5642ffca31bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:33:18.645775 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa9325-4fdf-40a5-a9f6-5642ffca31bd service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:33:18.654799 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 705/1413] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:33:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:33:35.405700 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee0ae9-d969-47d2-bc9c-f21c8beeeb9d None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:35.406249 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee0ae9-d969-47d2-bc9c-f21c8beeeb9d None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:35.406249 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee0ae9-d969-47d2-bc9c-f21c8beeeb9d None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:35.408574 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 709/1414] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:33:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:33:35.414539 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f63ef9-aa38-47c8-aefa-c830df22c0bc None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:35.414978 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f63ef9-aa38-47c8-aefa-c830df22c0bc None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:35.415113 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f63ef9-aa38-47c8-aefa-c830df22c0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:35.432800 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-b1f63ef9-aa38-47c8-aefa-c830df22c0bc None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:33:35.433969 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-b1f63ef9-aa38-47c8-aefa-c830df22c0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:33:35.441396 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 706/1415] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:33:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:33:35.492036 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18234d-a226-42dc-8f32-aa5d18f8a97d None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:35.492320 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18234d-a226-42dc-8f32-aa5d18f8a97d None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:35.492596 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18234d-a226-42dc-8f32-aa5d18f8a97d None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:35.494444 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 710/1416] 10.222.0.30 () {54 vars in 962 bytes} [Fri Oct 15 03:33:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:33:35.499491 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a38e7c-c83a-40ed-ac5d-b2107f63d248 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:35.499822 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a38e7c-c83a-40ed-ac5d-b2107f63d248 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:35.500104 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a38e7c-c83a-40ed-ac5d-b2107f63d248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:35.517587 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-07a38e7c-c83a-40ed-ac5d-b2107f63d248 None None] MFA Rules not processed for user `456c83b8619847279927251ca48fca37`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:33:35.518774 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-07a38e7c-c83a-40ed-ac5d-b2107f63d248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:33:35.525151 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 707/1417] 10.222.0.30 () {58 vars in 1059 bytes} [Fri Oct 15 03:33:35 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:33:35.533267 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18234d-a226-42dc-8f32-aa5d18f8a97d None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:33:35.543311 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18234d-a226-42dc-8f32-aa5d18f8a97d None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:33:35.546770 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453d8d5-ce7c-4570-a29a-f61fb592aab5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456c83b8619847279927251ca48fca37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:33:35.547376 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453d8d5-ce7c-4570-a29a-f61fb592aab5 service glance] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:35.547654 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453d8d5-ce7c-4570-a29a-f61fb592aab5 service glance] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:35.548572 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453d8d5-ce7c-4570-a29a-f61fb592aab5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:35.557063 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453d8d5-ce7c-4570-a29a-f61fb592aab5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:33:35.558465 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453d8d5-ce7c-4570-a29a-f61fb592aab5 service glance] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:33:35.567416 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 711/1418] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:33:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:33:37.990011 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad7cda-2fcd-44a5-9ab9-c65465bc11bb None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:37.990567 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad7cda-2fcd-44a5-9ab9-c65465bc11bb None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:37.990675 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad7cda-2fcd-44a5-9ab9-c65465bc11bb None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:37.992413 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 708/1419] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:33:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:33:37.998301 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0d01b-69d6-4f65-8b66-0ffe7020305f None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:37.998749 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0d01b-69d6-4f65-8b66-0ffe7020305f None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:37.998858 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0d01b-69d6-4f65-8b66-0ffe7020305f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:38.016230 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-3ad0d01b-69d6-4f65-8b66-0ffe7020305f None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:33:38.017919 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-3ad0d01b-69d6-4f65-8b66-0ffe7020305f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:33:38.025617 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 712/1420] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:33:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:33:38.049771 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad7cda-2fcd-44a5-9ab9-c65465bc11bb None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:33:38.061692 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad7cda-2fcd-44a5-9ab9-c65465bc11bb None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:33:38.066008 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d28b964-fca8-49d2-ab1e-60c909330a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:33:38.066633 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28b964-fca8-49d2-ab1e-60c909330a7a admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:38.066915 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28b964-fca8-49d2-ab1e-60c909330a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:38.067188 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28b964-fca8-49d2-ab1e-60c909330a7a admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:38.067952 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28b964-fca8-49d2-ab1e-60c909330a7a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:33:38.069823 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d28b964-fca8-49d2-ab1e-60c909330a7a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:33:38.088445 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 709/1421] 10.222.0.30 () {56 vars in 1108 bytes} [Fri Oct 15 03:33:38 2021] GET /identity/v3/projects => generated 2553 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:33:40.380600 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85fc1a-240f-403c-b4ea-9221747b9ee1 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:40.381156 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85fc1a-240f-403c-b4ea-9221747b9ee1 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:40.381156 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85fc1a-240f-403c-b4ea-9221747b9ee1 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:40.382943 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 713/1422] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:33:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:33:40.388938 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fbf01-9df0-4e3e-b8d5-cc7e3ddc2ebe None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:40.389317 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fbf01-9df0-4e3e-b8d5-cc7e3ddc2ebe None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:40.389487 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fbf01-9df0-4e3e-b8d5-cc7e3ddc2ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:40.406762 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-047fbf01-9df0-4e3e-b8d5-cc7e3ddc2ebe None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:33:40.407967 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-047fbf01-9df0-4e3e-b8d5-cc7e3ddc2ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:33:40.415439 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 710/1423] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:33:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:33:40.460522 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85fc1a-240f-403c-b4ea-9221747b9ee1 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:33:40.474601 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85fc1a-240f-403c-b4ea-9221747b9ee1 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:33:40.479952 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db6a8c-94a3-432c-ac5c-5a046c5f13a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:33:40.480573 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db6a8c-94a3-432c-ac5c-5a046c5f13a5 service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:40.480854 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db6a8c-94a3-432c-ac5c-5a046c5f13a5 service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:40.481127 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db6a8c-94a3-432c-ac5c-5a046c5f13a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:40.489437 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db6a8c-94a3-432c-ac5c-5a046c5f13a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:33:40.491019 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db6a8c-94a3-432c-ac5c-5a046c5f13a5 service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:33:40.500086 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 714/1424] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:33:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:33:42.919849 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78e7e0-9b4f-4053-8e18-50326ad21f2c None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:42.920432 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78e7e0-9b4f-4053-8e18-50326ad21f2c None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:42.920432 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78e7e0-9b4f-4053-8e18-50326ad21f2c None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:42.922164 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 711/1425] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:33:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:33:42.928130 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2d8ff-b4fb-4c10-beba-d6e74d678eb9 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:42.928554 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2d8ff-b4fb-4c10-beba-d6e74d678eb9 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:42.928673 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2d8ff-b4fb-4c10-beba-d6e74d678eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:42.946365 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-91a2d8ff-b4fb-4c10-beba-d6e74d678eb9 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:33:42.947544 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-91a2d8ff-b4fb-4c10-beba-d6e74d678eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:33:42.955795 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 715/1426] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:33:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:33:42.993189 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78e7e0-9b4f-4053-8e18-50326ad21f2c None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:33:43.004047 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78e7e0-9b4f-4053-8e18-50326ad21f2c None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:33:43.007482 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db74050-c87b-479b-804e-af123bc05452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:33:43.008152 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db74050-c87b-479b-804e-af123bc05452 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:43.008438 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db74050-c87b-479b-804e-af123bc05452 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:43.008723 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db74050-c87b-479b-804e-af123bc05452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:43.017874 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db74050-c87b-479b-804e-af123bc05452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:33:43.019309 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db74050-c87b-479b-804e-af123bc05452 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:33:43.028567 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 712/1427] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:33:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:33:45.326262 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714724e-9756-45bf-85f6-20fd717e24c3 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:45.326802 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714724e-9756-45bf-85f6-20fd717e24c3 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:45.326802 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714724e-9756-45bf-85f6-20fd717e24c3 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:45.328619 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 716/1428] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:33:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:33:45.334628 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511eecd-8399-4037-8fff-402bf2cafbb2 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:45.335027 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511eecd-8399-4037-8fff-402bf2cafbb2 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:45.335190 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511eecd-8399-4037-8fff-402bf2cafbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:45.353370 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-c511eecd-8399-4037-8fff-402bf2cafbb2 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:33:45.354562 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c511eecd-8399-4037-8fff-402bf2cafbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:33:45.362860 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 713/1429] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:33:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:33:45.402121 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714724e-9756-45bf-85f6-20fd717e24c3 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:33:45.413048 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714724e-9756-45bf-85f6-20fd717e24c3 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:33:45.416529 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00ce65-5936-473c-b7a0-2cd8fc795cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:33:45.417153 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00ce65-5936-473c-b7a0-2cd8fc795cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:45.417432 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00ce65-5936-473c-b7a0-2cd8fc795cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:45.417706 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00ce65-5936-473c-b7a0-2cd8fc795cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:45.426325 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00ce65-5936-473c-b7a0-2cd8fc795cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:33:45.427776 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00ce65-5936-473c-b7a0-2cd8fc795cd1 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:33:45.436756 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 717/1430] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:33:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:33:47.813291 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df2f87-a703-4b56-9028-8aecda3ba30b None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:47.813829 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df2f87-a703-4b56-9028-8aecda3ba30b None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:47.813985 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df2f87-a703-4b56-9028-8aecda3ba30b None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:47.815854 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 714/1431] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:33:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:33:47.821870 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26168ea4-0064-4499-8980-a4f3ac9e0920 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:47.822274 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26168ea4-0064-4499-8980-a4f3ac9e0920 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:47.822454 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26168ea4-0064-4499-8980-a4f3ac9e0920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:47.840360 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-26168ea4-0064-4499-8980-a4f3ac9e0920 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:33:47.841533 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-26168ea4-0064-4499-8980-a4f3ac9e0920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:33:47.850068 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 718/1432] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:33:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:33:47.890976 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df2f87-a703-4b56-9028-8aecda3ba30b None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:33:47.901760 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df2f87-a703-4b56-9028-8aecda3ba30b None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:33:47.905151 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b4127-cc38-4dff-91ee-0a3178c934fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:33:47.905772 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b4127-cc38-4dff-91ee-0a3178c934fc service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:47.906049 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b4127-cc38-4dff-91ee-0a3178c934fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:47.906318 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b4127-cc38-4dff-91ee-0a3178c934fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:47.915369 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b4127-cc38-4dff-91ee-0a3178c934fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:33:47.916944 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b4127-cc38-4dff-91ee-0a3178c934fc service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:33:47.926053 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 715/1433] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:33:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:33:50.329473 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4198a5f-19f6-4286-9b1b-e022205f20b1 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:50.330035 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4198a5f-19f6-4286-9b1b-e022205f20b1 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:50.330148 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4198a5f-19f6-4286-9b1b-e022205f20b1 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:50.332015 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 719/1434] 10.222.0.30 () {54 vars in 926 bytes} [Fri Oct 15 03:33:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:33:50.337973 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf82742-d14a-4a3d-9e98-c7a537c232d5 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:50.338364 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf82742-d14a-4a3d-9e98-c7a537c232d5 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:50.338523 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf82742-d14a-4a3d-9e98-c7a537c232d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:50.357551 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-0bf82742-d14a-4a3d-9e98-c7a537c232d5 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:33:50.358733 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-0bf82742-d14a-4a3d-9e98-c7a537c232d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:33:50.366841 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 716/1435] 10.222.0.30 () {58 vars in 1023 bytes} [Fri Oct 15 03:33:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:33:50.406347 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4198a5f-19f6-4286-9b1b-e022205f20b1 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:33:50.417217 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4198a5f-19f6-4286-9b1b-e022205f20b1 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:33:50.420667 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035eb90-b95e-4ed4-bc67-fb138155a625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:33:50.421311 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035eb90-b95e-4ed4-bc67-fb138155a625 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:33:50.421592 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035eb90-b95e-4ed4-bc67-fb138155a625 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:33:50.421865 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035eb90-b95e-4ed4-bc67-fb138155a625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:33:50.430983 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035eb90-b95e-4ed4-bc67-fb138155a625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:33:50.432444 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035eb90-b95e-4ed4-bc67-fb138155a625 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:33:50.441903 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 720/1436] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:33:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:35:00.878845 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba587d-832c-41e9-a1c3-683cef0297f0 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:35:00.879436 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba587d-832c-41e9-a1c3-683cef0297f0 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:35:00.879436 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba587d-832c-41e9-a1c3-683cef0297f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:35:00.896695 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-7cba587d-832c-41e9-a1c3-683cef0297f0 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:35:00.897880 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7cba587d-832c-41e9-a1c3-683cef0297f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:35:00.905656 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 717/1437] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:35:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:35:00.913776 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e520b7-ce45-4f02-bc1d-9bbc44ad4caf None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:35:00.914260 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e520b7-ce45-4f02-bc1d-9bbc44ad4caf None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:35:00.914363 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e520b7-ce45-4f02-bc1d-9bbc44ad4caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:35:00.931860 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-03e520b7-ce45-4f02-bc1d-9bbc44ad4caf None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:35:00.933012 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-03e520b7-ce45-4f02-bc1d-9bbc44ad4caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:35:00.940640 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 721/1438] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:35:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:35:00.945050 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba587d-832c-41e9-a1c3-683cef0297f0 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:35:00.954192 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba587d-832c-41e9-a1c3-683cef0297f0 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:35:00.958593 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca73ee-fa41-4e06-9a9f-47d35fad882d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:35:00.959204 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca73ee-fa41-4e06-9a9f-47d35fad882d admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:35:00.959481 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca73ee-fa41-4e06-9a9f-47d35fad882d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:35:00.959785 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca73ee-fa41-4e06-9a9f-47d35fad882d admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:35:00.960497 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca73ee-fa41-4e06-9a9f-47d35fad882d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:35:00.960793 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca73ee-fa41-4e06-9a9f-47d35fad882d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:35:00.962384 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca73ee-fa41-4e06-9a9f-47d35fad882d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:35:00.974023 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 718/1439] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:35:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:35:00.981645 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e520b7-ce45-4f02-bc1d-9bbc44ad4caf None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:35:00.990841 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e520b7-ce45-4f02-bc1d-9bbc44ad4caf None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:35:00.995280 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13af98-0e91-4e6b-b8c3-1634d85eea2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:35:00.995938 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13af98-0e91-4e6b-b8c3-1634d85eea2d admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:35:00.996218 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13af98-0e91-4e6b-b8c3-1634d85eea2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:35:00.996487 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13af98-0e91-4e6b-b8c3-1634d85eea2d admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:35:00.997168 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13af98-0e91-4e6b-b8c3-1634d85eea2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:35:00.999027 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13af98-0e91-4e6b-b8c3-1634d85eea2d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:35:01.033238 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 722/1440] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:35:00 2021] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:35:01.037340 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca73ee-fa41-4e06-9a9f-47d35fad882d admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:35:01.047772 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca73ee-fa41-4e06-9a9f-47d35fad882d admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:35:01.099043 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54134446-df67-4aa8-ae25-cb1e65a33c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:35:01.099705 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54134446-df67-4aa8-ae25-cb1e65a33c8b admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:35:01.099989 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54134446-df67-4aa8-ae25-cb1e65a33c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:35:01.100263 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54134446-df67-4aa8-ae25-cb1e65a33c8b admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:35:01.100935 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54134446-df67-4aa8-ae25-cb1e65a33c8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:35:01.102819 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54134446-df67-4aa8-ae25-cb1e65a33c8b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:35:01.121736 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 719/1441] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:35:01 2021] POST /identity/v3/users => generated 289 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:35:01.125705 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13af98-0e91-4e6b-b8c3-1634d85eea2d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:35:01.135420 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13af98-0e91-4e6b-b8c3-1634d85eea2d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:35:01.139766 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe432a-b7b6-4184-ba4f-4d519dbafba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:35:01.140926 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe432a-b7b6-4184-ba4f-4d519dbafba1 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:35:01.141204 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe432a-b7b6-4184-ba4f-4d519dbafba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:35:01.141478 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe432a-b7b6-4184-ba4f-4d519dbafba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:35:01.142201 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe432a-b7b6-4184-ba4f-4d519dbafba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:35:01.143792 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe432a-b7b6-4184-ba4f-4d519dbafba1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:35:01.157144 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 723/1442] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:35:01 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:35:01.160946 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54134446-df67-4aa8-ae25-cb1e65a33c8b admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:35:01.170276 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54134446-df67-4aa8-ae25-cb1e65a33c8b admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:35:01.174629 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a7fb7-7402-4517-a0de-9a2445413080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:35:01.175260 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a7fb7-7402-4517-a0de-9a2445413080 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:35:01.175538 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a7fb7-7402-4517-a0de-9a2445413080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:35:01.175850 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a7fb7-7402-4517-a0de-9a2445413080 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:35:01.176566 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a7fb7-7402-4517-a0de-9a2445413080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:35:01.178122 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a7fb7-7402-4517-a0de-9a2445413080 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:35:01.190676 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 720/1443] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:35:01 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:35:01.194481 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe432a-b7b6-4184-ba4f-4d519dbafba1 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:35:01.204533 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe432a-b7b6-4184-ba4f-4d519dbafba1 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:35:01.209017 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56f844-9c27-41cc-8a8e-d5b6b64f2dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:35:01.209859 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56f844-9c27-41cc-8a8e-d5b6b64f2dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:35:01.210139 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56f844-9c27-41cc-8a8e-d5b6b64f2dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:35:01.210417 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56f844-9c27-41cc-8a8e-d5b6b64f2dd0 admin admin] PATH_INFO: `/v3/projects/a1e979042b524c10a912030607010a09/users/dd8e7496ec6d4d42bcf582ccad8ffe42/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:35:01.224984 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56f844-9c27-41cc-8a8e-d5b6b64f2dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e979042b524c10a912030607010a09, user_id=dd8e7496ec6d4d42bcf582ccad8ffe42, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:35:01.227645 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56f844-9c27-41cc-8a8e-d5b6b64f2dd0 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:35:01.242900 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 724/1444] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:35:01 2021] PUT /identity/v3/projects/a1e979042b524c10a912030607010a09/users/dd8e7496ec6d4d42bcf582ccad8ffe42/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:35:01.254151 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7623a-b5fc-4c9b-adbd-b77d256138d6 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:35:01.254486 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7623a-b5fc-4c9b-adbd-b77d256138d6 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:35:01.254767 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7623a-b5fc-4c9b-adbd-b77d256138d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:35:01.280426 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-1ea7623a-b5fc-4c9b-adbd-b77d256138d6 None None] MFA Rules not processed for user `dd8e7496ec6d4d42bcf582ccad8ffe42`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:35:01.282196 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-1ea7623a-b5fc-4c9b-adbd-b77d256138d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:35:01.341689 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 721/1445] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:35:01 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:35:01.353719 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56f844-9c27-41cc-8a8e-d5b6b64f2dd0 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:35:01.418339 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56f844-9c27-41cc-8a8e-d5b6b64f2dd0 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:35:01.423595 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea4314-591d-47bd-8d49-c2ec41ae1891 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:35:01.424242 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea4314-591d-47bd-8d49-c2ec41ae1891 service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:35:01.424520 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea4314-591d-47bd-8d49-c2ec41ae1891 service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:35:01.424790 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea4314-591d-47bd-8d49-c2ec41ae1891 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:35:01.432345 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea4314-591d-47bd-8d49-c2ec41ae1891 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:35:01.433956 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea4314-591d-47bd-8d49-c2ec41ae1891 service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:35:01.442557 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 725/1446] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:35:01 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:35:01.511449 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce4e94-79f6-4510-a937-bf33eecf6d47 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:35:01.511774 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce4e94-79f6-4510-a937-bf33eecf6d47 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:35:01.512060 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce4e94-79f6-4510-a937-bf33eecf6d47 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:35:01.513819 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 722/1447] 10.222.0.30 () {52 vars in 829 bytes} [Fri Oct 15 03:35:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:35:01.518057 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea4314-591d-47bd-8d49-c2ec41ae1891 service nova] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:35:01.575366 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea4314-591d-47bd-8d49-c2ec41ae1891 service nova] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:35:01.580586 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670d2b9-fde0-4fce-b0e8-1a91729f199e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:35:01.581427 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670d2b9-fde0-4fce-b0e8-1a91729f199e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:35:01.581740 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670d2b9-fde0-4fce-b0e8-1a91729f199e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:35:01.582020 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670d2b9-fde0-4fce-b0e8-1a91729f199e admin admin] PATH_INFO: `/v3/users/dd8e7496ec6d4d42bcf582ccad8ffe42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:35:01.583204 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670d2b9-fde0-4fce-b0e8-1a91729f199e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd8e7496ec6d4d42bcf582ccad8ffe42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:35:01.584276 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING py.warnings [None req-d670d2b9-fde0-4fce-b0e8-1a91729f199e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:35:01.584276 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: warnings.warn(msg) Oct 15 03:35:01.584276 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: Oct 15 03:35:01.585487 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670d2b9-fde0-4fce-b0e8-1a91729f199e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:35:01.650775 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d670d2b9-fde0-4fce-b0e8-1a91729f199e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd8e7496ec6d4d42bcf582ccad8ffe42'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:35:01.669604 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d670d2b9-fde0-4fce-b0e8-1a91729f199e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd8e7496ec6d4d42bcf582ccad8ffe42'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:35:01.678644 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d670d2b9-fde0-4fce-b0e8-1a91729f199e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd8e7496ec6d4d42bcf582ccad8ffe42'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:35:01.679366 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d670d2b9-fde0-4fce-b0e8-1a91729f199e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd8e7496ec6d4d42bcf582ccad8ffe42'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:35:01.691858 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d670d2b9-fde0-4fce-b0e8-1a91729f199e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd8e7496ec6d4d42bcf582ccad8ffe42'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:35:01.697929 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 726/1448] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:35:01 2021] DELETE /identity/v3/users/dd8e7496ec6d4d42bcf582ccad8ffe42 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:35:01.702358 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced34c98-0169-4dc9-ab40-c94b09d615b3 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:35:01.702646 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced34c98-0169-4dc9-ab40-c94b09d615b3 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:35:01.703493 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced34c98-0169-4dc9-ab40-c94b09d615b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:35:01.720961 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-ced34c98-0169-4dc9-ab40-c94b09d615b3 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:35:01.722224 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-ced34c98-0169-4dc9-ab40-c94b09d615b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:35:01.776943 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 723/1449] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:35:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:35:01.786599 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670d2b9-fde0-4fce-b0e8-1a91729f199e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:35:01.787994 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-d670d2b9-fde0-4fce-b0e8-1a91729f199e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:35:01.841555 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670d2b9-fde0-4fce-b0e8-1a91729f199e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:35:01.845604 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c349b95-6af0-421e-b453-a67c8b7446b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:35:01.846299 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c349b95-6af0-421e-b453-a67c8b7446b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:35:01.846583 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c349b95-6af0-421e-b453-a67c8b7446b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:35:01.846859 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c349b95-6af0-421e-b453-a67c8b7446b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:35:01.855650 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c349b95-6af0-421e-b453-a67c8b7446b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:35:01.857110 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c349b95-6af0-421e-b453-a67c8b7446b1 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:35:01.866793 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 727/1450] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:35:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:35:02.174098 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced34c98-0169-4dc9-ab40-c94b09d615b3 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:35:02.175557 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-ced34c98-0169-4dc9-ab40-c94b09d615b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:35:02.187177 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced34c98-0169-4dc9-ab40-c94b09d615b3 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:35:02.192565 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f43eb-660f-4b1c-9f87-0947c86488e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:35:02.193413 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f43eb-660f-4b1c-9f87-0947c86488e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:35:02.193687 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f43eb-660f-4b1c-9f87-0947c86488e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:35:02.194382 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f43eb-660f-4b1c-9f87-0947c86488e7 admin admin] PATH_INFO: `/v3/projects/a1e979042b524c10a912030607010a09` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:35:02.195584 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f43eb-660f-4b1c-9f87-0947c86488e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1e979042b524c10a912030607010a09)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:35:02.196644 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING py.warnings [None req-963f43eb-660f-4b1c-9f87-0947c86488e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:35:02.196644 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: warnings.warn(msg) Oct 15 03:35:02.196644 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: Oct 15 03:35:02.197843 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f43eb-660f-4b1c-9f87-0947c86488e7 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:35:02.256746 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-963f43eb-660f-4b1c-9f87-0947c86488e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1e979042b524c10a912030607010a09', 'request_id': 'req-963f43eb-660f-4b1c-9f87-0947c86488e7'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:35:02.269625 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-963f43eb-660f-4b1c-9f87-0947c86488e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1e979042b524c10a912030607010a09', 'request_id': 'req-963f43eb-660f-4b1c-9f87-0947c86488e7'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:35:02.275443 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-963f43eb-660f-4b1c-9f87-0947c86488e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1e979042b524c10a912030607010a09', 'request_id': 'req-963f43eb-660f-4b1c-9f87-0947c86488e7'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:35:02.290525 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-963f43eb-660f-4b1c-9f87-0947c86488e7 admin admin] The token cache is being invalidate because project a1e979042b524c10a912030607010a09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:35:02.290811 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-963f43eb-660f-4b1c-9f87-0947c86488e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:35:02.291434 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-963f43eb-660f-4b1c-9f87-0947c86488e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:35:02.293117 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 724/1451] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:35:02 2021] DELETE /identity/v3/projects/a1e979042b524c10a912030607010a09 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:36:23.689608 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19871a-7e44-4542-849f-45b2937f000e None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:23.690167 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19871a-7e44-4542-849f-45b2937f000e None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:23.690167 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19871a-7e44-4542-849f-45b2937f000e None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:23.691922 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 728/1452] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 15 03:36:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:36:23.697318 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5d06b-bc29-404c-821b-2e7c64807b83 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:23.697722 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5d06b-bc29-404c-821b-2e7c64807b83 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:23.697877 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5d06b-bc29-404c-821b-2e7c64807b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:23.717481 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-b7b5d06b-bc29-404c-821b-2e7c64807b83 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:36:23.718713 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-b7b5d06b-bc29-404c-821b-2e7c64807b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:36:23.780767 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 725/1453] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 15 03:36:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:36:23.898646 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b5d8f-20f0-4b21-a450-9f976a7bb3ba None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:23.898930 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b5d8f-20f0-4b21-a450-9f976a7bb3ba None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:23.899208 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b5d8f-20f0-4b21-a450-9f976a7bb3ba None None] PATH_INFO: `/v3` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:23.900535 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 729/1454] 10.222.0.37 () {54 vars in 925 bytes} [Fri Oct 15 03:36:23 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:36:23.907833 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea9d1a-c49d-45d5-877a-499c726b361e None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:23.908127 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea9d1a-c49d-45d5-877a-499c726b361e None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:23.908408 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea9d1a-c49d-45d5-877a-499c726b361e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:23.926697 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-33ea9d1a-c49d-45d5-877a-499c726b361e None None] MFA Rules not processed for user `bffc0480ffb942cdad426195eca0529e`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:36:23.927928 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-33ea9d1a-c49d-45d5-877a-499c726b361e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:36:23.940439 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b5d8f-20f0-4b21-a450-9f976a7bb3ba None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:36:23.942516 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-654b5d8f-20f0-4b21-a450-9f976a7bb3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:36:23.988908 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 726/1455] 10.222.0.37 () {58 vars in 1015 bytes} [Fri Oct 15 03:36:23 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:36:24.017197 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b5d8f-20f0-4b21-a450-9f976a7bb3ba None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:36:24.022579 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9a1aa-f03b-4fde-bc1e-b3a9ce592ac8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:36:24.023220 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9a1aa-f03b-4fde-bc1e-b3a9ce592ac8 service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:24.023512 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9a1aa-f03b-4fde-bc1e-b3a9ce592ac8 service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:24.023832 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9a1aa-f03b-4fde-bc1e-b3a9ce592ac8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:24.032344 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9a1aa-f03b-4fde-bc1e-b3a9ce592ac8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:36:24.033944 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9a1aa-f03b-4fde-bc1e-b3a9ce592ac8 service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:36:24.043143 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 730/1456] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:36:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:36:25.448947 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626dd06-b55f-4132-8e13-684cda5a0a8c None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:25.449539 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626dd06-b55f-4132-8e13-684cda5a0a8c None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:25.449539 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626dd06-b55f-4132-8e13-684cda5a0a8c None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:25.451799 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 727/1457] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 15 03:36:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:36:25.457054 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8f57a-9f2c-4f72-aa0c-0c271e108382 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:25.457467 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8f57a-9f2c-4f72-aa0c-0c271e108382 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:25.457606 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8f57a-9f2c-4f72-aa0c-0c271e108382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:25.476102 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-bcd8f57a-9f2c-4f72-aa0c-0c271e108382 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:36:25.477271 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-bcd8f57a-9f2c-4f72-aa0c-0c271e108382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:36:25.484828 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 731/1458] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 15 03:36:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:36:25.637965 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626dd06-b55f-4132-8e13-684cda5a0a8c None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:36:25.652564 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626dd06-b55f-4132-8e13-684cda5a0a8c None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:36:25.658070 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c6b8a-25e6-460a-a01e-698fa01ff032 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:36:25.658694 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c6b8a-25e6-460a-a01e-698fa01ff032 service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:25.658978 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c6b8a-25e6-460a-a01e-698fa01ff032 service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:25.659249 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c6b8a-25e6-460a-a01e-698fa01ff032 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:25.667185 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c6b8a-25e6-460a-a01e-698fa01ff032 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:36:25.668830 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c6b8a-25e6-460a-a01e-698fa01ff032 service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:36:25.677858 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 728/1459] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:36:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:36:27.627214 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a74f4-dac9-48ed-8aee-72fa44042aba None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:27.627672 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a74f4-dac9-48ed-8aee-72fa44042aba None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:27.627810 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a74f4-dac9-48ed-8aee-72fa44042aba None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:27.629550 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 732/1460] 10.222.0.30 () {54 vars in 960 bytes} [Fri Oct 15 03:36:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:36:27.634758 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be7f27-671f-4aae-b2e7-be28dc0c36b6 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:27.635193 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be7f27-671f-4aae-b2e7-be28dc0c36b6 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:27.635298 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be7f27-671f-4aae-b2e7-be28dc0c36b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:27.652943 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-12be7f27-671f-4aae-b2e7-be28dc0c36b6 None None] MFA Rules not processed for user `bffc0480ffb942cdad426195eca0529e`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:36:27.654094 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-12be7f27-671f-4aae-b2e7-be28dc0c36b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:36:27.662696 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 729/1461] 10.222.0.30 () {58 vars in 1057 bytes} [Fri Oct 15 03:36:27 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:36:27.670827 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a74f4-dac9-48ed-8aee-72fa44042aba None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:36:27.683578 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a74f4-dac9-48ed-8aee-72fa44042aba None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:36:27.689238 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af67685-9d33-4269-81d5-a6cca27cb899 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bffc0480ffb942cdad426195eca0529e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:36:27.689854 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af67685-9d33-4269-81d5-a6cca27cb899 service placement] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:27.690131 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af67685-9d33-4269-81d5-a6cca27cb899 service placement] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:27.690402 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af67685-9d33-4269-81d5-a6cca27cb899 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:27.698492 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af67685-9d33-4269-81d5-a6cca27cb899 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:36:27.700107 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af67685-9d33-4269-81d5-a6cca27cb899 service placement] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:36:27.709231 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 733/1462] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:36:27 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:36:37.504470 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534b0a1-b56f-4f5a-9a08-6cefdcad37aa None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:37.505004 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534b0a1-b56f-4f5a-9a08-6cefdcad37aa None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:37.505004 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534b0a1-b56f-4f5a-9a08-6cefdcad37aa None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:37.506817 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 730/1463] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 15 03:36:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:36:37.512205 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139abb9-d36d-42d1-931d-3c2bcdcb3066 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:37.512648 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139abb9-d36d-42d1-931d-3c2bcdcb3066 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:37.512747 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139abb9-d36d-42d1-931d-3c2bcdcb3066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:37.530926 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-7139abb9-d36d-42d1-931d-3c2bcdcb3066 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:36:37.532137 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-7139abb9-d36d-42d1-931d-3c2bcdcb3066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:36:37.539729 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 734/1464] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 15 03:36:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:36:37.691759 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534b0a1-b56f-4f5a-9a08-6cefdcad37aa None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:36:37.706365 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534b0a1-b56f-4f5a-9a08-6cefdcad37aa None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:36:37.711786 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2da48-6fe7-4c7c-84fa-30b68b91857b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:36:37.712429 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2da48-6fe7-4c7c-84fa-30b68b91857b service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:37.712715 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2da48-6fe7-4c7c-84fa-30b68b91857b service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:37.713014 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2da48-6fe7-4c7c-84fa-30b68b91857b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:37.721450 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2da48-6fe7-4c7c-84fa-30b68b91857b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:36:37.723031 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2da48-6fe7-4c7c-84fa-30b68b91857b service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:36:37.732436 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 731/1465] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:36:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:36:39.145037 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61b482-0cb5-44d1-9cfd-fe4fe3a37d22 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:39.145633 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61b482-0cb5-44d1-9cfd-fe4fe3a37d22 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:39.145633 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61b482-0cb5-44d1-9cfd-fe4fe3a37d22 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:39.147382 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 735/1466] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 15 03:36:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:36:39.152610 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf08a8d-9848-46b3-8250-fcff4f437def None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:39.153041 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf08a8d-9848-46b3-8250-fcff4f437def None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:39.153163 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf08a8d-9848-46b3-8250-fcff4f437def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:39.170633 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-0bf08a8d-9848-46b3-8250-fcff4f437def None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:36:39.171872 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-0bf08a8d-9848-46b3-8250-fcff4f437def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:36:39.179364 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 732/1467] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 15 03:36:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:36:39.332377 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61b482-0cb5-44d1-9cfd-fe4fe3a37d22 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:36:39.346479 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61b482-0cb5-44d1-9cfd-fe4fe3a37d22 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:36:39.351752 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fb06d-262e-48a8-825d-8ff2d2b70742 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:36:39.352369 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fb06d-262e-48a8-825d-8ff2d2b70742 service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:39.352645 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fb06d-262e-48a8-825d-8ff2d2b70742 service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:39.352917 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fb06d-262e-48a8-825d-8ff2d2b70742 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:39.361137 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fb06d-262e-48a8-825d-8ff2d2b70742 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:36:39.362726 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fb06d-262e-48a8-825d-8ff2d2b70742 service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:36:39.371667 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 736/1468] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:36:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:36:43.443272 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2edd4-12c9-4e45-9dd7-a9034981b7ef None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:43.443882 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2edd4-12c9-4e45-9dd7-a9034981b7ef None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:43.443882 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2edd4-12c9-4e45-9dd7-a9034981b7ef None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:43.445920 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 733/1469] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 15 03:36:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:36:43.451722 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188c86e-8f39-4ada-aa49-10acc6f8d1bc None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:43.452169 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188c86e-8f39-4ada-aa49-10acc6f8d1bc None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:43.452288 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188c86e-8f39-4ada-aa49-10acc6f8d1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:43.471446 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-0188c86e-8f39-4ada-aa49-10acc6f8d1bc None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:36:43.472665 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-0188c86e-8f39-4ada-aa49-10acc6f8d1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:36:43.480922 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 737/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 15 03:36:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:36:43.522327 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2edd4-12c9-4e45-9dd7-a9034981b7ef None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:36:43.524194 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-f3e2edd4-12c9-4e45-9dd7-a9034981b7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:36:43.578561 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2edd4-12c9-4e45-9dd7-a9034981b7ef None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:36:43.582033 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65be86b-d3f5-431e-95bb-37b05352ef64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:36:43.582664 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65be86b-d3f5-431e-95bb-37b05352ef64 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:43.582948 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65be86b-d3f5-431e-95bb-37b05352ef64 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:43.583218 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65be86b-d3f5-431e-95bb-37b05352ef64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:43.593222 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65be86b-d3f5-431e-95bb-37b05352ef64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:36:43.594641 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65be86b-d3f5-431e-95bb-37b05352ef64 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:36:43.604027 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 734/1471] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:36:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:36:45.860658 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fe23f-1795-439a-a9f6-0b0478f45cb2 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:45.861227 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fe23f-1795-439a-a9f6-0b0478f45cb2 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:45.861227 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fe23f-1795-439a-a9f6-0b0478f45cb2 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:45.863022 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 738/1472] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 15 03:36:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:36:45.869369 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d48315-c26f-44a4-9ef2-25dd7d84aa97 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:45.869929 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d48315-c26f-44a4-9ef2-25dd7d84aa97 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:45.870035 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d48315-c26f-44a4-9ef2-25dd7d84aa97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:45.887858 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-43d48315-c26f-44a4-9ef2-25dd7d84aa97 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:36:45.889679 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-43d48315-c26f-44a4-9ef2-25dd7d84aa97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:36:45.897528 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 735/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 15 03:36:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:36:45.934548 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fe23f-1795-439a-a9f6-0b0478f45cb2 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:36:45.945367 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fe23f-1795-439a-a9f6-0b0478f45cb2 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:36:45.948814 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bda681-5d03-4bb1-a541-ba0e1726f997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:36:45.949433 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bda681-5d03-4bb1-a541-ba0e1726f997 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:45.949720 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bda681-5d03-4bb1-a541-ba0e1726f997 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:45.949989 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bda681-5d03-4bb1-a541-ba0e1726f997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:45.959229 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bda681-5d03-4bb1-a541-ba0e1726f997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:36:45.960686 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bda681-5d03-4bb1-a541-ba0e1726f997 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:36:45.969968 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 739/1474] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:36:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:36:49.582805 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746b3fe-4d05-4cf4-98eb-4c506acb4ee3 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:49.583331 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746b3fe-4d05-4cf4-98eb-4c506acb4ee3 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:49.583331 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746b3fe-4d05-4cf4-98eb-4c506acb4ee3 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:49.585117 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 736/1475] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 15 03:36:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:36:49.591403 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec08612-ebf5-4da6-afb3-1faf6b5818a9 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:49.591909 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec08612-ebf5-4da6-afb3-1faf6b5818a9 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:49.592023 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec08612-ebf5-4da6-afb3-1faf6b5818a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:49.609440 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-7ec08612-ebf5-4da6-afb3-1faf6b5818a9 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:36:49.610610 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-7ec08612-ebf5-4da6-afb3-1faf6b5818a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:36:49.618248 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 740/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 15 03:36:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:36:49.668680 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746b3fe-4d05-4cf4-98eb-4c506acb4ee3 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:36:49.670313 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-3746b3fe-4d05-4cf4-98eb-4c506acb4ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:36:49.725505 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746b3fe-4d05-4cf4-98eb-4c506acb4ee3 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:36:49.729023 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7491e1-e9f8-4e8c-ab78-4d0adb42a1a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:36:49.729687 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7491e1-e9f8-4e8c-ab78-4d0adb42a1a1 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:49.729970 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7491e1-e9f8-4e8c-ab78-4d0adb42a1a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:49.730245 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7491e1-e9f8-4e8c-ab78-4d0adb42a1a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:49.738861 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7491e1-e9f8-4e8c-ab78-4d0adb42a1a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:36:49.740332 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7491e1-e9f8-4e8c-ab78-4d0adb42a1a1 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:36:49.749975 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 737/1477] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:36:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:36:52.007576 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050adc9-c98d-4402-8635-ebfecf19c0b7 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:52.008180 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050adc9-c98d-4402-8635-ebfecf19c0b7 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:52.008180 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050adc9-c98d-4402-8635-ebfecf19c0b7 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:52.009930 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 741/1478] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 15 03:36:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:36:52.015718 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242129c-6f82-4f53-8b07-ce4dd35c8e86 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:52.016137 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242129c-6f82-4f53-8b07-ce4dd35c8e86 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:52.016287 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242129c-6f82-4f53-8b07-ce4dd35c8e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:52.034521 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-3242129c-6f82-4f53-8b07-ce4dd35c8e86 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:36:52.035855 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-3242129c-6f82-4f53-8b07-ce4dd35c8e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:36:52.043605 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 738/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 15 03:36:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:36:52.099055 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f6722-23e2-41c8-b15f-6e96d352eaa3 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:52.099469 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f6722-23e2-41c8-b15f-6e96d352eaa3 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:52.099889 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f6722-23e2-41c8-b15f-6e96d352eaa3 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:52.101752 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 742/1480] 10.222.0.30 () {54 vars in 962 bytes} [Fri Oct 15 03:36:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:36:52.107025 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07047a0f-4488-4d6a-b77f-cf36d2683d94 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:52.107375 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07047a0f-4488-4d6a-b77f-cf36d2683d94 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:52.108201 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07047a0f-4488-4d6a-b77f-cf36d2683d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:52.125654 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-07047a0f-4488-4d6a-b77f-cf36d2683d94 None None] MFA Rules not processed for user `4edffc4b89f74ce590a2dd7b8fc904bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:36:52.126823 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-07047a0f-4488-4d6a-b77f-cf36d2683d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:36:52.133070 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 739/1481] 10.222.0.30 () {58 vars in 1059 bytes} [Fri Oct 15 03:36:52 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:36:52.141182 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f6722-23e2-41c8-b15f-6e96d352eaa3 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:36:52.151158 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f6722-23e2-41c8-b15f-6e96d352eaa3 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:36:52.155127 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340faff-f89f-454a-972a-186b357c3343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:36:52.155751 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340faff-f89f-454a-972a-186b357c3343 service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:36:52.156033 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340faff-f89f-454a-972a-186b357c3343 service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:36:52.156305 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340faff-f89f-454a-972a-186b357c3343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:36:52.164758 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340faff-f89f-454a-972a-186b357c3343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:36:52.166162 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340faff-f89f-454a-972a-186b357c3343 service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:36:52.175419 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 743/1482] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:36:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:10.935329 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62826e1e-f133-4e39-9aa7-0d080fd0b709 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:10.935954 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62826e1e-f133-4e39-9aa7-0d080fd0b709 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:10.935954 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62826e1e-f133-4e39-9aa7-0d080fd0b709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:10.966018 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-62826e1e-f133-4e39-9aa7-0d080fd0b709 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:10.967358 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-62826e1e-f133-4e39-9aa7-0d080fd0b709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:10.978138 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 740/1483] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:38:10.987357 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c38cc-a75a-48e4-9c04-94f17e2c27a8 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:10.988346 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c38cc-a75a-48e4-9c04-94f17e2c27a8 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:10.988844 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c38cc-a75a-48e4-9c04-94f17e2c27a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.011723 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-7d4c38cc-a75a-48e4-9c04-94f17e2c27a8 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:11.013362 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-7d4c38cc-a75a-48e4-9c04-94f17e2c27a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:11.026313 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 744/1484] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:11.031205 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62826e1e-f133-4e39-9aa7-0d080fd0b709 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:11.045523 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62826e1e-f133-4e39-9aa7-0d080fd0b709 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:11.054119 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471dc75-4eaf-4878-8112-c7bddee5b499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:11.054787 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471dc75-4eaf-4878-8112-c7bddee5b499 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.055070 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471dc75-4eaf-4878-8112-c7bddee5b499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.055347 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471dc75-4eaf-4878-8112-c7bddee5b499 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.056109 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471dc75-4eaf-4878-8112-c7bddee5b499 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:38:11.056417 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471dc75-4eaf-4878-8112-c7bddee5b499 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:11.058044 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471dc75-4eaf-4878-8112-c7bddee5b499 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:11.074665 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 741/1485] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:38:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:38:11.082597 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c38cc-a75a-48e4-9c04-94f17e2c27a8 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:11.093254 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c38cc-a75a-48e4-9c04-94f17e2c27a8 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:11.103549 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf982a0-1bc2-4daf-9ae0-0552c359e2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:11.104522 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf982a0-1bc2-4daf-9ae0-0552c359e2be admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.105031 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf982a0-1bc2-4daf-9ae0-0552c359e2be admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.105540 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf982a0-1bc2-4daf-9ae0-0552c359e2be admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.107345 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf982a0-1bc2-4daf-9ae0-0552c359e2be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:11.109548 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf982a0-1bc2-4daf-9ae0-0552c359e2be admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:11.113738 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f7a01-be15-4faa-9eb9-a47d8b76ab73 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.114033 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f7a01-be15-4faa-9eb9-a47d8b76ab73 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.114313 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f7a01-be15-4faa-9eb9-a47d8b76ab73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.141241 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-bf9f7a01-be15-4faa-9eb9-a47d8b76ab73 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:11.142468 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-bf9f7a01-be15-4faa-9eb9-a47d8b76ab73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:11.156272 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 745/1486] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:11 2021] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:11.156726 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 742/1487] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:38:11.160706 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf982a0-1bc2-4daf-9ae0-0552c359e2be admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:11.169026 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e71541-4be5-48a4-9b51-1bf84ecfa707 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.169324 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e71541-4be5-48a4-9b51-1bf84ecfa707 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.169602 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e71541-4be5-48a4-9b51-1bf84ecfa707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.202801 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-79e71541-4be5-48a4-9b51-1bf84ecfa707 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:11.203457 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-79e71541-4be5-48a4-9b51-1bf84ecfa707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:11.287390 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf982a0-1bc2-4daf-9ae0-0552c359e2be admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:11.303305 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a96c1c-e232-424f-a1c8-86b24fc6765a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:11.303831 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a96c1c-e232-424f-a1c8-86b24fc6765a admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.304117 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a96c1c-e232-424f-a1c8-86b24fc6765a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.304395 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a96c1c-e232-424f-a1c8-86b24fc6765a admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.305174 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a96c1c-e232-424f-a1c8-86b24fc6765a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:11.307085 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a96c1c-e232-424f-a1c8-86b24fc6765a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:11.343670 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 743/1488] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:38:11.345790 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cbe21-c9ec-47bc-bd2e-cd58903260ce None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.346176 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cbe21-c9ec-47bc-bd2e-cd58903260ce None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.346472 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cbe21-c9ec-47bc-bd2e-cd58903260ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.356630 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 746/1489] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:11 2021] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:38:11.357923 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e789d1-fa7c-49f0-8d60-e7534a825d7e None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.358211 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e789d1-fa7c-49f0-8d60-e7534a825d7e None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.358488 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e789d1-fa7c-49f0-8d60-e7534a825d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.378380 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-e34cbe21-c9ec-47bc-bd2e-cd58903260ce None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:11.379578 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e34cbe21-c9ec-47bc-bd2e-cd58903260ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:11.388224 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-17e789d1-fa7c-49f0-8d60-e7534a825d7e None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:11.389906 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-17e789d1-fa7c-49f0-8d60-e7534a825d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:11.397503 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 744/1490] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:11.399971 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cbe21-c9ec-47bc-bd2e-cd58903260ce None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:11.409704 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 747/1491] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:11.410531 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e789d1-fa7c-49f0-8d60-e7534a825d7e None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:11.419472 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cbe21-c9ec-47bc-bd2e-cd58903260ce None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:11.426495 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd51bc0-1778-4d1b-a469-8a162a12120d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:11.427381 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd51bc0-1778-4d1b-a469-8a162a12120d admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.427660 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd51bc0-1778-4d1b-a469-8a162a12120d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.427966 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd51bc0-1778-4d1b-a469-8a162a12120d admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.428705 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd51bc0-1778-4d1b-a469-8a162a12120d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:38:11.429011 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd51bc0-1778-4d1b-a469-8a162a12120d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:11.430639 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd51bc0-1778-4d1b-a469-8a162a12120d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:11.431176 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e789d1-fa7c-49f0-8d60-e7534a825d7e None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:11.441966 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed4283-6b31-40f3-b79f-5f35d70bafdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:11.442639 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed4283-6b31-40f3-b79f-5f35d70bafdd admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.442917 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed4283-6b31-40f3-b79f-5f35d70bafdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.443187 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed4283-6b31-40f3-b79f-5f35d70bafdd admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.443955 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 745/1492] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:38:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:38:11.444074 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed4283-6b31-40f3-b79f-5f35d70bafdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:11.445378 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e8440-60cb-4a6c-af50-76029fdc54a0 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.445668 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e8440-60cb-4a6c-af50-76029fdc54a0 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.445854 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed4283-6b31-40f3-b79f-5f35d70bafdd admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:11.445955 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e8440-60cb-4a6c-af50-76029fdc54a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.460559 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 748/1493] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:11 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:11.461862 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266e191-49d4-4d83-ab3f-bc498f8a83f3 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.462160 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266e191-49d4-4d83-ab3f-bc498f8a83f3 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.462427 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266e191-49d4-4d83-ab3f-bc498f8a83f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.471183 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-c31e8440-60cb-4a6c-af50-76029fdc54a0 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:11.472546 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c31e8440-60cb-4a6c-af50-76029fdc54a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:11.480675 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 746/1494] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:11.482056 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef107b8-2448-4a2d-aea2-2c0f5c11c2fe None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.482479 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef107b8-2448-4a2d-aea2-2c0f5c11c2fe None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.482761 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef107b8-2448-4a2d-aea2-2c0f5c11c2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.489069 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-f266e191-49d4-4d83-ab3f-bc498f8a83f3 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:11.492006 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-f266e191-49d4-4d83-ab3f-bc498f8a83f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:11.502075 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-3ef107b8-2448-4a2d-aea2-2c0f5c11c2fe None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:11.502375 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 749/1495] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:11.503259 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-3ef107b8-2448-4a2d-aea2-2c0f5c11c2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:11.504187 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024cf11-e262-47fa-98e9-995e76bd93ae None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.504694 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024cf11-e262-47fa-98e9-995e76bd93ae None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.505624 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024cf11-e262-47fa-98e9-995e76bd93ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.511652 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 747/1496] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:11.512934 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef107b8-2448-4a2d-aea2-2c0f5c11c2fe None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:11.522558 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef107b8-2448-4a2d-aea2-2c0f5c11c2fe None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:11.523942 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-d024cf11-e262-47fa-98e9-995e76bd93ae None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:11.525106 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-d024cf11-e262-47fa-98e9-995e76bd93ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:11.526963 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f68a8a-0031-44f5-a727-6d23029f6117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:11.527587 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f68a8a-0031-44f5-a727-6d23029f6117 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.528461 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f68a8a-0031-44f5-a727-6d23029f6117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.528735 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f68a8a-0031-44f5-a727-6d23029f6117 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.529418 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f68a8a-0031-44f5-a727-6d23029f6117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:11.531328 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f68a8a-0031-44f5-a727-6d23029f6117 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:11.533546 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 750/1497] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:11.534323 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024cf11-e262-47fa-98e9-995e76bd93ae None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:11.544588 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024cf11-e262-47fa-98e9-995e76bd93ae None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:11.549613 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6c37f-c35a-4612-8f65-01ee6d0d7005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:11.550289 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6c37f-c35a-4612-8f65-01ee6d0d7005 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.550652 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6c37f-c35a-4612-8f65-01ee6d0d7005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.550924 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6c37f-c35a-4612-8f65-01ee6d0d7005 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.551656 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6c37f-c35a-4612-8f65-01ee6d0d7005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:11.553280 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6c37f-c35a-4612-8f65-01ee6d0d7005 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:11.559999 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 748/1498] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:11 2021] POST /identity/v3/projects => generated 405 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:11.559999 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a12a89-ec50-4b5b-ac83-00674cd8f04b None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.559999 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a12a89-ec50-4b5b-ac83-00674cd8f04b None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.559999 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a12a89-ec50-4b5b-ac83-00674cd8f04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.563356 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 751/1499] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:11 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:11.565174 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19055c-1879-4e24-9ff8-62883b09bf75 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.565462 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19055c-1879-4e24-9ff8-62883b09bf75 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.565742 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19055c-1879-4e24-9ff8-62883b09bf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.580028 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-57a12a89-ec50-4b5b-ac83-00674cd8f04b None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:11.581203 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-57a12a89-ec50-4b5b-ac83-00674cd8f04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:11.582861 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-cb19055c-1879-4e24-9ff8-62883b09bf75 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:11.584027 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-cb19055c-1879-4e24-9ff8-62883b09bf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:11.638817 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 749/1500] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:11.640200 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9a057-0e9e-4284-8111-ae164bf25acb None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.640494 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9a057-0e9e-4284-8111-ae164bf25acb None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.640777 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9a057-0e9e-4284-8111-ae164bf25acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.642234 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 752/1501] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:11.643246 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19055c-1879-4e24-9ff8-62883b09bf75 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:11.652410 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19055c-1879-4e24-9ff8-62883b09bf75 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:11.656875 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975952a-4eef-4d17-8e02-2ab0cff9aa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:11.657511 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975952a-4eef-4d17-8e02-2ab0cff9aa68 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.657791 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975952a-4eef-4d17-8e02-2ab0cff9aa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.658064 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975952a-4eef-4d17-8e02-2ab0cff9aa68 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.658254 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-a4d9a057-0e9e-4284-8111-ae164bf25acb None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:11.658791 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975952a-4eef-4d17-8e02-2ab0cff9aa68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:38:11.659093 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975952a-4eef-4d17-8e02-2ab0cff9aa68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:11.659459 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-a4d9a057-0e9e-4284-8111-ae164bf25acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:11.660712 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975952a-4eef-4d17-8e02-2ab0cff9aa68 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:11.667245 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 750/1502] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:11.670995 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9a057-0e9e-4284-8111-ae164bf25acb None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:11.672411 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 753/1503] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:38:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:38:11.673762 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db359553-dca7-4837-81da-4168fa7547a2 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.674233 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db359553-dca7-4837-81da-4168fa7547a2 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.674512 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db359553-dca7-4837-81da-4168fa7547a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.680386 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9a057-0e9e-4284-8111-ae164bf25acb None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:11.685437 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261954f-937f-49a3-8c1d-e4f254affb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:11.686072 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261954f-937f-49a3-8c1d-e4f254affb94 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.686355 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261954f-937f-49a3-8c1d-e4f254affb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.686628 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261954f-937f-49a3-8c1d-e4f254affb94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.687352 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4261954f-937f-49a3-8c1d-e4f254affb94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:38:11.687655 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4261954f-937f-49a3-8c1d-e4f254affb94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:11.689291 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4261954f-937f-49a3-8c1d-e4f254affb94 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:11.695335 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-db359553-dca7-4837-81da-4168fa7547a2 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:11.696536 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-db359553-dca7-4837-81da-4168fa7547a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:11.701004 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 751/1504] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:38:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:38:11.701742 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261954f-937f-49a3-8c1d-e4f254affb94 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:11.710723 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261954f-937f-49a3-8c1d-e4f254affb94 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:11.711999 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 754/1505] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:11.712769 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db359553-dca7-4837-81da-4168fa7547a2 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:11.715630 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbafddc-3a30-4f8a-8316-57af47382fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:11.716287 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbafddc-3a30-4f8a-8316-57af47382fcc admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.716568 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbafddc-3a30-4f8a-8316-57af47382fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.716840 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbafddc-3a30-4f8a-8316-57af47382fcc admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.717524 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbafddc-3a30-4f8a-8316-57af47382fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:11.719419 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbafddc-3a30-4f8a-8316-57af47382fcc admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:11.722078 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db359553-dca7-4837-81da-4168fa7547a2 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:11.726543 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c5f63-c03b-47e6-a45f-1b45aad84223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:11.727389 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c5f63-c03b-47e6-a45f-1b45aad84223 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.727697 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c5f63-c03b-47e6-a45f-1b45aad84223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.727985 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c5f63-c03b-47e6-a45f-1b45aad84223 admin admin] PATH_INFO: `/v3/projects/76d19e2158b04733b678a44fb39408ad/users/2eb9e53f520f443dbc36f68dbe72e5cf/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.739185 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 752/1506] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:11 2021] POST /identity/v3/users => generated 303 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:11.740172 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbafddc-3a30-4f8a-8316-57af47382fcc admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:11.745090 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c5f63-c03b-47e6-a45f-1b45aad84223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d19e2158b04733b678a44fb39408ad, user_id=2eb9e53f520f443dbc36f68dbe72e5cf, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:11.748402 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c5f63-c03b-47e6-a45f-1b45aad84223 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:11.750496 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbafddc-3a30-4f8a-8316-57af47382fcc admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:11.755931 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0d342-2cac-43f2-83e4-5acc9a56a75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:11.756556 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0d342-2cac-43f2-83e4-5acc9a56a75f admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.756839 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0d342-2cac-43f2-83e4-5acc9a56a75f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.757111 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0d342-2cac-43f2-83e4-5acc9a56a75f admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.757826 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0d342-2cac-43f2-83e4-5acc9a56a75f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:38:11.758127 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0d342-2cac-43f2-83e4-5acc9a56a75f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:11.759737 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0d342-2cac-43f2-83e4-5acc9a56a75f admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:11.761705 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 755/1507] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:11 2021] PUT /identity/v3/projects/76d19e2158b04733b678a44fb39408ad/users/2eb9e53f520f443dbc36f68dbe72e5cf/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:11.764105 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1da77c-cfee-4807-bb57-62778a436e99 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.764506 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1da77c-cfee-4807-bb57-62778a436e99 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.764965 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1da77c-cfee-4807-bb57-62778a436e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.779837 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 753/1508] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:38:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:38:11.779837 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3da15-174c-4c08-af0a-69946a857ce1 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.779837 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3da15-174c-4c08-af0a-69946a857ce1 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.779837 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3da15-174c-4c08-af0a-69946a857ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.782351 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-ae1da77c-cfee-4807-bb57-62778a436e99 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:11.783547 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-ae1da77c-cfee-4807-bb57-62778a436e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:11.796219 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-4eb3da15-174c-4c08-af0a-69946a857ce1 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:11.797381 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-4eb3da15-174c-4c08-af0a-69946a857ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:11.839614 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 756/1509] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:11.843657 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1da77c-cfee-4807-bb57-62778a436e99 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:11.849604 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1da77c-cfee-4807-bb57-62778a436e99 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:11.854116 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5be871-c41d-461a-99bb-7f5591575540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:11.854275 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 754/1510] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:11.854744 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5be871-c41d-461a-99bb-7f5591575540 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.855028 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5be871-c41d-461a-99bb-7f5591575540 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.855302 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5be871-c41d-461a-99bb-7f5591575540 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.855761 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3da15-174c-4c08-af0a-69946a857ce1 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:11.856060 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5be871-c41d-461a-99bb-7f5591575540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:11.858184 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5be871-c41d-461a-99bb-7f5591575540 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:11.864648 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3da15-174c-4c08-af0a-69946a857ce1 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:11.869094 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549abe5a-a6a1-4e5c-95a1-2cf61face5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:11.869719 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549abe5a-a6a1-4e5c-95a1-2cf61face5d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.870004 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549abe5a-a6a1-4e5c-95a1-2cf61face5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.870281 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549abe5a-a6a1-4e5c-95a1-2cf61face5d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.871003 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549abe5a-a6a1-4e5c-95a1-2cf61face5d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:11.873741 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549abe5a-a6a1-4e5c-95a1-2cf61face5d5 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:11.886569 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 757/1511] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:11 2021] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:11.886569 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5be871-c41d-461a-99bb-7f5591575540 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:11.899609 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 755/1512] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:11 2021] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:11.900322 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549abe5a-a6a1-4e5c-95a1-2cf61face5d5 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:11.945224 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5be871-c41d-461a-99bb-7f5591575540 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:11.957755 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549abe5a-a6a1-4e5c-95a1-2cf61face5d5 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:11.962369 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b357890-6177-465a-9c1d-7625fef21caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:11.962965 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b357890-6177-465a-9c1d-7625fef21caa admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.963276 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b357890-6177-465a-9c1d-7625fef21caa admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.963550 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b357890-6177-465a-9c1d-7625fef21caa admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:11.964318 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b357890-6177-465a-9c1d-7625fef21caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:11.966203 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b357890-6177-465a-9c1d-7625fef21caa admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:11.975737 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 756/1513] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:11 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:11.976903 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37150d69-af53-4a85-ad60-9e0530f16960 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:11.977196 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37150d69-af53-4a85-ad60-9e0530f16960 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:11.977471 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37150d69-af53-4a85-ad60-9e0530f16960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.001606 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc6698-2e7d-4c44-a2be-92e9787049fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.002255 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc6698-2e7d-4c44-a2be-92e9787049fb admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.002532 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc6698-2e7d-4c44-a2be-92e9787049fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.002800 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc6698-2e7d-4c44-a2be-92e9787049fb admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.002966 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-37150d69-af53-4a85-ad60-9e0530f16960 None None] MFA Rules not processed for user `2eb9e53f520f443dbc36f68dbe72e5cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:12.003521 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc6698-2e7d-4c44-a2be-92e9787049fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:38:12.003927 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc6698-2e7d-4c44-a2be-92e9787049fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.004206 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-37150d69-af53-4a85-ad60-9e0530f16960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:12.005513 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc6698-2e7d-4c44-a2be-92e9787049fb admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.023367 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 758/1514] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:38:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:38:12.023367 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc6698-2e7d-4c44-a2be-92e9787049fb admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.032392 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc6698-2e7d-4c44-a2be-92e9787049fb admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.036871 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894ae09-f00e-4ca6-87da-a47bfbf6b1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.037487 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894ae09-f00e-4ca6-87da-a47bfbf6b1bc admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.037767 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894ae09-f00e-4ca6-87da-a47bfbf6b1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.038040 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894ae09-f00e-4ca6-87da-a47bfbf6b1bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.038717 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894ae09-f00e-4ca6-87da-a47bfbf6b1bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.040606 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894ae09-f00e-4ca6-87da-a47bfbf6b1bc admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.066555 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 757/1515] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:11 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:12.067436 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37150d69-af53-4a85-ad60-9e0530f16960 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.071311 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 759/1516] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:12 2021] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:12.071311 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894ae09-f00e-4ca6-87da-a47bfbf6b1bc admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.080844 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37150d69-af53-4a85-ad60-9e0530f16960 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.132289 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894ae09-f00e-4ca6-87da-a47bfbf6b1bc admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.134594 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a27f0a-95a2-4132-99f8-1cac1a79143d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.135254 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a27f0a-95a2-4132-99f8-1cac1a79143d admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.135540 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a27f0a-95a2-4132-99f8-1cac1a79143d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.135855 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a27f0a-95a2-4132-99f8-1cac1a79143d admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.136581 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a27f0a-95a2-4132-99f8-1cac1a79143d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:38:12.136886 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a27f0a-95a2-4132-99f8-1cac1a79143d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.137024 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226f79d-6e04-495f-a161-94d278192e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.137697 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226f79d-6e04-495f-a161-94d278192e99 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.137976 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226f79d-6e04-495f-a161-94d278192e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.138247 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226f79d-6e04-495f-a161-94d278192e99 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.138886 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a27f0a-95a2-4132-99f8-1cac1a79143d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.138990 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226f79d-6e04-495f-a161-94d278192e99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:38:12.139254 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226f79d-6e04-495f-a161-94d278192e99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.140869 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226f79d-6e04-495f-a161-94d278192e99 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.150172 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 758/1517] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:38:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:38:12.150948 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a27f0a-95a2-4132-99f8-1cac1a79143d admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.158930 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 760/1518] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:38:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:38:12.158930 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226f79d-6e04-495f-a161-94d278192e99 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.162343 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226f79d-6e04-495f-a161-94d278192e99 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.162486 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a27f0a-95a2-4132-99f8-1cac1a79143d admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.166830 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057dce5e-6a97-4669-a654-37708172647b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.166978 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85eae38-5095-41c7-adb9-bf131bdd041c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.167487 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dce5e-6a97-4669-a654-37708172647b admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.167622 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85eae38-5095-41c7-adb9-bf131bdd041c admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.167786 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dce5e-6a97-4669-a654-37708172647b admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.167894 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85eae38-5095-41c7-adb9-bf131bdd041c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.168055 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dce5e-6a97-4669-a654-37708172647b admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.168172 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85eae38-5095-41c7-adb9-bf131bdd041c admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.169240 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057dce5e-6a97-4669-a654-37708172647b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.169363 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85eae38-5095-41c7-adb9-bf131bdd041c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.171116 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057dce5e-6a97-4669-a654-37708172647b admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.171238 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85eae38-5095-41c7-adb9-bf131bdd041c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.191530 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 759/1519] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:12 2021] POST /identity/v3/users => generated 285 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:12.195231 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85eae38-5095-41c7-adb9-bf131bdd041c admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.195360 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 761/1520] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:12 2021] POST /identity/v3/users => generated 289 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:12.195360 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057dce5e-6a97-4669-a654-37708172647b admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.203862 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057dce5e-6a97-4669-a654-37708172647b admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.204292 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85eae38-5095-41c7-adb9-bf131bdd041c admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.209157 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b661e8d-bbac-4c4d-9c14-c7582b51c62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.209294 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649fb80-490c-42ba-a94b-caaa7c4c4646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.209885 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b661e8d-bbac-4c4d-9c14-c7582b51c62d admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.210218 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b661e8d-bbac-4c4d-9c14-c7582b51c62d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.210540 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b661e8d-bbac-4c4d-9c14-c7582b51c62d admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.211264 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b661e8d-bbac-4c4d-9c14-c7582b51c62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.211506 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649fb80-490c-42ba-a94b-caaa7c4c4646 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.213142 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b661e8d-bbac-4c4d-9c14-c7582b51c62d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.213259 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649fb80-490c-42ba-a94b-caaa7c4c4646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.213551 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649fb80-490c-42ba-a94b-caaa7c4c4646 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.214295 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649fb80-490c-42ba-a94b-caaa7c4c4646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.216509 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649fb80-490c-42ba-a94b-caaa7c4c4646 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.223827 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 760/1521] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:12 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:12.224591 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b661e8d-bbac-4c4d-9c14-c7582b51c62d admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.234148 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b661e8d-bbac-4c4d-9c14-c7582b51c62d admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.241323 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde2855-7063-4f21-b11e-24e82d2d6424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.242022 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde2855-7063-4f21-b11e-24e82d2d6424 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.242276 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde2855-7063-4f21-b11e-24e82d2d6424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.242601 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde2855-7063-4f21-b11e-24e82d2d6424 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.243755 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde2855-7063-4f21-b11e-24e82d2d6424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.245226 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde2855-7063-4f21-b11e-24e82d2d6424 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.245497 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 762/1522] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:12 2021] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:12.249488 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc7306-be2e-49d8-bfe7-b79c071ca7d8 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.249777 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc7306-be2e-49d8-bfe7-b79c071ca7d8 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.250052 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc7306-be2e-49d8-bfe7-b79c071ca7d8 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.251894 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 763/1523] 10.222.0.30 () {54 vars in 960 bytes} [Fri Oct 15 03:38:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:38:12.252460 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc7306-be2e-49d8-bfe7-b79c071ca7d8 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.267065 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 761/1524] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:12 2021] POST /identity/v3/users => generated 297 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:12.267892 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde2855-7063-4f21-b11e-24e82d2d6424 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.276869 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde2855-7063-4f21-b11e-24e82d2d6424 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.313681 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc7306-be2e-49d8-bfe7-b79c071ca7d8 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.318161 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a4d3c-0583-42ae-b1bf-54ab3c264846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.318799 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a4d3c-0583-42ae-b1bf-54ab3c264846 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.319106 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a4d3c-0583-42ae-b1bf-54ab3c264846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.319375 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a4d3c-0583-42ae-b1bf-54ab3c264846 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.320102 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a4d3c-0583-42ae-b1bf-54ab3c264846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.322029 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a4d3c-0583-42ae-b1bf-54ab3c264846 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.329927 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15ed0c-5370-448d-95e9-94fcb702c736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.330569 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15ed0c-5370-448d-95e9-94fcb702c736 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.330844 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15ed0c-5370-448d-95e9-94fcb702c736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.331119 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15ed0c-5370-448d-95e9-94fcb702c736 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.331848 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15ed0c-5370-448d-95e9-94fcb702c736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.333714 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15ed0c-5370-448d-95e9-94fcb702c736 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.348944 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 764/1525] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:12 2021] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:12.349922 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a4d3c-0583-42ae-b1bf-54ab3c264846 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.361637 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 762/1526] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:12 2021] POST /identity/v3/projects => generated 389 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:12.362710 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15ed0c-5370-448d-95e9-94fcb702c736 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.409106 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a4d3c-0583-42ae-b1bf-54ab3c264846 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.421168 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15ed0c-5370-448d-95e9-94fcb702c736 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.425813 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686fe1a-03d0-4033-afbf-6387828485d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.426492 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686fe1a-03d0-4033-afbf-6387828485d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.426774 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686fe1a-03d0-4033-afbf-6387828485d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.427051 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686fe1a-03d0-4033-afbf-6387828485d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.427810 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686fe1a-03d0-4033-afbf-6387828485d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.429424 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686fe1a-03d0-4033-afbf-6387828485d0 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.438883 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 763/1527] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:12 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:12.439638 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686fe1a-03d0-4033-afbf-6387828485d0 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.448735 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686fe1a-03d0-4033-afbf-6387828485d0 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.453389 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29ad11-2885-4d90-aca4-0b6f39ec77b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.454217 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29ad11-2885-4d90-aca4-0b6f39ec77b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.454497 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29ad11-2885-4d90-aca4-0b6f39ec77b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.454768 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29ad11-2885-4d90-aca4-0b6f39ec77b5 admin admin] PATH_INFO: `/v3/projects/4520cd6f3a3a4c868dcd285ad7983dd1/users/e7b12405e5814461b1f828f900645f71/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.461438 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b86da-ffdd-4e21-9ddf-599c04db22dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.462102 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b86da-ffdd-4e21-9ddf-599c04db22dd admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.462394 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b86da-ffdd-4e21-9ddf-599c04db22dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.462668 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b86da-ffdd-4e21-9ddf-599c04db22dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.463464 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b86da-ffdd-4e21-9ddf-599c04db22dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.466182 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b86da-ffdd-4e21-9ddf-599c04db22dd admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.469541 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29ad11-2885-4d90-aca4-0b6f39ec77b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4520cd6f3a3a4c868dcd285ad7983dd1, user_id=e7b12405e5814461b1f828f900645f71, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.472429 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29ad11-2885-4d90-aca4-0b6f39ec77b5 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.478785 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 765/1528] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:12 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:12.478785 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b86da-ffdd-4e21-9ddf-599c04db22dd admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.487357 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b86da-ffdd-4e21-9ddf-599c04db22dd admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.489668 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 764/1529] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:12 2021] PUT /identity/v3/projects/4520cd6f3a3a4c868dcd285ad7983dd1/users/e7b12405e5814461b1f828f900645f71/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:12.497027 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858a40b-b684-4272-9ec1-e82bb2ccf6fa None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.497329 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858a40b-b684-4272-9ec1-e82bb2ccf6fa None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.497594 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858a40b-b684-4272-9ec1-e82bb2ccf6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.515028 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-d858a40b-b684-4272-9ec1-e82bb2ccf6fa None None] MFA Rules not processed for user `3d71a1bd93b04249b2b8e6a054de44c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:12.516355 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d858a40b-b684-4272-9ec1-e82bb2ccf6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:12.540789 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0c1fc-9dde-4c70-81e1-4242dbc87d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.541529 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0c1fc-9dde-4c70-81e1-4242dbc87d5d admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.541806 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0c1fc-9dde-4c70-81e1-4242dbc87d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.542075 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0c1fc-9dde-4c70-81e1-4242dbc87d5d admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.542763 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0c1fc-9dde-4c70-81e1-4242dbc87d5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.545312 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0c1fc-9dde-4c70-81e1-4242dbc87d5d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.565097 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 766/1530] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:12 2021] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:12.565882 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0c1fc-9dde-4c70-81e1-4242dbc87d5d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.575413 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0c1fc-9dde-4c70-81e1-4242dbc87d5d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.580178 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd6ba6-6cdb-43be-8515-1a9e0ceb8c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.580813 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd6ba6-6cdb-43be-8515-1a9e0ceb8c4a admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.581098 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd6ba6-6cdb-43be-8515-1a9e0ceb8c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.581374 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd6ba6-6cdb-43be-8515-1a9e0ceb8c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.581476 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 765/1531] 10.222.0.30 () {58 vars in 1057 bytes} [Fri Oct 15 03:38:12 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:12.582105 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd6ba6-6cdb-43be-8515-1a9e0ceb8c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.582254 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858a40b-b684-4272-9ec1-e82bb2ccf6fa None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.583703 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd6ba6-6cdb-43be-8515-1a9e0ceb8c4a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.592775 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858a40b-b684-4272-9ec1-e82bb2ccf6fa None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.597320 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 767/1532] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:12 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:12.597320 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd6ba6-6cdb-43be-8515-1a9e0ceb8c4a admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.598876 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ab171-927f-4eb1-b3f0-817d2d5b8417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.599557 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ab171-927f-4eb1-b3f0-817d2d5b8417 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.599868 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ab171-927f-4eb1-b3f0-817d2d5b8417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.600146 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ab171-927f-4eb1-b3f0-817d2d5b8417 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.600834 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ab171-927f-4eb1-b3f0-817d2d5b8417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.602756 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ab171-927f-4eb1-b3f0-817d2d5b8417 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.604849 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd6ba6-6cdb-43be-8515-1a9e0ceb8c4a admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.610025 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0e537-4a75-4ba2-9ab2-b1b51c5d146b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.610676 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0e537-4a75-4ba2-9ab2-b1b51c5d146b admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.610961 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0e537-4a75-4ba2-9ab2-b1b51c5d146b admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.611238 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0e537-4a75-4ba2-9ab2-b1b51c5d146b admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.611954 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0e537-4a75-4ba2-9ab2-b1b51c5d146b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.614141 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0e537-4a75-4ba2-9ab2-b1b51c5d146b admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.622821 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 766/1533] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:12 2021] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:12.623723 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ab171-927f-4eb1-b3f0-817d2d5b8417 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.633150 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ab171-927f-4eb1-b3f0-817d2d5b8417 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.635648 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 768/1534] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:12 2021] POST /identity/v3/users => generated 295 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:12.636307 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0e537-4a75-4ba2-9ab2-b1b51c5d146b admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.640684 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab747f7-fde3-4584-87d5-b9775296a00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.641320 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab747f7-fde3-4584-87d5-b9775296a00b admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.641600 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab747f7-fde3-4584-87d5-b9775296a00b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.641882 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab747f7-fde3-4584-87d5-b9775296a00b admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.642600 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab747f7-fde3-4584-87d5-b9775296a00b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.644210 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab747f7-fde3-4584-87d5-b9775296a00b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.645539 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0e537-4a75-4ba2-9ab2-b1b51c5d146b admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.650112 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fbba0-6573-47ea-b51b-63aba3e72a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.650743 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fbba0-6573-47ea-b51b-63aba3e72a12 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.651032 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fbba0-6573-47ea-b51b-63aba3e72a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.651308 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fbba0-6573-47ea-b51b-63aba3e72a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.652061 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fbba0-6573-47ea-b51b-63aba3e72a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.654184 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fbba0-6573-47ea-b51b-63aba3e72a12 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.654672 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 767/1535] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:12 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:12.655988 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770abc13-13c4-45f8-a590-9cfd84f0ed26 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.656397 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770abc13-13c4-45f8-a590-9cfd84f0ed26 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.656681 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770abc13-13c4-45f8-a590-9cfd84f0ed26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.667531 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 769/1536] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:12 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:12.668438 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fbba0-6573-47ea-b51b-63aba3e72a12 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.678736 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fbba0-6573-47ea-b51b-63aba3e72a12 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.682319 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-770abc13-13c4-45f8-a590-9cfd84f0ed26 None None] MFA Rules not processed for user `e7b12405e5814461b1f828f900645f71`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:12.683445 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fde128-4daf-423b-bb11-02b98faa1d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.683587 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-770abc13-13c4-45f8-a590-9cfd84f0ed26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:12.684167 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fde128-4daf-423b-bb11-02b98faa1d78 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.684446 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fde128-4daf-423b-bb11-02b98faa1d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.684717 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fde128-4daf-423b-bb11-02b98faa1d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.685551 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fde128-4daf-423b-bb11-02b98faa1d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.687169 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fde128-4daf-423b-bb11-02b98faa1d78 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.696904 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 770/1537] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:12 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:12.697472 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fde128-4daf-423b-bb11-02b98faa1d78 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.710603 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fde128-4daf-423b-bb11-02b98faa1d78 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.717372 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df2ce6-f2b8-4def-a46a-a672df4eceee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.717920 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df2ce6-f2b8-4def-a46a-a672df4eceee service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.718199 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df2ce6-f2b8-4def-a46a-a672df4eceee service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.718471 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df2ce6-f2b8-4def-a46a-a672df4eceee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.745225 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 768/1538] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:12 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:12.746378 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770abc13-13c4-45f8-a590-9cfd84f0ed26 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.756351 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770abc13-13c4-45f8-a590-9cfd84f0ed26 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.760904 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003a718-8de8-4e88-bfdc-b85479f34cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.761575 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003a718-8de8-4e88-bfdc-b85479f34cbe admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.761869 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003a718-8de8-4e88-bfdc-b85479f34cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.762821 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003a718-8de8-4e88-bfdc-b85479f34cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.763745 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003a718-8de8-4e88-bfdc-b85479f34cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.765436 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003a718-8de8-4e88-bfdc-b85479f34cbe admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.772354 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df2ce6-f2b8-4def-a46a-a672df4eceee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.773941 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df2ce6-f2b8-4def-a46a-a672df4eceee service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.775079 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 769/1539] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:12 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:12.775895 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003a718-8de8-4e88-bfdc-b85479f34cbe admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.783721 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 771/1540] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:12 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:12.784556 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df2ce6-f2b8-4def-a46a-a672df4eceee service nova] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.785699 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003a718-8de8-4e88-bfdc-b85479f34cbe admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.790233 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e505c2-087e-4e5b-8ba3-0bfa212fe789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.790867 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e505c2-087e-4e5b-8ba3-0bfa212fe789 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.791151 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e505c2-087e-4e5b-8ba3-0bfa212fe789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.791431 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e505c2-087e-4e5b-8ba3-0bfa212fe789 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.792174 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e505c2-087e-4e5b-8ba3-0bfa212fe789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.793782 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e505c2-087e-4e5b-8ba3-0bfa212fe789 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.794883 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df2ce6-f2b8-4def-a46a-a672df4eceee service nova] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.799409 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e531702-5bf2-4ea2-8e89-acfea13265dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.800070 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e531702-5bf2-4ea2-8e89-acfea13265dd admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.800350 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e531702-5bf2-4ea2-8e89-acfea13265dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.800627 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e531702-5bf2-4ea2-8e89-acfea13265dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.801340 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e531702-5bf2-4ea2-8e89-acfea13265dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.802877 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e531702-5bf2-4ea2-8e89-acfea13265dd admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.806858 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 770/1541] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:12 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:12.806858 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e505c2-087e-4e5b-8ba3-0bfa212fe789 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.814242 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e505c2-087e-4e5b-8ba3-0bfa212fe789 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.818436 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 772/1542] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:12 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:12.818436 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e531702-5bf2-4ea2-8e89-acfea13265dd admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.821759 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b5e66-ebff-450e-8cb4-7699fc7f92d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.822648 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b5e66-ebff-450e-8cb4-7699fc7f92d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.822934 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b5e66-ebff-450e-8cb4-7699fc7f92d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.823210 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b5e66-ebff-450e-8cb4-7699fc7f92d1 admin admin] PATH_INFO: `/v3/projects/0e3771e448cc4b798d048ac3fa182787/users/8e8c979ab68548b082f33bfb215c7713/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.827407 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e531702-5bf2-4ea2-8e89-acfea13265dd admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.831407 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade122a4-8bf7-42b3-8799-dfbcf960240d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.832332 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade122a4-8bf7-42b3-8799-dfbcf960240d admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.832614 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade122a4-8bf7-42b3-8799-dfbcf960240d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.832890 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade122a4-8bf7-42b3-8799-dfbcf960240d admin admin] PATH_INFO: `/v3/projects/bee86348280a4baf80a46110898eeba7/users/68db45fc6ca04edca942fce2078fda9e/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.839086 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b5e66-ebff-450e-8cb4-7699fc7f92d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e3771e448cc4b798d048ac3fa182787, user_id=8e8c979ab68548b082f33bfb215c7713, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.844594 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b5e66-ebff-450e-8cb4-7699fc7f92d1 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.848194 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade122a4-8bf7-42b3-8799-dfbcf960240d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bee86348280a4baf80a46110898eeba7, user_id=68db45fc6ca04edca942fce2078fda9e, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.850857 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade122a4-8bf7-42b3-8799-dfbcf960240d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.861052 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 771/1543] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:12 2021] PUT /identity/v3/projects/0e3771e448cc4b798d048ac3fa182787/users/8e8c979ab68548b082f33bfb215c7713/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:12.862117 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b5e66-ebff-450e-8cb4-7699fc7f92d1 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.868021 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 773/1544] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:12 2021] PUT /identity/v3/projects/bee86348280a4baf80a46110898eeba7/users/68db45fc6ca04edca942fce2078fda9e/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:12.868840 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade122a4-8bf7-42b3-8799-dfbcf960240d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.924658 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b5e66-ebff-450e-8cb4-7699fc7f92d1 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.929436 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45477050-295d-4a4d-a131-57dd8b95ccfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.929796 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade122a4-8bf7-42b3-8799-dfbcf960240d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.930251 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45477050-295d-4a4d-a131-57dd8b95ccfc admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.930608 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45477050-295d-4a4d-a131-57dd8b95ccfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.930961 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45477050-295d-4a4d-a131-57dd8b95ccfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.931788 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45477050-295d-4a4d-a131-57dd8b95ccfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.933466 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45477050-295d-4a4d-a131-57dd8b95ccfc admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.934364 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2836117-d361-4566-b291-0e1b2f71546c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.934999 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2836117-d361-4566-b291-0e1b2f71546c admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.935279 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2836117-d361-4566-b291-0e1b2f71546c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.935547 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2836117-d361-4566-b291-0e1b2f71546c admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.936275 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2836117-d361-4566-b291-0e1b2f71546c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.938180 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2836117-d361-4566-b291-0e1b2f71546c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:12.944000 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 772/1545] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:12 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:12.948151 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45477050-295d-4a4d-a131-57dd8b95ccfc admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.958903 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45477050-295d-4a4d-a131-57dd8b95ccfc admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:12.964109 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3cde74-ee23-4e78-8d98-9f3d810dd97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:12.964992 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cde74-ee23-4e78-8d98-9f3d810dd97e admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:12.966087 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cde74-ee23-4e78-8d98-9f3d810dd97e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:12.966376 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cde74-ee23-4e78-8d98-9f3d810dd97e admin admin] PATH_INFO: `/v3/projects/d6c17981f1ce4d7c88b53e155ea14ad2/users/3c20f31a1826483ca92b923482984d5b/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:12.970996 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 774/1546] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:12 2021] POST /identity/v3/projects => generated 403 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:12.970996 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2836117-d361-4566-b291-0e1b2f71546c admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:12.983478 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3cde74-ee23-4e78-8d98-9f3d810dd97e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c17981f1ce4d7c88b53e155ea14ad2, user_id=3c20f31a1826483ca92b923482984d5b, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:12.986200 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3cde74-ee23-4e78-8d98-9f3d810dd97e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:13.000119 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 773/1547] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:12 2021] PUT /identity/v3/projects/d6c17981f1ce4d7c88b53e155ea14ad2/users/3c20f31a1826483ca92b923482984d5b/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:13.000497 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3cde74-ee23-4e78-8d98-9f3d810dd97e admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:13.039639 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2836117-d361-4566-b291-0e1b2f71546c admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:13.059409 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3cde74-ee23-4e78-8d98-9f3d810dd97e admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:13.064398 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a2d7e-374e-4c2e-9f07-78131ad44350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:13.065053 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a2d7e-374e-4c2e-9f07-78131ad44350 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:13.065333 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a2d7e-374e-4c2e-9f07-78131ad44350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:13.065603 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a2d7e-374e-4c2e-9f07-78131ad44350 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:13.066322 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a2d7e-374e-4c2e-9f07-78131ad44350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:13.068012 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a2d7e-374e-4c2e-9f07-78131ad44350 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:13.078003 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 774/1548] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:12 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:13.079257 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5cef1-69e5-44f3-bde4-8512edda95f1 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:13.079542 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5cef1-69e5-44f3-bde4-8512edda95f1 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:13.079841 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5cef1-69e5-44f3-bde4-8512edda95f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:13.093055 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9cdc9-78a1-4b82-a2b2-1182ac6278d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:13.093709 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9cdc9-78a1-4b82-a2b2-1182ac6278d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:13.094014 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9cdc9-78a1-4b82-a2b2-1182ac6278d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:13.094287 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9cdc9-78a1-4b82-a2b2-1182ac6278d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:13.095015 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9cdc9-78a1-4b82-a2b2-1182ac6278d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:13.096655 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9cdc9-78a1-4b82-a2b2-1182ac6278d8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:13.097170 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-2aa5cef1-69e5-44f3-bde4-8512edda95f1 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:13.098342 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-2aa5cef1-69e5-44f3-bde4-8512edda95f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:13.105684 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 775/1549] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:13.109127 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 775/1550] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:12 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:13.109774 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b69df-8f24-48a9-bec4-815b8ce51431 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:13.109878 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9cdc9-78a1-4b82-a2b2-1182ac6278d8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:13.109978 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b69df-8f24-48a9-bec4-815b8ce51431 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:13.109978 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b69df-8f24-48a9-bec4-815b8ce51431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:13.121155 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9cdc9-78a1-4b82-a2b2-1182ac6278d8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:13.126307 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80666031-9b9a-4425-973b-316126206ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:13.127178 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80666031-9b9a-4425-973b-316126206ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:13.127461 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80666031-9b9a-4425-973b-316126206ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:13.127770 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80666031-9b9a-4425-973b-316126206ab8 admin admin] PATH_INFO: `/v3/projects/2c374ecfb00a444d87fbdb2fb3a5b4fa/users/af43d0550c134da3b407e977b8447fc7/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:13.133407 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-c05b69df-8f24-48a9-bec4-815b8ce51431 None None] MFA Rules not processed for user `68db45fc6ca04edca942fce2078fda9e`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:13.134590 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c05b69df-8f24-48a9-bec4-815b8ce51431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:13.142262 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80666031-9b9a-4425-973b-316126206ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c374ecfb00a444d87fbdb2fb3a5b4fa, user_id=af43d0550c134da3b407e977b8447fc7, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:13.144964 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80666031-9b9a-4425-973b-316126206ab8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:13.157871 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 776/1551] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:13 2021] PUT /identity/v3/projects/2c374ecfb00a444d87fbdb2fb3a5b4fa/users/af43d0550c134da3b407e977b8447fc7/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:13.158743 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80666031-9b9a-4425-973b-316126206ab8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:13.196584 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 776/1552] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:13 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:13.200925 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dcf62-da25-4d89-8368-0bdf2f7fdf6c None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:13.200925 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dcf62-da25-4d89-8368-0bdf2f7fdf6c None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:13.200925 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dcf62-da25-4d89-8368-0bdf2f7fdf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:13.220572 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80666031-9b9a-4425-973b-316126206ab8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:13.225146 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-ba4dcf62-da25-4d89-8368-0bdf2f7fdf6c None None] MFA Rules not processed for user `3c20f31a1826483ca92b923482984d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:13.225285 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add5dd7-c63c-4203-850b-d54b519f00c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:13.225916 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add5dd7-c63c-4203-850b-d54b519f00c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:13.226199 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add5dd7-c63c-4203-850b-d54b519f00c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:13.226428 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-ba4dcf62-da25-4d89-8368-0bdf2f7fdf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:13.226528 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add5dd7-c63c-4203-850b-d54b519f00c3 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:13.227171 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add5dd7-c63c-4203-850b-d54b519f00c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:13.229140 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add5dd7-c63c-4203-850b-d54b519f00c3 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:13.254701 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 777/1553] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:13 2021] POST /identity/v3/users => generated 308 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:13.256243 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cd70c-3bc7-47d3-af30-e22f9bf1d724 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:13.256525 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cd70c-3bc7-47d3-af30-e22f9bf1d724 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:13.256798 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cd70c-3bc7-47d3-af30-e22f9bf1d724 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:13.258517 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 778/1554] 10.222.0.30 () {54 vars in 912 bytes} [Fri Oct 15 03:38:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:38:13.259244 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cd70c-3bc7-47d3-af30-e22f9bf1d724 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:13.272061 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cd70c-3bc7-47d3-af30-e22f9bf1d724 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:13.276790 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b0a90-0cfc-4900-9812-647194bf96b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:13.277631 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b0a90-0cfc-4900-9812-647194bf96b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:13.277937 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b0a90-0cfc-4900-9812-647194bf96b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:13.278213 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b0a90-0cfc-4900-9812-647194bf96b1 admin admin] PATH_INFO: `/v3/projects/5b4923cacd2a4baea3b5dcf9522e9b54/users/d795b4264cbe4aff82f5a2b0275ca972/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:13.292745 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b0a90-0cfc-4900-9812-647194bf96b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b4923cacd2a4baea3b5dcf9522e9b54, user_id=d795b4264cbe4aff82f5a2b0275ca972, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:13.295421 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b0a90-0cfc-4900-9812-647194bf96b1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:13.297428 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 777/1555] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:13 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:13.298379 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dcf62-da25-4d89-8368-0bdf2f7fdf6c None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:13.308623 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dcf62-da25-4d89-8368-0bdf2f7fdf6c None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:13.310877 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 779/1556] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:13 2021] PUT /identity/v3/projects/5b4923cacd2a4baea3b5dcf9522e9b54/users/d795b4264cbe4aff82f5a2b0275ca972/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:13.311697 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b0a90-0cfc-4900-9812-647194bf96b1 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:13.362291 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b0a90-0cfc-4900-9812-647194bf96b1 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:13.362668 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407266c-9f40-42b0-9e23-4acb9eb8eacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:13.363543 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407266c-9f40-42b0-9e23-4acb9eb8eacd admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:13.363858 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407266c-9f40-42b0-9e23-4acb9eb8eacd admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:13.364127 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407266c-9f40-42b0-9e23-4acb9eb8eacd admin admin] PATH_INFO: `/v3/projects/fca42958bf634cd8be46887a2580f4cc/users/f1f3db9250cc4edbacb392d5d0d18e08/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:13.366215 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d9374-7d7d-44d2-a19b-38f30619080e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:13.366876 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d9374-7d7d-44d2-a19b-38f30619080e service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:13.367160 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d9374-7d7d-44d2-a19b-38f30619080e service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:13.367441 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d9374-7d7d-44d2-a19b-38f30619080e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:13.376810 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d9374-7d7d-44d2-a19b-38f30619080e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:13.378236 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d9374-7d7d-44d2-a19b-38f30619080e service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:13.378726 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407266c-9f40-42b0-9e23-4acb9eb8eacd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fca42958bf634cd8be46887a2580f4cc, user_id=f1f3db9250cc4edbacb392d5d0d18e08, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:13.381426 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407266c-9f40-42b0-9e23-4acb9eb8eacd admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:13.388490 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 780/1557] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:13.389864 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c68ae5-0cbf-4ca2-8619-087031c78dc4 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:13.390135 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c68ae5-0cbf-4ca2-8619-087031c78dc4 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:13.390452 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c68ae5-0cbf-4ca2-8619-087031c78dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:13.396831 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 778/1558] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:13 2021] PUT /identity/v3/projects/fca42958bf634cd8be46887a2580f4cc/users/f1f3db9250cc4edbacb392d5d0d18e08/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:13.397831 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407266c-9f40-42b0-9e23-4acb9eb8eacd admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:13.417817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-22c68ae5-0cbf-4ca2-8619-087031c78dc4 None None] MFA Rules not processed for user `af43d0550c134da3b407e977b8447fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:13.419150 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-22c68ae5-0cbf-4ca2-8619-087031c78dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:13.462938 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407266c-9f40-42b0-9e23-4acb9eb8eacd admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:13.468180 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f3663-6ce3-4f5d-abb9-98c8a5097061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:13.468917 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f3663-6ce3-4f5d-abb9-98c8a5097061 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:13.469194 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f3663-6ce3-4f5d-abb9-98c8a5097061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:13.469527 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f3663-6ce3-4f5d-abb9-98c8a5097061 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:13.470215 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f3663-6ce3-4f5d-abb9-98c8a5097061 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:13.472181 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f3663-6ce3-4f5d-abb9-98c8a5097061 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:13.485184 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 781/1559] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:13 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:13.485707 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c68ae5-0cbf-4ca2-8619-087031c78dc4 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:13.497358 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c68ae5-0cbf-4ca2-8619-087031c78dc4 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:13.502324 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c606d-f8aa-40a9-b3f3-936317afe5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:13.503055 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c606d-f8aa-40a9-b3f3-936317afe5ea admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:13.503309 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c606d-f8aa-40a9-b3f3-936317afe5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:13.503587 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c606d-f8aa-40a9-b3f3-936317afe5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:13.504373 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c606d-f8aa-40a9-b3f3-936317afe5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:13.508966 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 779/1560] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:13 2021] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:13.509133 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c606d-f8aa-40a9-b3f3-936317afe5ea admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:13.509230 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac36ac2-0096-45db-864d-6a652e547579 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:13.509230 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac36ac2-0096-45db-864d-6a652e547579 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:13.509230 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac36ac2-0096-45db-864d-6a652e547579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:13.519781 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 782/1561] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:13 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:13.519781 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c606d-f8aa-40a9-b3f3-936317afe5ea admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:13.528645 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c606d-f8aa-40a9-b3f3-936317afe5ea admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:13.529246 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-1ac36ac2-0096-45db-864d-6a652e547579 None None] MFA Rules not processed for user `3d71a1bd93b04249b2b8e6a054de44c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:13.530607 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-1ac36ac2-0096-45db-864d-6a652e547579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:13.588683 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d19d1-a784-4bf7-951f-43572271fa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:13.589351 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d19d1-a784-4bf7-951f-43572271fa46 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:13.589632 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d19d1-a784-4bf7-951f-43572271fa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:13.589902 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d19d1-a784-4bf7-951f-43572271fa46 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:13.590898 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d19d1-a784-4bf7-951f-43572271fa46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:13.593634 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d19d1-a784-4bf7-951f-43572271fa46 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:13.618763 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 780/1562] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Oct 15 03:38:13 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:13.620684 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a807c92-66da-4371-a10c-d6042b152c6d None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:13.621235 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a807c92-66da-4371-a10c-d6042b152c6d None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:13.622224 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a807c92-66da-4371-a10c-d6042b152c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:13.623241 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 783/1563] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:13 2021] POST /identity/v3/projects => generated 393 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:13.627519 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32728105-67a2-412a-b0a6-772552f0c2e5 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:13.627839 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32728105-67a2-412a-b0a6-772552f0c2e5 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:13.628307 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32728105-67a2-412a-b0a6-772552f0c2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:13.646253 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-32728105-67a2-412a-b0a6-772552f0c2e5 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:13.646808 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-7a807c92-66da-4371-a10c-d6042b152c6d None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:13.647437 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-32728105-67a2-412a-b0a6-772552f0c2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:13.648768 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7a807c92-66da-4371-a10c-d6042b152c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:13.717390 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 781/1564] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:13.719042 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb4253-825b-4214-aabd-0c3dd9458438 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:13.719615 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb4253-825b-4214-aabd-0c3dd9458438 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:13.720288 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb4253-825b-4214-aabd-0c3dd9458438 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:13.722668 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 782/1565] 10.222.0.30 () {54 vars in 960 bytes} [Fri Oct 15 03:38:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:38:13.723785 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb4253-825b-4214-aabd-0c3dd9458438 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:13.723917 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 784/1566] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:13.724990 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32728105-67a2-412a-b0a6-772552f0c2e5 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:13.739486 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32728105-67a2-412a-b0a6-772552f0c2e5 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:13.739828 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb4253-825b-4214-aabd-0c3dd9458438 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:13.746163 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6210e-0ec6-48a1-8c95-bab249a55663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:13.747334 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1120e3-cba9-4671-aa87-b1bac54c83b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:13.747604 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6210e-0ec6-48a1-8c95-bab249a55663 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:13.748311 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1120e3-cba9-4671-aa87-b1bac54c83b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:13.748596 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1120e3-cba9-4671-aa87-b1bac54c83b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:13.748868 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1120e3-cba9-4671-aa87-b1bac54c83b9 admin admin] PATH_INFO: `/v3/projects/fc3d91935c744028bd11174eceb1858c/users/da2f5a7f2f394f8b8b4686961d96a9f2/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:13.755809 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6210e-0ec6-48a1-8c95-bab249a55663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:13.756333 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6210e-0ec6-48a1-8c95-bab249a55663 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:13.757849 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6210e-0ec6-48a1-8c95-bab249a55663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:13.760826 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6210e-0ec6-48a1-8c95-bab249a55663 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:13.765872 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1120e3-cba9-4671-aa87-b1bac54c83b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc3d91935c744028bd11174eceb1858c, user_id=da2f5a7f2f394f8b8b4686961d96a9f2, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:13.769010 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1120e3-cba9-4671-aa87-b1bac54c83b9 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:13.790553 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 785/1567] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:13 2021] PUT /identity/v3/projects/fc3d91935c744028bd11174eceb1858c/users/da2f5a7f2f394f8b8b4686961d96a9f2/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:13.790553 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1120e3-cba9-4671-aa87-b1bac54c83b9 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:13.794740 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 783/1568] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:13 2021] POST /identity/v3/users => generated 291 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:13.796434 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6210e-0ec6-48a1-8c95-bab249a55663 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:13.862201 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6210e-0ec6-48a1-8c95-bab249a55663 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:13.864548 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1120e3-cba9-4671-aa87-b1bac54c83b9 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:13.869232 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f748f-7813-44b4-afab-990fd93faeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:13.869899 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f748f-7813-44b4-afab-990fd93faeca admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:13.870179 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f748f-7813-44b4-afab-990fd93faeca admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:13.870452 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f748f-7813-44b4-afab-990fd93faeca admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:13.871150 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f748f-7813-44b4-afab-990fd93faeca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:13.873121 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f748f-7813-44b4-afab-990fd93faeca admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:13.895480 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 786/1569] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:13 2021] POST /identity/v3/users => generated 303 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:13.896809 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6d280-3129-41d0-a529-9cfc224dbbb5 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:13.897102 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6d280-3129-41d0-a529-9cfc224dbbb5 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:13.897391 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6d280-3129-41d0-a529-9cfc224dbbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:13.915857 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-bbf6d280-3129-41d0-a529-9cfc224dbbb5 None None] MFA Rules not processed for user `3d71a1bd93b04249b2b8e6a054de44c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:13.916103 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55440184-f901-4a4d-be57-e80100b31129 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:13.916526 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55440184-f901-4a4d-be57-e80100b31129 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:13.916810 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55440184-f901-4a4d-be57-e80100b31129 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:13.917087 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55440184-f901-4a4d-be57-e80100b31129 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:13.918132 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-bbf6d280-3129-41d0-a529-9cfc224dbbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:13.985397 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55440184-f901-4a4d-be57-e80100b31129 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:13.986915 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55440184-f901-4a4d-be57-e80100b31129 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:13.993279 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 787/1570] 10.222.0.30 () {58 vars in 1057 bytes} [Fri Oct 15 03:38:13 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:13.994006 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6d280-3129-41d0-a529-9cfc224dbbb5 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:14.005875 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 784/1571] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:13 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:14.006590 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55440184-f901-4a4d-be57-e80100b31129 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:14.057797 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6d280-3129-41d0-a529-9cfc224dbbb5 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:14.061822 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21a689-830e-4bb1-8923-5419d25b23fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:14.062716 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21a689-830e-4bb1-8923-5419d25b23fb service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:14.063091 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21a689-830e-4bb1-8923-5419d25b23fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:14.063471 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21a689-830e-4bb1-8923-5419d25b23fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:14.067139 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55440184-f901-4a4d-be57-e80100b31129 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:14.075081 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21a689-830e-4bb1-8923-5419d25b23fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:14.076635 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21a689-830e-4bb1-8923-5419d25b23fb service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:14.076883 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f5524-a08d-4c45-b606-2227b6f5d225 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:14.077600 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f5524-a08d-4c45-b606-2227b6f5d225 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:14.078494 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f5524-a08d-4c45-b606-2227b6f5d225 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:14.079818 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f5524-a08d-4c45-b606-2227b6f5d225 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:14.087772 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 788/1572] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:14.088580 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21a689-830e-4bb1-8923-5419d25b23fb service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:14.098080 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f5524-a08d-4c45-b606-2227b6f5d225 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:14.099404 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21a689-830e-4bb1-8923-5419d25b23fb service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:14.099666 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f5524-a08d-4c45-b606-2227b6f5d225 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:14.107031 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2003a7-c33a-4771-a361-b783606596d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:14.107625 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2003a7-c33a-4771-a361-b783606596d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:14.108033 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2003a7-c33a-4771-a361-b783606596d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:14.108399 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2003a7-c33a-4771-a361-b783606596d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:14.109976 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2003a7-c33a-4771-a361-b783606596d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:14.113948 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2003a7-c33a-4771-a361-b783606596d5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:14.122799 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 785/1573] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:14.123809 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f5524-a08d-4c45-b606-2227b6f5d225 service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:14.134060 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f5524-a08d-4c45-b606-2227b6f5d225 service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:14.140049 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf093b-9069-484a-a849-4e5beb244e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:14.140822 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf093b-9069-484a-a849-4e5beb244e25 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:14.141172 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf093b-9069-484a-a849-4e5beb244e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:14.141452 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf093b-9069-484a-a849-4e5beb244e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:14.142348 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf093b-9069-484a-a849-4e5beb244e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:14.143979 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 789/1574] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:14 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:14.144343 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf093b-9069-484a-a849-4e5beb244e25 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:14.148627 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2003a7-c33a-4771-a361-b783606596d5 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:14.167312 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2003a7-c33a-4771-a361-b783606596d5 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:14.167660 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 786/1575] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:14 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:14.169229 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf093b-9069-484a-a849-4e5beb244e25 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:14.184752 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96df0e-3f3a-4596-9f8e-da251d6c6c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:14.185848 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96df0e-3f3a-4596-9f8e-da251d6c6c32 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:14.185848 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96df0e-3f3a-4596-9f8e-da251d6c6c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:14.186114 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96df0e-3f3a-4596-9f8e-da251d6c6c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:14.186824 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96df0e-3f3a-4596-9f8e-da251d6c6c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:14.187253 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf093b-9069-484a-a849-4e5beb244e25 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:14.188454 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96df0e-3f3a-4596-9f8e-da251d6c6c32 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:14.195523 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e78f7-44c0-4595-9bdd-53ee0db8a32e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:14.196313 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e78f7-44c0-4595-9bdd-53ee0db8a32e service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:14.196689 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e78f7-44c0-4595-9bdd-53ee0db8a32e service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:14.196972 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e78f7-44c0-4595-9bdd-53ee0db8a32e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:14.213391 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 790/1576] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:14 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:14.214289 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96df0e-3f3a-4596-9f8e-da251d6c6c32 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:14.234561 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96df0e-3f3a-4596-9f8e-da251d6c6c32 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:14.247541 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871ca93-8ff8-4105-97f2-c37c059900bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:14.248464 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871ca93-8ff8-4105-97f2-c37c059900bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:14.248800 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871ca93-8ff8-4105-97f2-c37c059900bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:14.249080 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871ca93-8ff8-4105-97f2-c37c059900bc admin admin] PATH_INFO: `/v3/projects/fc3d91935c744028bd11174eceb1858c/users/da2f5a7f2f394f8b8b4686961d96a9f2/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:14.254410 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871ca93-8ff8-4105-97f2-c37c059900bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc3d91935c744028bd11174eceb1858c, user_id=da2f5a7f2f394f8b8b4686961d96a9f2, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:14.257124 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871ca93-8ff8-4105-97f2-c37c059900bc admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:14.275882 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e78f7-44c0-4595-9bdd-53ee0db8a32e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:14.279052 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e78f7-44c0-4595-9bdd-53ee0db8a32e service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:14.283465 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 791/1577] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:14 2021] PUT /identity/v3/projects/fc3d91935c744028bd11174eceb1858c/users/da2f5a7f2f394f8b8b4686961d96a9f2/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:14.285004 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3522b-fa49-4b10-a884-7699a18af677 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:14.285291 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3522b-fa49-4b10-a884-7699a18af677 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:14.285562 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3522b-fa49-4b10-a884-7699a18af677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:14.303734 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 787/1578] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:14 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:14.304691 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e78f7-44c0-4595-9bdd-53ee0db8a32e service nova] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:14.314084 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-33e3522b-fa49-4b10-a884-7699a18af677 None None] MFA Rules not processed for user `8e8c979ab68548b082f33bfb215c7713`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:14.315480 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-33e3522b-fa49-4b10-a884-7699a18af677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:14.332084 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e78f7-44c0-4595-9bdd-53ee0db8a32e service nova] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:14.406895 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 792/1579] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:14 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:14.408004 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3522b-fa49-4b10-a884-7699a18af677 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:14.469306 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd126f-8efe-4328-a185-75909ec1ebc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:14.470213 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd126f-8efe-4328-a185-75909ec1ebc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:14.470498 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd126f-8efe-4328-a185-75909ec1ebc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:14.470777 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd126f-8efe-4328-a185-75909ec1ebc1 admin admin] PATH_INFO: `/v3/projects/549ad010d4024b1796ab101e294d003b/users/10f040fd444f43099ab3d8a51af8662f/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:14.505651 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd126f-8efe-4328-a185-75909ec1ebc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=549ad010d4024b1796ab101e294d003b, user_id=10f040fd444f43099ab3d8a51af8662f, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:14.506901 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3522b-fa49-4b10-a884-7699a18af677 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:14.508602 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd126f-8efe-4328-a185-75909ec1ebc1 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:14.514792 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6353fc-2db1-42ad-8996-e0a44eb5cf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:14.516175 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6353fc-2db1-42ad-8996-e0a44eb5cf57 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:14.516719 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6353fc-2db1-42ad-8996-e0a44eb5cf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:14.517165 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6353fc-2db1-42ad-8996-e0a44eb5cf57 admin admin] PATH_INFO: `/v3/projects/9f9d1510272545d0a45b7383be9a447c/users/b71534cddaeb42589af7acf42c690adf/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:14.533846 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 788/1580] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:14 2021] PUT /identity/v3/projects/549ad010d4024b1796ab101e294d003b/users/10f040fd444f43099ab3d8a51af8662f/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:14.535177 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbefca-54cb-492b-82e2-c720ce04da69 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:14.535462 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbefca-54cb-492b-82e2-c720ce04da69 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:14.535854 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbefca-54cb-492b-82e2-c720ce04da69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:14.550229 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6353fc-2db1-42ad-8996-e0a44eb5cf57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f9d1510272545d0a45b7383be9a447c, user_id=b71534cddaeb42589af7acf42c690adf, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:14.553504 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6353fc-2db1-42ad-8996-e0a44eb5cf57 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:14.580468 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 793/1581] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:14 2021] PUT /identity/v3/projects/9f9d1510272545d0a45b7383be9a447c/users/b71534cddaeb42589af7acf42c690adf/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:14.584622 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dc987-0261-4a65-845b-58cd597630b5 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:14.584991 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dc987-0261-4a65-845b-58cd597630b5 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:14.585344 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dc987-0261-4a65-845b-58cd597630b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:14.585940 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-c9dbefca-54cb-492b-82e2-c720ce04da69 None None] MFA Rules not processed for user `da2f5a7f2f394f8b8b4686961d96a9f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:14.587268 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c9dbefca-54cb-492b-82e2-c720ce04da69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:14.667270 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-491dc987-0261-4a65-845b-58cd597630b5 None None] MFA Rules not processed for user `8e8c979ab68548b082f33bfb215c7713`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:14.678554 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-491dc987-0261-4a65-845b-58cd597630b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:14.777082 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 789/1582] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:14 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:14.781152 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbefca-54cb-492b-82e2-c720ce04da69 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:14.787211 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 794/1583] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:14 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:14.787211 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dc987-0261-4a65-845b-58cd597630b5 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:14.905524 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dc987-0261-4a65-845b-58cd597630b5 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:14.926912 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b2c6f-4d65-42d5-9f71-c862a9918601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:14.926912 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b2c6f-4d65-42d5-9f71-c862a9918601 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:14.926912 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b2c6f-4d65-42d5-9f71-c862a9918601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:14.926912 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b2c6f-4d65-42d5-9f71-c862a9918601 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:14.927242 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b2c6f-4d65-42d5-9f71-c862a9918601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:14.927242 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b2c6f-4d65-42d5-9f71-c862a9918601 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:14.927394 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbefca-54cb-492b-82e2-c720ce04da69 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:14.940067 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1347e-2445-42bd-aec1-c2f4de8774f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:14.940745 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1347e-2445-42bd-aec1-c2f4de8774f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:14.941180 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1347e-2445-42bd-aec1-c2f4de8774f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:14.941319 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1347e-2445-42bd-aec1-c2f4de8774f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:14.942005 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1347e-2445-42bd-aec1-c2f4de8774f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:14.943635 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1347e-2445-42bd-aec1-c2f4de8774f9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:14.948923 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 795/1584] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:14 2021] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:14.957498 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b2c6f-4d65-42d5-9f71-c862a9918601 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:14.967372 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 790/1585] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:14 2021] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:14.969519 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1347e-2445-42bd-aec1-c2f4de8774f9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:15.069038 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b2c6f-4d65-42d5-9f71-c862a9918601 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:15.079109 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7277aa-4623-4826-9d4c-c53f9e675e86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:15.079805 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7277aa-4623-4826-9d4c-c53f9e675e86 service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:15.080088 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7277aa-4623-4826-9d4c-c53f9e675e86 service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:15.080363 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7277aa-4623-4826-9d4c-c53f9e675e86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:15.103276 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7277aa-4623-4826-9d4c-c53f9e675e86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:15.104714 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7277aa-4623-4826-9d4c-c53f9e675e86 service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:15.116647 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1347e-2445-42bd-aec1-c2f4de8774f9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:15.128309 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 796/1586] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:14 2021] GET /identity/v3/auth/tokens => generated 3490 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:15.130365 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778fa4e-a775-4b19-8818-8dc7daff0863 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:15.131070 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778fa4e-a775-4b19-8818-8dc7daff0863 service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:15.131351 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778fa4e-a775-4b19-8818-8dc7daff0863 service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:15.131622 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778fa4e-a775-4b19-8818-8dc7daff0863 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:15.132062 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7277aa-4623-4826-9d4c-c53f9e675e86 service cinder] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:15.149951 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778fa4e-a775-4b19-8818-8dc7daff0863 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:15.152744 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7277aa-4623-4826-9d4c-c53f9e675e86 service cinder] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:15.153492 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778fa4e-a775-4b19-8818-8dc7daff0863 service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:15.164220 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00feb5-4daa-4b32-b90a-d7ba5f3ccaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:15.164388 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00feb5-4daa-4b32-b90a-d7ba5f3ccaf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:15.164695 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00feb5-4daa-4b32-b90a-d7ba5f3ccaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:15.164813 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00feb5-4daa-4b32-b90a-d7ba5f3ccaf7 admin admin] PATH_INFO: `/v3/projects/9f9d1510272545d0a45b7383be9a447c/users/b71534cddaeb42589af7acf42c690adf/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:15.171873 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00feb5-4daa-4b32-b90a-d7ba5f3ccaf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f9d1510272545d0a45b7383be9a447c, user_id=b71534cddaeb42589af7acf42c690adf, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:15.175532 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00feb5-4daa-4b32-b90a-d7ba5f3ccaf7 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:15.185440 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 791/1587] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:14 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:15.187864 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778fa4e-a775-4b19-8818-8dc7daff0863 service nova] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:15.201338 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 797/1588] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:15 2021] PUT /identity/v3/projects/9f9d1510272545d0a45b7383be9a447c/users/b71534cddaeb42589af7acf42c690adf/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:15.201941 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00feb5-4daa-4b32-b90a-d7ba5f3ccaf7 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:15.211172 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778fa4e-a775-4b19-8818-8dc7daff0863 service nova] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:15.303055 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00feb5-4daa-4b32-b90a-d7ba5f3ccaf7 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:15.308643 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca9fa3-33de-4f00-bf7a-832357ed5de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:15.309717 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2e5cb-ba85-4dff-a2f1-2a2e5a4ea011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:15.310713 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2e5cb-ba85-4dff-a2f1-2a2e5a4ea011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:15.311049 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2e5cb-ba85-4dff-a2f1-2a2e5a4ea011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:15.311359 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2e5cb-ba85-4dff-a2f1-2a2e5a4ea011 admin admin] PATH_INFO: `/v3/users/af43d0550c134da3b407e977b8447fc7` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:15.312227 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca9fa3-33de-4f00-bf7a-832357ed5de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:15.312924 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2e5cb-ba85-4dff-a2f1-2a2e5a4ea011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af43d0550c134da3b407e977b8447fc7)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:15.314571 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca9fa3-33de-4f00-bf7a-832357ed5de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:15.315160 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca9fa3-33de-4f00-bf7a-832357ed5de8 admin admin] PATH_INFO: `/v3/projects/549ad010d4024b1796ab101e294d003b/users/10f040fd444f43099ab3d8a51af8662f/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:15.315507 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2e5cb-ba85-4dff-a2f1-2a2e5a4ea011 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:15.321165 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca9fa3-33de-4f00-bf7a-832357ed5de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=549ad010d4024b1796ab101e294d003b, user_id=10f040fd444f43099ab3d8a51af8662f, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:15.326304 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca9fa3-33de-4f00-bf7a-832357ed5de8 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:15.349152 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 792/1589] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:15 2021] PUT /identity/v3/projects/549ad010d4024b1796ab101e294d003b/users/10f040fd444f43099ab3d8a51af8662f/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:15.350650 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d555e5-579c-424d-8a6e-eff604741b1f None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:15.350992 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d555e5-579c-424d-8a6e-eff604741b1f None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:15.351326 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d555e5-579c-424d-8a6e-eff604741b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:15.391529 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-07d555e5-579c-424d-8a6e-eff604741b1f None None] MFA Rules not processed for user `b71534cddaeb42589af7acf42c690adf`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:15.392924 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-07d555e5-579c-424d-8a6e-eff604741b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:15.410666 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8aa2e5cb-ba85-4dff-a2f1-2a2e5a4ea011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af43d0550c134da3b407e977b8447fc7'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:15.466620 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8aa2e5cb-ba85-4dff-a2f1-2a2e5a4ea011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af43d0550c134da3b407e977b8447fc7'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:15.479945 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8aa2e5cb-ba85-4dff-a2f1-2a2e5a4ea011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af43d0550c134da3b407e977b8447fc7'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:15.482922 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8aa2e5cb-ba85-4dff-a2f1-2a2e5a4ea011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af43d0550c134da3b407e977b8447fc7'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:15.491873 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8aa2e5cb-ba85-4dff-a2f1-2a2e5a4ea011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af43d0550c134da3b407e977b8447fc7'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:15.506073 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 798/1590] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:38:15 2021] DELETE /identity/v3/users/af43d0550c134da3b407e977b8447fc7 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:15.506232 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 793/1591] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:15 2021] POST /identity/v3/auth/tokens => generated 3480 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:15.506336 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1861d-4e40-4f4d-b48e-a334dcf655cd None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:15.506336 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1861d-4e40-4f4d-b48e-a334dcf655cd None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:15.506336 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1861d-4e40-4f4d-b48e-a334dcf655cd None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:15.507907 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 799/1592] 10.222.0.30 () {54 vars in 912 bytes} [Fri Oct 15 03:38:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:38:15.508669 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1861d-4e40-4f4d-b48e-a334dcf655cd None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:15.510984 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665491f-572b-4c0f-9b89-b47ff89643a0 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:15.511133 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-ebb1861d-4e40-4f4d-b48e-a334dcf655cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:15.511470 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665491f-572b-4c0f-9b89-b47ff89643a0 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:15.511877 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665491f-572b-4c0f-9b89-b47ff89643a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:15.547102 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-a665491f-572b-4c0f-9b89-b47ff89643a0 None None] MFA Rules not processed for user `10f040fd444f43099ab3d8a51af8662f`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:15.549139 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-a665491f-572b-4c0f-9b89-b47ff89643a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:15.601169 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1861d-4e40-4f4d-b48e-a334dcf655cd None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:15.613142 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc5d63-fcff-43fd-a84d-a4ae6108173f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:15.620486 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc5d63-fcff-43fd-a84d-a4ae6108173f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:15.622508 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc5d63-fcff-43fd-a84d-a4ae6108173f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:15.622990 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc5d63-fcff-43fd-a84d-a4ae6108173f admin admin] PATH_INFO: `/v3/users/e7b12405e5814461b1f828f900645f71` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:15.624532 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc5d63-fcff-43fd-a84d-a4ae6108173f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7b12405e5814461b1f828f900645f71)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:15.627452 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc5d63-fcff-43fd-a84d-a4ae6108173f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:15.656877 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 794/1593] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:15 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:15.658317 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201766aa-bf85-4293-9bba-27f32f3166b8 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:15.658720 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201766aa-bf85-4293-9bba-27f32f3166b8 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:15.659091 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201766aa-bf85-4293-9bba-27f32f3166b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:15.683228 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-201766aa-bf85-4293-9bba-27f32f3166b8 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:15.685294 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-201766aa-bf85-4293-9bba-27f32f3166b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:15.697187 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 795/1594] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:15.697187 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201766aa-bf85-4293-9bba-27f32f3166b8 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:15.698666 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-201766aa-bf85-4293-9bba-27f32f3166b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:15.723515 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2dcc5d63-fcff-43fd-a84d-a4ae6108173f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7b12405e5814461b1f828f900645f71'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:15.739082 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2dcc5d63-fcff-43fd-a84d-a4ae6108173f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7b12405e5814461b1f828f900645f71'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:15.759481 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2dcc5d63-fcff-43fd-a84d-a4ae6108173f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7b12405e5814461b1f828f900645f71'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:15.760244 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2dcc5d63-fcff-43fd-a84d-a4ae6108173f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7b12405e5814461b1f828f900645f71'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:15.769832 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2dcc5d63-fcff-43fd-a84d-a4ae6108173f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7b12405e5814461b1f828f900645f71'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:15.776348 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 800/1595] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:38:15 2021] DELETE /identity/v3/users/e7b12405e5814461b1f828f900645f71 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:15.777845 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcec65-5931-480f-9227-a80446349fad None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:15.778135 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcec65-5931-480f-9227-a80446349fad None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:15.779265 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcec65-5931-480f-9227-a80446349fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:15.799533 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-81fcec65-5931-480f-9227-a80446349fad None None] MFA Rules not processed for user `3d71a1bd93b04249b2b8e6a054de44c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:15.801253 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-81fcec65-5931-480f-9227-a80446349fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:15.832953 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201766aa-bf85-4293-9bba-27f32f3166b8 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:15.901186 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 801/1596] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Oct 15 03:38:15 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:15.916573 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcec65-5931-480f-9227-a80446349fad None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:15.924175 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-81fcec65-5931-480f-9227-a80446349fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:15.940102 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49dbe4-e5c4-4106-baa2-6666f41be8c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:15.940811 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49dbe4-e5c4-4106-baa2-6666f41be8c8 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:15.941091 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49dbe4-e5c4-4106-baa2-6666f41be8c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:15.941364 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49dbe4-e5c4-4106-baa2-6666f41be8c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:15.943172 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-3a49dbe4-e5c4-4106-baa2-6666f41be8c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:15.991659 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcec65-5931-480f-9227-a80446349fad None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:15.995945 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1c469-a0b6-449d-a467-3eb5b6fcbf36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:15.999157 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1c469-a0b6-449d-a467-3eb5b6fcbf36 service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:15.999712 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1c469-a0b6-449d-a467-3eb5b6fcbf36 service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:16.000169 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1c469-a0b6-449d-a467-3eb5b6fcbf36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:16.002378 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-32a1c469-a0b6-449d-a467-3eb5b6fcbf36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:16.023449 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49dbe4-e5c4-4106-baa2-6666f41be8c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:16.025548 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49dbe4-e5c4-4106-baa2-6666f41be8c8 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:16.037159 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 796/1597] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:15 2021] GET /identity/v3/auth/tokens => generated 3480 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:16.038043 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49dbe4-e5c4-4106-baa2-6666f41be8c8 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:16.039406 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-3a49dbe4-e5c4-4106-baa2-6666f41be8c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:16.103810 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1c469-a0b6-449d-a467-3eb5b6fcbf36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:16.105407 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1c469-a0b6-449d-a467-3eb5b6fcbf36 service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:16.125060 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 802/1598] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:15 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:16.129542 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78c10a-8166-4223-9988-af055dda2647 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:16.130167 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78c10a-8166-4223-9988-af055dda2647 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:16.130398 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78c10a-8166-4223-9988-af055dda2647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:16.146047 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49dbe4-e5c4-4106-baa2-6666f41be8c8 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:16.150051 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051990f-74fc-4642-9822-aabcf0871677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:16.150709 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051990f-74fc-4642-9822-aabcf0871677 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:16.150996 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051990f-74fc-4642-9822-aabcf0871677 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:16.151433 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051990f-74fc-4642-9822-aabcf0871677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:16.154039 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c051990f-74fc-4642-9822-aabcf0871677 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:16.154255 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-de78c10a-8166-4223-9988-af055dda2647 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:16.155518 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-de78c10a-8166-4223-9988-af055dda2647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:16.231160 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 803/1599] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:16.231160 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78c10a-8166-4223-9988-af055dda2647 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:16.231452 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051990f-74fc-4642-9822-aabcf0871677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:16.231571 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-de78c10a-8166-4223-9988-af055dda2647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:16.231699 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051990f-74fc-4642-9822-aabcf0871677 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:16.242275 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 797/1600] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:16.243544 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20022b-efae-47c3-969f-e50d3867a3cb None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:16.243864 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20022b-efae-47c3-969f-e50d3867a3cb None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:16.244144 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20022b-efae-47c3-969f-e50d3867a3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:16.274131 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-fd20022b-efae-47c3-969f-e50d3867a3cb None None] MFA Rules not processed for user `f1f3db9250cc4edbacb392d5d0d18e08`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:16.275344 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-fd20022b-efae-47c3-969f-e50d3867a3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:16.315785 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78c10a-8166-4223-9988-af055dda2647 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:16.320717 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1f823-0871-4a83-b6da-3b23007f68bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456c83b8619847279927251ca48fca37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:16.321558 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1f823-0871-4a83-b6da-3b23007f68bc service glance] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:16.321936 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1f823-0871-4a83-b6da-3b23007f68bc service glance] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:16.322303 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1f823-0871-4a83-b6da-3b23007f68bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:16.335657 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1f823-0871-4a83-b6da-3b23007f68bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:16.337272 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1f823-0871-4a83-b6da-3b23007f68bc service glance] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:16.350868 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 804/1601] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:16 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:16.351998 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1f823-0871-4a83-b6da-3b23007f68bc service glance] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:16.364661 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1f823-0871-4a83-b6da-3b23007f68bc service glance] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:16.367860 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 798/1602] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:16 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:16.371974 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20022b-efae-47c3-969f-e50d3867a3cb None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:16.375881 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-fd20022b-efae-47c3-969f-e50d3867a3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:16.380260 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de40dd-4656-44b2-9f08-d3dbba567274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:16.381039 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de40dd-4656-44b2-9f08-d3dbba567274 service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:16.381421 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de40dd-4656-44b2-9f08-d3dbba567274 service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:16.381791 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de40dd-4656-44b2-9f08-d3dbba567274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:16.388586 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-b2de40dd-4656-44b2-9f08-d3dbba567274 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:16.408367 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20022b-efae-47c3-969f-e50d3867a3cb None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:16.418760 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfc999-8eba-49a0-a128-75bbf7f1b3e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:16.419434 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfc999-8eba-49a0-a128-75bbf7f1b3e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:16.420252 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfc999-8eba-49a0-a128-75bbf7f1b3e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:16.420569 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfc999-8eba-49a0-a128-75bbf7f1b3e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:16.433034 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfc999-8eba-49a0-a128-75bbf7f1b3e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:16.448482 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfc999-8eba-49a0-a128-75bbf7f1b3e1 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:16.481307 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 799/1603] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:16.484790 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee60f8e-10e5-47b5-98c1-5fd940d08748 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:16.485616 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee60f8e-10e5-47b5-98c1-5fd940d08748 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:16.486682 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee60f8e-10e5-47b5-98c1-5fd940d08748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:16.523267 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de40dd-4656-44b2-9f08-d3dbba567274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:16.527640 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de40dd-4656-44b2-9f08-d3dbba567274 service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:16.535014 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-3ee60f8e-10e5-47b5-98c1-5fd940d08748 None None] MFA Rules not processed for user `f1f3db9250cc4edbacb392d5d0d18e08`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:16.536266 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-3ee60f8e-10e5-47b5-98c1-5fd940d08748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:16.559632 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 800/1604] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:16 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:16.559866 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 805/1605] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:16 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:16.610697 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee60f8e-10e5-47b5-98c1-5fd940d08748 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:16.612376 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-3ee60f8e-10e5-47b5-98c1-5fd940d08748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:16.641424 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee60f8e-10e5-47b5-98c1-5fd940d08748 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:16.661226 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50feda-0a4a-4baa-a524-9fc51cc065ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:16.662901 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50feda-0a4a-4baa-a524-9fc51cc065ea service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:16.663992 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50feda-0a4a-4baa-a524-9fc51cc065ea service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:16.665171 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50feda-0a4a-4baa-a524-9fc51cc065ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:16.690901 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50feda-0a4a-4baa-a524-9fc51cc065ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:16.695215 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50feda-0a4a-4baa-a524-9fc51cc065ea service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:16.725122 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 801/1606] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:16 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:16.931241 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2766ad4-4f38-45b3-8034-60745ccc0297 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:16.932286 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2766ad4-4f38-45b3-8034-60745ccc0297 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:16.932839 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2766ad4-4f38-45b3-8034-60745ccc0297 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:16.936468 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 806/1607] 10.222.0.30 () {54 vars in 912 bytes} [Fri Oct 15 03:38:16 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:38:16.942969 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f2d6e-7b78-4a18-9dc0-2ce953b18346 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:16.943284 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f2d6e-7b78-4a18-9dc0-2ce953b18346 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:16.943961 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f2d6e-7b78-4a18-9dc0-2ce953b18346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:17.005860 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-a23f2d6e-7b78-4a18-9dc0-2ce953b18346 None None] MFA Rules not processed for user `3ea75b4f9132494388b223a309a40640`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:17.007533 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-a23f2d6e-7b78-4a18-9dc0-2ce953b18346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:17.029708 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 802/1608] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Oct 15 03:38:16 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:17.090564 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2766ad4-4f38-45b3-8034-60745ccc0297 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:17.125190 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2766ad4-4f38-45b3-8034-60745ccc0297 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:17.138605 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991fec89-8249-497e-bb80-22aac7c915e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:17.139817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fec89-8249-497e-bb80-22aac7c915e0 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:17.139817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fec89-8249-497e-bb80-22aac7c915e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:17.139817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fec89-8249-497e-bb80-22aac7c915e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:17.155554 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991fec89-8249-497e-bb80-22aac7c915e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:17.157132 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991fec89-8249-497e-bb80-22aac7c915e0 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:17.187225 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 807/1609] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:17 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:17.619456 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d3f0c-cdcb-440c-8874-8c510956ced2 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:17.620100 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d3f0c-cdcb-440c-8874-8c510956ced2 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:17.620255 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d3f0c-cdcb-440c-8874-8c510956ced2 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:17.622961 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 803/1610] 10.222.0.30 () {54 vars in 912 bytes} [Fri Oct 15 03:38:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:38:17.631267 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2644b-096f-469f-b1e2-a3e9bcf19576 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:17.632070 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2644b-096f-469f-b1e2-a3e9bcf19576 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:17.632772 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2644b-096f-469f-b1e2-a3e9bcf19576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:17.653680 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d3f0c-cdcb-440c-8874-8c510956ced2 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:17.658787 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-514d3f0c-cdcb-440c-8874-8c510956ced2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:17.669968 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-eaa2644b-096f-469f-b1e2-a3e9bcf19576 None None] MFA Rules not processed for user `3ea75b4f9132494388b223a309a40640`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:17.685946 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-eaa2644b-096f-469f-b1e2-a3e9bcf19576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:17.689495 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d3f0c-cdcb-440c-8874-8c510956ced2 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:17.697652 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 808/1611] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Oct 15 03:38:17 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:17.698278 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c0067-87bf-4137-90e4-3eb7ece8c5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:17.699927 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c0067-87bf-4137-90e4-3eb7ece8c5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:17.700552 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c0067-87bf-4137-90e4-3eb7ece8c5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:17.700969 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c0067-87bf-4137-90e4-3eb7ece8c5c0 admin admin] PATH_INFO: `/v3/projects/4520cd6f3a3a4c868dcd285ad7983dd1` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:17.702820 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c0067-87bf-4137-90e4-3eb7ece8c5c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4520cd6f3a3a4c868dcd285ad7983dd1)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:17.706780 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c0067-87bf-4137-90e4-3eb7ece8c5c0 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:17.729729 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2644b-096f-469f-b1e2-a3e9bcf19576 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:17.740766 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2644b-096f-469f-b1e2-a3e9bcf19576 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:17.751785 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd474e1-e864-4dc8-a9e9-ae7ae5d50bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:17.752062 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd474e1-e864-4dc8-a9e9-ae7ae5d50bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:17.753051 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd474e1-e864-4dc8-a9e9-ae7ae5d50bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:17.753324 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd474e1-e864-4dc8-a9e9-ae7ae5d50bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:17.776502 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd474e1-e864-4dc8-a9e9-ae7ae5d50bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:17.780026 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd474e1-e864-4dc8-a9e9-ae7ae5d50bb2 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:17.794247 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 809/1612] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:17 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:38:17.795386 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd474e1-e864-4dc8-a9e9-ae7ae5d50bb2 service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:17.797338 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-0dd474e1-e864-4dc8-a9e9-ae7ae5d50bb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:17.817678 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd474e1-e864-4dc8-a9e9-ae7ae5d50bb2 service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:17.824601 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-ea4c0067-87bf-4137-90e4-3eb7ece8c5c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4520cd6f3a3a4c868dcd285ad7983dd1', 'request_id': 'req-ea4c0067-87bf-4137-90e4-3eb7ece8c5c0'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:17.851397 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-ea4c0067-87bf-4137-90e4-3eb7ece8c5c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4520cd6f3a3a4c868dcd285ad7983dd1', 'request_id': 'req-ea4c0067-87bf-4137-90e4-3eb7ece8c5c0'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:17.865783 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-ea4c0067-87bf-4137-90e4-3eb7ece8c5c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4520cd6f3a3a4c868dcd285ad7983dd1', 'request_id': 'req-ea4c0067-87bf-4137-90e4-3eb7ece8c5c0'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:17.893464 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-ea4c0067-87bf-4137-90e4-3eb7ece8c5c0 admin admin] The token cache is being invalidate because project 4520cd6f3a3a4c868dcd285ad7983dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:38:17.893751 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-ea4c0067-87bf-4137-90e4-3eb7ece8c5c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:17.894603 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-ea4c0067-87bf-4137-90e4-3eb7ece8c5c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:17.897771 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 804/1613] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:38:17 2021] DELETE /identity/v3/projects/4520cd6f3a3a4c868dcd285ad7983dd1 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:17.901918 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c0067-87bf-4137-90e4-3eb7ece8c5c0 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:17.907801 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-ea4c0067-87bf-4137-90e4-3eb7ece8c5c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:17.946168 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c8c59-c793-4df0-a2c3-8e6bd35cd7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:17.947086 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c8c59-c793-4df0-a2c3-8e6bd35cd7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:17.947364 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c8c59-c793-4df0-a2c3-8e6bd35cd7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:17.947643 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c8c59-c793-4df0-a2c3-8e6bd35cd7a4 admin admin] PATH_INFO: `/v3/projects/2c374ecfb00a444d87fbdb2fb3a5b4fa` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:17.949152 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c8c59-c793-4df0-a2c3-8e6bd35cd7a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c374ecfb00a444d87fbdb2fb3a5b4fa)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:17.952277 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING py.warnings [None req-546c8c59-c793-4df0-a2c3-8e6bd35cd7a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:38:17.952277 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: warnings.warn(msg) Oct 15 03:38:17.952277 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: Oct 15 03:38:17.953908 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c8c59-c793-4df0-a2c3-8e6bd35cd7a4 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:18.000484 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c0067-87bf-4137-90e4-3eb7ece8c5c0 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:18.006985 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9773e-d40f-48f3-92ed-441ca18cb380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:18.009026 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9773e-d40f-48f3-92ed-441ca18cb380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:18.010251 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9773e-d40f-48f3-92ed-441ca18cb380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:18.011813 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9773e-d40f-48f3-92ed-441ca18cb380 admin admin] PATH_INFO: `/v3/users/da2f5a7f2f394f8b8b4686961d96a9f2` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:18.014725 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9773e-d40f-48f3-92ed-441ca18cb380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da2f5a7f2f394f8b8b4686961d96a9f2)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:18.017040 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: WARNING py.warnings [None req-fac9773e-d40f-48f3-92ed-441ca18cb380 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 15 03:38:18.017040 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: warnings.warn(msg) Oct 15 03:38:18.017040 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: Oct 15 03:38:18.019298 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9773e-d40f-48f3-92ed-441ca18cb380 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:18.087197 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-546c8c59-c793-4df0-a2c3-8e6bd35cd7a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c374ecfb00a444d87fbdb2fb3a5b4fa', 'request_id': 'req-546c8c59-c793-4df0-a2c3-8e6bd35cd7a4'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:18.144693 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-546c8c59-c793-4df0-a2c3-8e6bd35cd7a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c374ecfb00a444d87fbdb2fb3a5b4fa', 'request_id': 'req-546c8c59-c793-4df0-a2c3-8e6bd35cd7a4'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:18.171631 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-546c8c59-c793-4df0-a2c3-8e6bd35cd7a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c374ecfb00a444d87fbdb2fb3a5b4fa', 'request_id': 'req-546c8c59-c793-4df0-a2c3-8e6bd35cd7a4'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:18.193665 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-fac9773e-d40f-48f3-92ed-441ca18cb380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da2f5a7f2f394f8b8b4686961d96a9f2'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:18.209975 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-546c8c59-c793-4df0-a2c3-8e6bd35cd7a4 admin admin] The token cache is being invalidate because project 2c374ecfb00a444d87fbdb2fb3a5b4fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:38:18.210577 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-546c8c59-c793-4df0-a2c3-8e6bd35cd7a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:18.213804 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-546c8c59-c793-4df0-a2c3-8e6bd35cd7a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:18.218537 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 810/1614] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:38:17 2021] DELETE /identity/v3/projects/2c374ecfb00a444d87fbdb2fb3a5b4fa => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:18.224597 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f41f6-4ca4-4365-8953-e97113a59d04 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:18.225849 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f41f6-4ca4-4365-8953-e97113a59d04 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:18.226231 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f41f6-4ca4-4365-8953-e97113a59d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:18.236708 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-fac9773e-d40f-48f3-92ed-441ca18cb380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da2f5a7f2f394f8b8b4686961d96a9f2'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:18.252419 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-fac9773e-d40f-48f3-92ed-441ca18cb380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da2f5a7f2f394f8b8b4686961d96a9f2'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:18.253963 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-fac9773e-d40f-48f3-92ed-441ca18cb380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da2f5a7f2f394f8b8b4686961d96a9f2'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:18.268709 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-fac9773e-d40f-48f3-92ed-441ca18cb380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da2f5a7f2f394f8b8b4686961d96a9f2'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:18.278182 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 805/1615] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:38:17 2021] DELETE /identity/v3/users/da2f5a7f2f394f8b8b4686961d96a9f2 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:18.309960 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-483f41f6-4ca4-4365-8953-e97113a59d04 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:18.311211 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-483f41f6-4ca4-4365-8953-e97113a59d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:18.315638 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9773e-d40f-48f3-92ed-441ca18cb380 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:18.317968 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-fac9773e-d40f-48f3-92ed-441ca18cb380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:18.456980 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 811/1616] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:18.466469 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d44d6d-4157-4811-b6ec-12c6970c4801 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:18.470744 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d44d6d-4157-4811-b6ec-12c6970c4801 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:18.473717 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d44d6d-4157-4811-b6ec-12c6970c4801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:18.545713 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-95d44d6d-4157-4811-b6ec-12c6970c4801 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:18.551632 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-95d44d6d-4157-4811-b6ec-12c6970c4801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:18.580146 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 812/1617] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:18.583707 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d44d6d-4157-4811-b6ec-12c6970c4801 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:18.598708 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9773e-d40f-48f3-92ed-441ca18cb380 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:18.611504 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d44d6d-4157-4811-b6ec-12c6970c4801 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:18.619202 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e587c-bf29-4207-b29a-81c22419b504 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bffc0480ffb942cdad426195eca0529e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:18.623143 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e587c-bf29-4207-b29a-81c22419b504 service placement] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:18.624369 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e587c-bf29-4207-b29a-81c22419b504 service placement] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:18.624793 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e587c-bf29-4207-b29a-81c22419b504 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:18.631129 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-fe3e587c-bf29-4207-b29a-81c22419b504 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:18.631372 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1678652-d020-4872-8153-eca2779ff921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:18.635065 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1678652-d020-4872-8153-eca2779ff921 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:18.635432 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1678652-d020-4872-8153-eca2779ff921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:18.636570 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1678652-d020-4872-8153-eca2779ff921 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:18.638656 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1678652-d020-4872-8153-eca2779ff921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:38:18.639918 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1678652-d020-4872-8153-eca2779ff921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:18.645435 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1678652-d020-4872-8153-eca2779ff921 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:18.676881 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e587c-bf29-4207-b29a-81c22419b504 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:18.677741 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 813/1618] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:38:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:38:18.682384 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e587c-bf29-4207-b29a-81c22419b504 service placement] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:18.683192 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1678652-d020-4872-8153-eca2779ff921 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:18.704008 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 806/1619] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:18 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:18.711131 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1678652-d020-4872-8153-eca2779ff921 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:18.718677 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425e77d-4434-49ac-80f9-fe9441de8491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:18.719616 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425e77d-4434-49ac-80f9-fe9441de8491 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:18.721749 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425e77d-4434-49ac-80f9-fe9441de8491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:18.722240 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425e77d-4434-49ac-80f9-fe9441de8491 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:18.723187 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425e77d-4434-49ac-80f9-fe9441de8491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:18.728503 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425e77d-4434-49ac-80f9-fe9441de8491 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:18.803818 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 814/1620] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:18 2021] POST /identity/v3/projects => generated 355 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:18.808076 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e587c-bf29-4207-b29a-81c22419b504 service placement] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:18.824108 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e587c-bf29-4207-b29a-81c22419b504 service placement] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:18.986020 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8740f-be01-4c18-8393-1d7520107e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:18.987059 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8740f-be01-4c18-8393-1d7520107e60 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:18.991812 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8740f-be01-4c18-8393-1d7520107e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:18.993174 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8740f-be01-4c18-8393-1d7520107e60 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:18.994081 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8740f-be01-4c18-8393-1d7520107e60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:19.000244 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8740f-be01-4c18-8393-1d7520107e60 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:19.069491 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425e77d-4434-49ac-80f9-fe9441de8491 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:19.070764 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 807/1621] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:18 2021] POST /identity/v3/users => generated 278 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:19.093841 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425e77d-4434-49ac-80f9-fe9441de8491 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:19.110683 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c78aa4-c82d-4720-b22c-ad9a67787212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:19.112005 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c78aa4-c82d-4720-b22c-ad9a67787212 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:19.115828 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c78aa4-c82d-4720-b22c-ad9a67787212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:19.116301 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c78aa4-c82d-4720-b22c-ad9a67787212 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:19.117431 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c78aa4-c82d-4720-b22c-ad9a67787212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:19.120730 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c78aa4-c82d-4720-b22c-ad9a67787212 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:19.140402 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 815/1622] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:19 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:19.144296 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8740f-be01-4c18-8393-1d7520107e60 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:19.164823 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8740f-be01-4c18-8393-1d7520107e60 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:19.184935 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c78aa4-c82d-4720-b22c-ad9a67787212 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:19.186956 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-96c78aa4-c82d-4720-b22c-ad9a67787212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:19.217073 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0b0d3-25af-4544-92ac-880626faf996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:19.217837 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0b0d3-25af-4544-92ac-880626faf996 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:19.218184 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0b0d3-25af-4544-92ac-880626faf996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:19.218534 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0b0d3-25af-4544-92ac-880626faf996 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:19.219364 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0b0d3-25af-4544-92ac-880626faf996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:19.221461 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0b0d3-25af-4544-92ac-880626faf996 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:19.235281 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c78aa4-c82d-4720-b22c-ad9a67787212 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:19.242518 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af4482-d76c-4fa5-a57e-74dda1a8c556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:19.244028 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af4482-d76c-4fa5-a57e-74dda1a8c556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:19.245239 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af4482-d76c-4fa5-a57e-74dda1a8c556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:19.245711 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af4482-d76c-4fa5-a57e-74dda1a8c556 admin admin] PATH_INFO: `/v3/users/68db45fc6ca04edca942fce2078fda9e` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:19.248045 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af4482-d76c-4fa5-a57e-74dda1a8c556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68db45fc6ca04edca942fce2078fda9e)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:19.251011 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 808/1623] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:19 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:19.253454 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0b0d3-25af-4544-92ac-880626faf996 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:19.262038 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af4482-d76c-4fa5-a57e-74dda1a8c556 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:19.273447 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0b0d3-25af-4544-92ac-880626faf996 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:19.290681 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d9528-1cf0-48bc-a66c-1b672d746bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:19.291824 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d9528-1cf0-48bc-a66c-1b672d746bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:19.292498 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d9528-1cf0-48bc-a66c-1b672d746bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:19.292971 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d9528-1cf0-48bc-a66c-1b672d746bfc admin admin] PATH_INFO: `/v3/projects/3d8dd9aab31b4356916f66c805c08c9f/users/10c2e1f041cd4f4ab043b3b1c0627da3/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:19.334831 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d9528-1cf0-48bc-a66c-1b672d746bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d8dd9aab31b4356916f66c805c08c9f, user_id=10c2e1f041cd4f4ab043b3b1c0627da3, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:19.338236 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d9528-1cf0-48bc-a66c-1b672d746bfc admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:19.377709 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 809/1624] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:19 2021] PUT /identity/v3/projects/3d8dd9aab31b4356916f66c805c08c9f/users/10c2e1f041cd4f4ab043b3b1c0627da3/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:19.379531 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e9e30-7596-48a4-811c-4b6c668c8185 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:19.382864 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e9e30-7596-48a4-811c-4b6c668c8185 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:19.383301 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e9e30-7596-48a4-811c-4b6c668c8185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:19.385184 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-96af4482-d76c-4fa5-a57e-74dda1a8c556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68db45fc6ca04edca942fce2078fda9e'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:19.414899 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-96af4482-d76c-4fa5-a57e-74dda1a8c556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68db45fc6ca04edca942fce2078fda9e'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:19.431973 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-96af4482-d76c-4fa5-a57e-74dda1a8c556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68db45fc6ca04edca942fce2078fda9e'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:19.433116 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-96af4482-d76c-4fa5-a57e-74dda1a8c556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68db45fc6ca04edca942fce2078fda9e'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:19.433465 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-362e9e30-7596-48a4-811c-4b6c668c8185 None None] MFA Rules not processed for user `10c2e1f041cd4f4ab043b3b1c0627da3`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:19.435884 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-362e9e30-7596-48a4-811c-4b6c668c8185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:19.469387 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-96af4482-d76c-4fa5-a57e-74dda1a8c556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68db45fc6ca04edca942fce2078fda9e'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:19.506529 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 816/1625] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:38:19 2021] DELETE /identity/v3/users/68db45fc6ca04edca942fce2078fda9e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:19.509779 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b9eda-1f4a-4efa-a6e8-10e296e5df5e None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:19.510072 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b9eda-1f4a-4efa-a6e8-10e296e5df5e None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:19.510351 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b9eda-1f4a-4efa-a6e8-10e296e5df5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:19.575038 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 810/1626] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:19 2021] POST /identity/v3/auth/tokens => generated 3375 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:19.579752 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e9e30-7596-48a4-811c-4b6c668c8185 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:19.582665 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-362e9e30-7596-48a4-811c-4b6c668c8185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:19.582849 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-e84b9eda-1f4a-4efa-a6e8-10e296e5df5e None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:19.584680 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-e84b9eda-1f4a-4efa-a6e8-10e296e5df5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:19.759998 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e9e30-7596-48a4-811c-4b6c668c8185 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:19.809250 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 817/1627] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:19.810159 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b9eda-1f4a-4efa-a6e8-10e296e5df5e None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:19.817532 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-e84b9eda-1f4a-4efa-a6e8-10e296e5df5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:19.896945 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0478f42-696c-4f03-acbd-d676a197e6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:19.897711 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0478f42-696c-4f03-acbd-d676a197e6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:19.898065 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0478f42-696c-4f03-acbd-d676a197e6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:19.898424 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0478f42-696c-4f03-acbd-d676a197e6d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:19.899294 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0478f42-696c-4f03-acbd-d676a197e6d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:19.901591 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0478f42-696c-4f03-acbd-d676a197e6d8 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:19.982458 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b9eda-1f4a-4efa-a6e8-10e296e5df5e None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:19.999018 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55304ae5-3a00-4501-80b8-168beaadaf82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:19.999373 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55304ae5-3a00-4501-80b8-168beaadaf82 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:20.006975 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55304ae5-3a00-4501-80b8-168beaadaf82 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:20.009643 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55304ae5-3a00-4501-80b8-168beaadaf82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:20.059750 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 811/1628] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:19 2021] POST /identity/v3/projects => generated 355 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:20.062397 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0478f42-696c-4f03-acbd-d676a197e6d8 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:20.064672 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55304ae5-3a00-4501-80b8-168beaadaf82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:20.066421 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55304ae5-3a00-4501-80b8-168beaadaf82 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:20.072488 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d0478f42-696c-4f03-acbd-d676a197e6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:20.091882 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 818/1629] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:20.092839 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55304ae5-3a00-4501-80b8-168beaadaf82 service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:20.104887 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55304ae5-3a00-4501-80b8-168beaadaf82 service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:20.223836 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0478f42-696c-4f03-acbd-d676a197e6d8 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:20.253877 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ace1c1-2400-430b-b054-1a3d86112c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:20.257963 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ace1c1-2400-430b-b054-1a3d86112c50 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:20.258144 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ace1c1-2400-430b-b054-1a3d86112c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:20.260730 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ace1c1-2400-430b-b054-1a3d86112c50 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:20.263021 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ace1c1-2400-430b-b054-1a3d86112c50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:20.269977 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b05b9-199c-46e7-99be-73cd359845e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:20.271037 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b05b9-199c-46e7-99be-73cd359845e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:20.271407 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b05b9-199c-46e7-99be-73cd359845e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:20.271849 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b05b9-199c-46e7-99be-73cd359845e9 admin admin] PATH_INFO: `/v3/projects/fc3d91935c744028bd11174eceb1858c` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:20.273918 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ace1c1-2400-430b-b054-1a3d86112c50 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:20.274702 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b05b9-199c-46e7-99be-73cd359845e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc3d91935c744028bd11174eceb1858c)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:20.308825 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b05b9-199c-46e7-99be-73cd359845e9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:20.320409 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 819/1630] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:20 2021] POST /identity/v3/users => generated 284 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:20.322214 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ace1c1-2400-430b-b054-1a3d86112c50 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:20.336077 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ace1c1-2400-430b-b054-1a3d86112c50 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:20.358313 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec60a57-dba1-46a2-b784-f3f66ea11ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:20.359190 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec60a57-dba1-46a2-b784-f3f66ea11ebd admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:20.359801 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec60a57-dba1-46a2-b784-f3f66ea11ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:20.360191 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec60a57-dba1-46a2-b784-f3f66ea11ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:20.361963 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec60a57-dba1-46a2-b784-f3f66ea11ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:20.367696 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec60a57-dba1-46a2-b784-f3f66ea11ebd admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:20.398994 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 820/1631] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:20 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:20.400166 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec60a57-dba1-46a2-b784-f3f66ea11ebd admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:20.430316 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec60a57-dba1-46a2-b784-f3f66ea11ebd admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:20.434716 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-376b05b9-199c-46e7-99be-73cd359845e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc3d91935c744028bd11174eceb1858c', 'request_id': 'req-376b05b9-199c-46e7-99be-73cd359845e9'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:20.444157 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-376b05b9-199c-46e7-99be-73cd359845e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc3d91935c744028bd11174eceb1858c', 'request_id': 'req-376b05b9-199c-46e7-99be-73cd359845e9'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:20.454442 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-376b05b9-199c-46e7-99be-73cd359845e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc3d91935c744028bd11174eceb1858c', 'request_id': 'req-376b05b9-199c-46e7-99be-73cd359845e9'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:20.483447 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-376b05b9-199c-46e7-99be-73cd359845e9 admin admin] The token cache is being invalidate because project fc3d91935c744028bd11174eceb1858c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:38:20.483885 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-376b05b9-199c-46e7-99be-73cd359845e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:20.486167 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-376b05b9-199c-46e7-99be-73cd359845e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:20.494252 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 812/1632] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:38:20 2021] DELETE /identity/v3/projects/fc3d91935c744028bd11174eceb1858c => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:20.495955 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fd1be-c8cb-49bb-974b-2bf1b4034c27 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:20.498629 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fd1be-c8cb-49bb-974b-2bf1b4034c27 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:20.498921 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fd1be-c8cb-49bb-974b-2bf1b4034c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:20.557864 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-c19fd1be-c8cb-49bb-974b-2bf1b4034c27 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:20.560235 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c19fd1be-c8cb-49bb-974b-2bf1b4034c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:20.595218 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd10f31-c4fd-40aa-999a-6e118a59b88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:20.596141 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd10f31-c4fd-40aa-999a-6e118a59b88f admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:20.596488 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd10f31-c4fd-40aa-999a-6e118a59b88f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:20.596684 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd10f31-c4fd-40aa-999a-6e118a59b88f admin admin] PATH_INFO: `/v3/projects/e93116e19b154d7687210e4e8b5a5fbd/users/bb8748ad7f2643a187f2f9ca192174ae/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:20.630275 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd10f31-c4fd-40aa-999a-6e118a59b88f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93116e19b154d7687210e4e8b5a5fbd, user_id=bb8748ad7f2643a187f2f9ca192174ae, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:20.639981 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd10f31-c4fd-40aa-999a-6e118a59b88f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:20.666947 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 821/1633] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:20 2021] PUT /identity/v3/projects/e93116e19b154d7687210e4e8b5a5fbd/users/bb8748ad7f2643a187f2f9ca192174ae/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:20.671341 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd10f31-c4fd-40aa-999a-6e118a59b88f admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:20.676304 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-3fd10f31-c4fd-40aa-999a-6e118a59b88f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:20.716751 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 813/1634] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:20.726639 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb59a5-a3ed-4bb5-9eae-7b83741ed0fd None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:20.726946 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb59a5-a3ed-4bb5-9eae-7b83741ed0fd None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:20.727352 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb59a5-a3ed-4bb5-9eae-7b83741ed0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:20.775673 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-67fb59a5-a3ed-4bb5-9eae-7b83741ed0fd None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:20.778725 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-67fb59a5-a3ed-4bb5-9eae-7b83741ed0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:20.884960 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd10f31-c4fd-40aa-999a-6e118a59b88f admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:20.905330 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2c270-f03b-4b51-8117-56ea276bcc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:20.907003 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2c270-f03b-4b51-8117-56ea276bcc4f admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:20.908891 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2c270-f03b-4b51-8117-56ea276bcc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:20.909689 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2c270-f03b-4b51-8117-56ea276bcc4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:20.910779 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2c270-f03b-4b51-8117-56ea276bcc4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:20.914399 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2c270-f03b-4b51-8117-56ea276bcc4f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:20.930349 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 814/1635] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:20.937040 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb59a5-a3ed-4bb5-9eae-7b83741ed0fd None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:20.937040 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-67fb59a5-a3ed-4bb5-9eae-7b83741ed0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:20.944535 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 822/1636] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:20 2021] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:20.945552 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2c270-f03b-4b51-8117-56ea276bcc4f admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:20.958959 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb59a5-a3ed-4bb5-9eae-7b83741ed0fd None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:20.966420 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad920a17-e30e-4f9f-883c-894b2e3640ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:20.967446 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad920a17-e30e-4f9f-883c-894b2e3640ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:20.967583 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2c270-f03b-4b51-8117-56ea276bcc4f admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:20.967817 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad920a17-e30e-4f9f-883c-894b2e3640ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:20.968102 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad920a17-e30e-4f9f-883c-894b2e3640ba admin admin] PATH_INFO: `/v3/projects/bee86348280a4baf80a46110898eeba7` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:20.969294 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad920a17-e30e-4f9f-883c-894b2e3640ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=bee86348280a4baf80a46110898eeba7)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:20.972453 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad920a17-e30e-4f9f-883c-894b2e3640ba admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:20.973626 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c931a4-af6c-49ba-a329-c6c5691c700e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:20.974437 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c931a4-af6c-49ba-a329-c6c5691c700e admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:20.974980 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c931a4-af6c-49ba-a329-c6c5691c700e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:20.975396 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c931a4-af6c-49ba-a329-c6c5691c700e admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:20.976880 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c931a4-af6c-49ba-a329-c6c5691c700e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:38:20.977498 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c931a4-af6c-49ba-a329-c6c5691c700e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:20.979372 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c931a4-af6c-49ba-a329-c6c5691c700e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:21.010775 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 823/1637] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:38:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:38:21.013407 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c931a4-af6c-49ba-a329-c6c5691c700e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:21.046611 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c931a4-af6c-49ba-a329-c6c5691c700e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:21.049474 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-ad920a17-e30e-4f9f-883c-894b2e3640ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bee86348280a4baf80a46110898eeba7', 'request_id': 'req-ad920a17-e30e-4f9f-883c-894b2e3640ba'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:21.057219 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-ad920a17-e30e-4f9f-883c-894b2e3640ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bee86348280a4baf80a46110898eeba7', 'request_id': 'req-ad920a17-e30e-4f9f-883c-894b2e3640ba'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:21.070116 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-ad920a17-e30e-4f9f-883c-894b2e3640ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bee86348280a4baf80a46110898eeba7', 'request_id': 'req-ad920a17-e30e-4f9f-883c-894b2e3640ba'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:21.093446 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-ad920a17-e30e-4f9f-883c-894b2e3640ba admin admin] The token cache is being invalidate because project bee86348280a4baf80a46110898eeba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:38:21.093748 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-ad920a17-e30e-4f9f-883c-894b2e3640ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:21.094442 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-ad920a17-e30e-4f9f-883c-894b2e3640ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:21.096359 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 815/1638] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:38:20 2021] DELETE /identity/v3/projects/bee86348280a4baf80a46110898eeba7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:21.097180 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad920a17-e30e-4f9f-883c-894b2e3640ba admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:21.098514 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-ad920a17-e30e-4f9f-883c-894b2e3640ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:21.202949 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d01cec-cd50-4d8a-a6bf-6dfc8be173a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:21.204739 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d01cec-cd50-4d8a-a6bf-6dfc8be173a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:21.207354 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d01cec-cd50-4d8a-a6bf-6dfc8be173a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:21.213263 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d01cec-cd50-4d8a-a6bf-6dfc8be173a1 admin admin] PATH_INFO: `/v3/projects/e93116e19b154d7687210e4e8b5a5fbd/users/bb8748ad7f2643a187f2f9ca192174ae/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:21.222698 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d01cec-cd50-4d8a-a6bf-6dfc8be173a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93116e19b154d7687210e4e8b5a5fbd, user_id=bb8748ad7f2643a187f2f9ca192174ae, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:21.222698 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d01cec-cd50-4d8a-a6bf-6dfc8be173a1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:21.233920 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad920a17-e30e-4f9f-883c-894b2e3640ba admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:21.257466 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c1024-04f7-4983-83cc-cec5b6923810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:21.258363 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c1024-04f7-4983-83cc-cec5b6923810 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:21.258715 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c1024-04f7-4983-83cc-cec5b6923810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:21.259155 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c1024-04f7-4983-83cc-cec5b6923810 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:21.260108 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c1024-04f7-4983-83cc-cec5b6923810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:21.263540 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c1024-04f7-4983-83cc-cec5b6923810 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:21.269396 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 824/1639] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:21 2021] PUT /identity/v3/projects/e93116e19b154d7687210e4e8b5a5fbd/users/bb8748ad7f2643a187f2f9ca192174ae/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:21.270257 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d01cec-cd50-4d8a-a6bf-6dfc8be173a1 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:21.271914 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-87d01cec-cd50-4d8a-a6bf-6dfc8be173a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:21.343213 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 816/1640] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:21 2021] POST /identity/v3/projects => generated 373 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:21.343213 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ab149-297c-4ae2-8670-f5890399de61 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:21.343213 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ab149-297c-4ae2-8670-f5890399de61 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:21.343213 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ab149-297c-4ae2-8670-f5890399de61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:21.382911 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d01cec-cd50-4d8a-a6bf-6dfc8be173a1 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:21.413499 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-945ab149-297c-4ae2-8670-f5890399de61 None None] MFA Rules not processed for user `bb8748ad7f2643a187f2f9ca192174ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:21.419063 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-945ab149-297c-4ae2-8670-f5890399de61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:21.603645 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be0822-5f70-4c02-8941-259e290aa927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:21.604749 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be0822-5f70-4c02-8941-259e290aa927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:21.605038 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be0822-5f70-4c02-8941-259e290aa927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:21.605312 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be0822-5f70-4c02-8941-259e290aa927 admin admin] PATH_INFO: `/v3/users/10f040fd444f43099ab3d8a51af8662f` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:21.606883 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be0822-5f70-4c02-8941-259e290aa927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10f040fd444f43099ab3d8a51af8662f)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:21.611003 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be0822-5f70-4c02-8941-259e290aa927 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:21.616306 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 817/1641] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:21 2021] POST /identity/v3/auth/tokens => generated 3442 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:21.619670 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ab149-297c-4ae2-8670-f5890399de61 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:21.653587 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ab149-297c-4ae2-8670-f5890399de61 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:21.673378 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda992c5-e9af-4470-9608-205eabd5f052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:21.674168 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda992c5-e9af-4470-9608-205eabd5f052 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:21.674539 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda992c5-e9af-4470-9608-205eabd5f052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:21.674828 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda992c5-e9af-4470-9608-205eabd5f052 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:21.675577 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda992c5-e9af-4470-9608-205eabd5f052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:21.679523 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda992c5-e9af-4470-9608-205eabd5f052 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:21.760974 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 818/1642] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:21 2021] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:21.765519 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda992c5-e9af-4470-9608-205eabd5f052 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:21.787211 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda992c5-e9af-4470-9608-205eabd5f052 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:21.794241 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a8038-19d6-4cc8-8f50-2d7f53f22829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:21.795603 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a8038-19d6-4cc8-8f50-2d7f53f22829 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:21.796722 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a8038-19d6-4cc8-8f50-2d7f53f22829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:21.796885 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a8038-19d6-4cc8-8f50-2d7f53f22829 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:21.798003 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a8038-19d6-4cc8-8f50-2d7f53f22829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:21.800198 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a8038-19d6-4cc8-8f50-2d7f53f22829 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:21.823069 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 819/1643] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:21 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:21.829556 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a8038-19d6-4cc8-8f50-2d7f53f22829 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:21.832135 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e66a8038-19d6-4cc8-8f50-2d7f53f22829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:21.836507 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f4be0822-5f70-4c02-8941-259e290aa927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10f040fd444f43099ab3d8a51af8662f'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:21.873463 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f4be0822-5f70-4c02-8941-259e290aa927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10f040fd444f43099ab3d8a51af8662f'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:21.889904 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f4be0822-5f70-4c02-8941-259e290aa927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10f040fd444f43099ab3d8a51af8662f'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:21.890847 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f4be0822-5f70-4c02-8941-259e290aa927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10f040fd444f43099ab3d8a51af8662f'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:21.906982 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f4be0822-5f70-4c02-8941-259e290aa927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10f040fd444f43099ab3d8a51af8662f'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:21.921993 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 825/1644] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:38:21 2021] DELETE /identity/v3/users/10f040fd444f43099ab3d8a51af8662f => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:21.923107 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be0822-5f70-4c02-8941-259e290aa927 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:21.927860 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-f4be0822-5f70-4c02-8941-259e290aa927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:21.977933 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a8038-19d6-4cc8-8f50-2d7f53f22829 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:22.050759 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be0822-5f70-4c02-8941-259e290aa927 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:22.060634 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c6f05-49df-4204-b647-993cc14f5159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:22.064081 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c6f05-49df-4204-b647-993cc14f5159 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:22.064812 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c6f05-49df-4204-b647-993cc14f5159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:22.065591 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c6f05-49df-4204-b647-993cc14f5159 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:22.067780 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c6f05-49df-4204-b647-993cc14f5159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:22.070240 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c6f05-49df-4204-b647-993cc14f5159 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:22.121583 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 826/1645] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:21 2021] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:22.125211 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c6f05-49df-4204-b647-993cc14f5159 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:22.146425 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c6f05-49df-4204-b647-993cc14f5159 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:22.156736 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e614c-0b7a-47d3-9bc2-0b5c3ce2b492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:22.157794 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e614c-0b7a-47d3-9bc2-0b5c3ce2b492 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:22.158057 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e614c-0b7a-47d3-9bc2-0b5c3ce2b492 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:22.158229 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e614c-0b7a-47d3-9bc2-0b5c3ce2b492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:22.160178 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36693680-32a6-4f62-a3e5-cda92f6d92fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:22.161391 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36693680-32a6-4f62-a3e5-cda92f6d92fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:22.161907 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36693680-32a6-4f62-a3e5-cda92f6d92fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:22.162853 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36693680-32a6-4f62-a3e5-cda92f6d92fc admin admin] PATH_INFO: `/v3/projects/68d1b0ef7df5434bbbbfc7acc5453114/users/00669c5844834cbba4ffce6926ebef32/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:22.164839 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c15e614c-0b7a-47d3-9bc2-0b5c3ce2b492 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:22.196680 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36693680-32a6-4f62-a3e5-cda92f6d92fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=68d1b0ef7df5434bbbbfc7acc5453114, user_id=00669c5844834cbba4ffce6926ebef32, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:22.225639 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36693680-32a6-4f62-a3e5-cda92f6d92fc admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:22.260576 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 827/1646] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:22 2021] PUT /identity/v3/projects/68d1b0ef7df5434bbbbfc7acc5453114/users/00669c5844834cbba4ffce6926ebef32/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:22.263922 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d38480-26ed-40a8-9ad4-eebe9b065153 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:22.265332 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d38480-26ed-40a8-9ad4-eebe9b065153 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:22.266498 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d38480-26ed-40a8-9ad4-eebe9b065153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:22.318957 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-b6d38480-26ed-40a8-9ad4-eebe9b065153 None None] MFA Rules not processed for user `3f598b94a850413494da575188706cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:22.321994 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-b6d38480-26ed-40a8-9ad4-eebe9b065153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:22.374719 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e614c-0b7a-47d3-9bc2-0b5c3ce2b492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:22.381480 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e614c-0b7a-47d3-9bc2-0b5c3ce2b492 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:22.408342 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 820/1647] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:21 2021] GET /identity/v3/auth/tokens => generated 3442 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:22.410517 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f1f74-5621-4b9d-8d3f-8efc37fee003 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:22.410809 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f1f74-5621-4b9d-8d3f-8efc37fee003 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:22.411084 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f1f74-5621-4b9d-8d3f-8efc37fee003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:22.475224 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-922f1f74-5621-4b9d-8d3f-8efc37fee003 None None] MFA Rules not processed for user `00669c5844834cbba4ffce6926ebef32`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:22.476542 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-922f1f74-5621-4b9d-8d3f-8efc37fee003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:22.497543 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 828/1648] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Oct 15 03:38:22 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:22.498759 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d38480-26ed-40a8-9ad4-eebe9b065153 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:22.521474 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-b6d38480-26ed-40a8-9ad4-eebe9b065153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:22.696929 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 821/1649] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:22 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:22.698094 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f1f74-5621-4b9d-8d3f-8efc37fee003 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:22.699765 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-922f1f74-5621-4b9d-8d3f-8efc37fee003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:22.719719 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d38480-26ed-40a8-9ad4-eebe9b065153 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:22.726581 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a12849-96ef-48d7-b518-392b1a018533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:22.727591 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a12849-96ef-48d7-b518-392b1a018533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:22.728109 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a12849-96ef-48d7-b518-392b1a018533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:22.728611 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a12849-96ef-48d7-b518-392b1a018533 admin admin] PATH_INFO: `/v3/users/2eb9e53f520f443dbc36f68dbe72e5cf` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:22.731480 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a12849-96ef-48d7-b518-392b1a018533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eb9e53f520f443dbc36f68dbe72e5cf)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:22.736840 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a12849-96ef-48d7-b518-392b1a018533 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:22.853733 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f1f74-5621-4b9d-8d3f-8efc37fee003 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:22.861863 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9785d-dbbe-4f71-a645-8babe85cf776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:22.863062 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9785d-dbbe-4f71-a645-8babe85cf776 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:22.863062 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9785d-dbbe-4f71-a645-8babe85cf776 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:22.863342 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9785d-dbbe-4f71-a645-8babe85cf776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:22.865180 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-17a12849-96ef-48d7-b518-392b1a018533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eb9e53f520f443dbc36f68dbe72e5cf'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:22.868484 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-a6d9785d-dbbe-4f71-a645-8babe85cf776 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:22.890808 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-17a12849-96ef-48d7-b518-392b1a018533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eb9e53f520f443dbc36f68dbe72e5cf'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:22.905003 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-17a12849-96ef-48d7-b518-392b1a018533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eb9e53f520f443dbc36f68dbe72e5cf'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:22.905684 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-17a12849-96ef-48d7-b518-392b1a018533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eb9e53f520f443dbc36f68dbe72e5cf'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:22.919774 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-17a12849-96ef-48d7-b518-392b1a018533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eb9e53f520f443dbc36f68dbe72e5cf'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:22.935085 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 829/1650] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:38:22 2021] DELETE /identity/v3/users/2eb9e53f520f443dbc36f68dbe72e5cf => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:22.938775 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a12849-96ef-48d7-b518-392b1a018533 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:22.941398 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-17a12849-96ef-48d7-b518-392b1a018533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:22.991303 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9785d-dbbe-4f71-a645-8babe85cf776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:22.993130 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9785d-dbbe-4f71-a645-8babe85cf776 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:23.020934 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 822/1651] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:22 2021] GET /identity/v3/auth/tokens => generated 3375 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:23.021940 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9785d-dbbe-4f71-a645-8babe85cf776 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:23.023563 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-a6d9785d-dbbe-4f71-a645-8babe85cf776 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:23.083406 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a12849-96ef-48d7-b518-392b1a018533 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:23.109713 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c373c-196f-4080-a72f-c362776d4368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:23.110616 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c373c-196f-4080-a72f-c362776d4368 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:23.110957 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c373c-196f-4080-a72f-c362776d4368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:23.111175 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c373c-196f-4080-a72f-c362776d4368 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:23.111920 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c373c-196f-4080-a72f-c362776d4368 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:23.114986 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c373c-196f-4080-a72f-c362776d4368 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:23.166734 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 830/1652] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:22 2021] POST /identity/v3/projects => generated 371 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:23.166734 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30906e8-ec95-48a4-9588-c215bd2ee1e8 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:23.166734 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30906e8-ec95-48a4-9588-c215bd2ee1e8 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:23.166734 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30906e8-ec95-48a4-9588-c215bd2ee1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:23.191970 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9785d-dbbe-4f71-a645-8babe85cf776 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:23.223577 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-b30906e8-ec95-48a4-9588-c215bd2ee1e8 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:23.224835 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-b30906e8-ec95-48a4-9588-c215bd2ee1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:23.351586 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 831/1653] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:23.352572 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30906e8-ec95-48a4-9588-c215bd2ee1e8 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:23.362269 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1f1f3-5d85-488a-a99b-dca107c4c2bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfdf0fb38dd04c75a1c874913ea1bf98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:23.363464 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1f1f3-5d85-488a-a99b-dca107c4c2bf service swift] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:23.364077 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1f1f3-5d85-488a-a99b-dca107c4c2bf service swift] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:23.365128 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1f1f3-5d85-488a-a99b-dca107c4c2bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:23.370061 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-cee1f1f3-5d85-488a-a99b-dca107c4c2bf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:23.378906 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30906e8-ec95-48a4-9588-c215bd2ee1e8 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:23.393384 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5d059-e913-4a02-a062-70e3047ae333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:23.395136 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5d059-e913-4a02-a062-70e3047ae333 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:23.395423 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5d059-e913-4a02-a062-70e3047ae333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:23.395710 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5d059-e913-4a02-a062-70e3047ae333 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:23.396439 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5d059-e913-4a02-a062-70e3047ae333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:23.398362 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5d059-e913-4a02-a062-70e3047ae333 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:23.469141 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 832/1654] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:23 2021] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:23.469141 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5d059-e913-4a02-a062-70e3047ae333 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:23.475656 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-01e5d059-e913-4a02-a062-70e3047ae333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:23.543531 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1f1f3-5d85-488a-a99b-dca107c4c2bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:23.545245 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1f1f3-5d85-488a-a99b-dca107c4c2bf service swift] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:23.558034 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 823/1655] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Oct 15 03:38:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 15 03:38:23.559112 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1f1f3-5d85-488a-a99b-dca107c4c2bf service swift] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:23.607428 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1f1f3-5d85-488a-a99b-dca107c4c2bf service swift] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:23.622883 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5d059-e913-4a02-a062-70e3047ae333 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:23.624694 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528d4ff-6c88-43cb-af53-467197f4568f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:23.626609 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528d4ff-6c88-43cb-af53-467197f4568f admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:23.626927 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528d4ff-6c88-43cb-af53-467197f4568f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:23.628085 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528d4ff-6c88-43cb-af53-467197f4568f admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:23.628208 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40403655-ba2f-44a0-ab6d-eaa28c6d294d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:23.628856 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40403655-ba2f-44a0-ab6d-eaa28c6d294d service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:23.629225 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40403655-ba2f-44a0-ab6d-eaa28c6d294d service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:23.629534 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40403655-ba2f-44a0-ab6d-eaa28c6d294d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:23.634096 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528d4ff-6c88-43cb-af53-467197f4568f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:23.638838 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528d4ff-6c88-43cb-af53-467197f4568f admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:23.649477 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40403655-ba2f-44a0-ab6d-eaa28c6d294d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:23.653637 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40403655-ba2f-44a0-ab6d-eaa28c6d294d service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:23.674754 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 833/1656] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:23.676344 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40403655-ba2f-44a0-ab6d-eaa28c6d294d service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:23.678504 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-40403655-ba2f-44a0-ab6d-eaa28c6d294d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:23.705709 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 824/1657] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:23 2021] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:23.706894 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528d4ff-6c88-43cb-af53-467197f4568f admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:23.721392 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40403655-ba2f-44a0-ab6d-eaa28c6d294d service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:23.750704 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521b7e2-877f-4278-b12a-3ebd2b2c9619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:23.750899 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528d4ff-6c88-43cb-af53-467197f4568f admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:23.753117 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521b7e2-877f-4278-b12a-3ebd2b2c9619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:23.753733 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521b7e2-877f-4278-b12a-3ebd2b2c9619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:23.754168 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521b7e2-877f-4278-b12a-3ebd2b2c9619 admin admin] PATH_INFO: `/v3/projects/549ad010d4024b1796ab101e294d003b` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:23.756936 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521b7e2-877f-4278-b12a-3ebd2b2c9619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=549ad010d4024b1796ab101e294d003b)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:23.759876 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521b7e2-877f-4278-b12a-3ebd2b2c9619 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:23.761082 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71d61b-34fd-4544-b09b-dd1dfaf52063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:23.762089 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71d61b-34fd-4544-b09b-dd1dfaf52063 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:23.762360 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71d61b-34fd-4544-b09b-dd1dfaf52063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:23.762663 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71d61b-34fd-4544-b09b-dd1dfaf52063 admin admin] PATH_INFO: `/v3/projects/247cb17503294fb2b7567b7bcf079f63/users/a94b66cb08f54c7084c322b57698d96c/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:23.796453 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71d61b-34fd-4544-b09b-dd1dfaf52063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=247cb17503294fb2b7567b7bcf079f63, user_id=a94b66cb08f54c7084c322b57698d96c, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:23.802893 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71d61b-34fd-4544-b09b-dd1dfaf52063 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:23.838997 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 825/1658] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:23 2021] PUT /identity/v3/projects/247cb17503294fb2b7567b7bcf079f63/users/a94b66cb08f54c7084c322b57698d96c/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:23.854368 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71d61b-34fd-4544-b09b-dd1dfaf52063 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:23.863431 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-9c71d61b-34fd-4544-b09b-dd1dfaf52063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:23.895067 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-6521b7e2-877f-4278-b12a-3ebd2b2c9619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '549ad010d4024b1796ab101e294d003b', 'request_id': 'req-6521b7e2-877f-4278-b12a-3ebd2b2c9619'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:23.916049 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-6521b7e2-877f-4278-b12a-3ebd2b2c9619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '549ad010d4024b1796ab101e294d003b', 'request_id': 'req-6521b7e2-877f-4278-b12a-3ebd2b2c9619'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:23.933178 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-6521b7e2-877f-4278-b12a-3ebd2b2c9619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '549ad010d4024b1796ab101e294d003b', 'request_id': 'req-6521b7e2-877f-4278-b12a-3ebd2b2c9619'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:23.974117 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-6521b7e2-877f-4278-b12a-3ebd2b2c9619 admin admin] The token cache is being invalidate because project 549ad010d4024b1796ab101e294d003b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:38:23.975047 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-6521b7e2-877f-4278-b12a-3ebd2b2c9619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:23.977399 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-6521b7e2-877f-4278-b12a-3ebd2b2c9619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:23.985889 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 834/1659] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:38:23 2021] DELETE /identity/v3/projects/549ad010d4024b1796ab101e294d003b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:23.988162 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521b7e2-877f-4278-b12a-3ebd2b2c9619 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:23.994400 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-6521b7e2-877f-4278-b12a-3ebd2b2c9619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:24.030256 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71d61b-34fd-4544-b09b-dd1dfaf52063 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:24.138727 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232059f-0ae5-474a-aff9-df3c3bec4e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:24.140740 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232059f-0ae5-474a-aff9-df3c3bec4e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:24.141289 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232059f-0ae5-474a-aff9-df3c3bec4e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:24.141467 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232059f-0ae5-474a-aff9-df3c3bec4e3d admin admin] PATH_INFO: `/v3/users/3c20f31a1826483ca92b923482984d5b` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:24.143207 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232059f-0ae5-474a-aff9-df3c3bec4e3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c20f31a1826483ca92b923482984d5b)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:24.145191 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232059f-0ae5-474a-aff9-df3c3bec4e3d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:24.234995 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521b7e2-877f-4278-b12a-3ebd2b2c9619 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:24.248947 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-e232059f-0ae5-474a-aff9-df3c3bec4e3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c20f31a1826483ca92b923482984d5b'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:24.258711 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442ad16-5e88-498d-9b86-4e989cbb5fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:24.267538 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442ad16-5e88-498d-9b86-4e989cbb5fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:24.268534 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442ad16-5e88-498d-9b86-4e989cbb5fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:24.268997 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442ad16-5e88-498d-9b86-4e989cbb5fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:24.269793 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442ad16-5e88-498d-9b86-4e989cbb5fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:24.270842 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-e232059f-0ae5-474a-aff9-df3c3bec4e3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c20f31a1826483ca92b923482984d5b'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:24.271989 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442ad16-5e88-498d-9b86-4e989cbb5fe1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:24.281393 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-e232059f-0ae5-474a-aff9-df3c3bec4e3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c20f31a1826483ca92b923482984d5b'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:24.282364 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-e232059f-0ae5-474a-aff9-df3c3bec4e3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c20f31a1826483ca92b923482984d5b'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:24.291639 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-e232059f-0ae5-474a-aff9-df3c3bec4e3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c20f31a1826483ca92b923482984d5b'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:24.296948 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 835/1660] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:23 2021] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:24.299226 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f13a8-d06c-4d52-943a-f8d283cbaac4 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:24.299796 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f13a8-d06c-4d52-943a-f8d283cbaac4 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:24.300213 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f13a8-d06c-4d52-943a-f8d283cbaac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:24.306238 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 826/1661] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:38:23 2021] DELETE /identity/v3/users/3c20f31a1826483ca92b923482984d5b => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:24.307915 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff54ad-11c9-45a0-8472-e75b8674ccfc None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:24.308326 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff54ad-11c9-45a0-8472-e75b8674ccfc None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:24.308713 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff54ad-11c9-45a0-8472-e75b8674ccfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:24.335753 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-7fff54ad-11c9-45a0-8472-e75b8674ccfc None None] MFA Rules not processed for user `3ea75b4f9132494388b223a309a40640`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:24.339563 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7fff54ad-11c9-45a0-8472-e75b8674ccfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:24.341930 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-686f13a8-d06c-4d52-943a-f8d283cbaac4 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:24.348931 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-686f13a8-d06c-4d52-943a-f8d283cbaac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:24.511294 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 836/1662] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:24.513310 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad612435-de47-4e04-9b87-ed1e2017b367 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:24.513444 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 827/1663] 10.222.0.37 () {58 vars in 1015 bytes} [Fri Oct 15 03:38:24 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:24.513680 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad612435-de47-4e04-9b87-ed1e2017b367 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:24.513969 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad612435-de47-4e04-9b87-ed1e2017b367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:24.514281 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff54ad-11c9-45a0-8472-e75b8674ccfc None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:24.518864 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7fff54ad-11c9-45a0-8472-e75b8674ccfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:24.554509 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff54ad-11c9-45a0-8472-e75b8674ccfc None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:24.572702 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64062f4-4506-4ffd-8bb5-d0f5a0f1c103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:24.577770 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-ad612435-de47-4e04-9b87-ed1e2017b367 None None] MFA Rules not processed for user `d795b4264cbe4aff82f5a2b0275ca972`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:24.579034 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-ad612435-de47-4e04-9b87-ed1e2017b367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:24.580349 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64062f4-4506-4ffd-8bb5-d0f5a0f1c103 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:24.580579 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64062f4-4506-4ffd-8bb5-d0f5a0f1c103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:24.580861 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64062f4-4506-4ffd-8bb5-d0f5a0f1c103 admin admin] PATH_INFO: `/v3/projects/247cb17503294fb2b7567b7bcf079f63/users/a94b66cb08f54c7084c322b57698d96c/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:24.587316 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64062f4-4506-4ffd-8bb5-d0f5a0f1c103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=247cb17503294fb2b7567b7bcf079f63, user_id=a94b66cb08f54c7084c322b57698d96c, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:24.601598 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64062f4-4506-4ffd-8bb5-d0f5a0f1c103 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:24.642227 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 828/1664] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:24 2021] PUT /identity/v3/projects/247cb17503294fb2b7567b7bcf079f63/users/a94b66cb08f54c7084c322b57698d96c/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:24.645646 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ad272-a11c-4acb-84a2-bdd9ab62f1d4 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:24.645937 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ad272-a11c-4acb-84a2-bdd9ab62f1d4 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:24.646213 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ad272-a11c-4acb-84a2-bdd9ab62f1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:24.707634 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-1a1ad272-a11c-4acb-84a2-bdd9ab62f1d4 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:24.713773 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-1a1ad272-a11c-4acb-84a2-bdd9ab62f1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:24.808623 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 837/1665] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:24 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:24.813012 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecb698-b078-401c-8b40-20d6d6fedfad None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:24.830748 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecb698-b078-401c-8b40-20d6d6fedfad None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:24.832043 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecb698-b078-401c-8b40-20d6d6fedfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:24.856660 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-34ecb698-b078-401c-8b40-20d6d6fedfad None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:24.856660 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-34ecb698-b078-401c-8b40-20d6d6fedfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:24.921097 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 838/1666] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:24.923087 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024865fd-77a7-41a9-aad4-c3842e71effe None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:24.923388 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024865fd-77a7-41a9-aad4-c3842e71effe None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:24.923671 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024865fd-77a7-41a9-aad4-c3842e71effe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:24.969142 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-024865fd-77a7-41a9-aad4-c3842e71effe None None] MFA Rules not processed for user `a94b66cb08f54c7084c322b57698d96c`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:24.971851 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-024865fd-77a7-41a9-aad4-c3842e71effe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:24.998100 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 829/1667] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:24.999222 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ad272-a11c-4acb-84a2-bdd9ab62f1d4 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:25.003209 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-1a1ad272-a11c-4acb-84a2-bdd9ab62f1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:25.122056 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ad272-a11c-4acb-84a2-bdd9ab62f1d4 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:25.126134 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff2627-3b1c-4163-9fa3-73ac22b74896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:25.126815 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff2627-3b1c-4163-9fa3-73ac22b74896 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:25.127095 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff2627-3b1c-4163-9fa3-73ac22b74896 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:25.127376 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff2627-3b1c-4163-9fa3-73ac22b74896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:25.138172 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff2627-3b1c-4163-9fa3-73ac22b74896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:25.139568 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff2627-3b1c-4163-9fa3-73ac22b74896 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:25.148754 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 830/1668] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:24 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:25.149599 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff2627-3b1c-4163-9fa3-73ac22b74896 service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:25.151980 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-6eff2627-3b1c-4163-9fa3-73ac22b74896 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:25.172588 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 839/1669] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:24 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:25.173870 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024865fd-77a7-41a9-aad4-c3842e71effe None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:25.201869 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024865fd-77a7-41a9-aad4-c3842e71effe None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:25.217105 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d85f03-4d76-415f-8ddf-1d4e52f47918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:25.218264 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d85f03-4d76-415f-8ddf-1d4e52f47918 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:25.218655 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d85f03-4d76-415f-8ddf-1d4e52f47918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:25.219143 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d85f03-4d76-415f-8ddf-1d4e52f47918 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:25.220237 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d85f03-4d76-415f-8ddf-1d4e52f47918 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:38:25.221947 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d85f03-4d76-415f-8ddf-1d4e52f47918 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:25.225425 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d85f03-4d76-415f-8ddf-1d4e52f47918 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:25.304693 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff2627-3b1c-4163-9fa3-73ac22b74896 service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:25.314457 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 840/1670] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:38:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:38:25.315559 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648b2f4-e622-4849-a11a-bce70da92184 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:25.316280 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648b2f4-e622-4849-a11a-bce70da92184 service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:25.316560 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648b2f4-e622-4849-a11a-bce70da92184 service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:25.317009 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648b2f4-e622-4849-a11a-bce70da92184 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:25.317905 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d85f03-4d76-415f-8ddf-1d4e52f47918 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:25.353707 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d85f03-4d76-415f-8ddf-1d4e52f47918 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:25.370437 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc72e77-c3a8-4780-92b3-8ee139eaf195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:25.373450 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc72e77-c3a8-4780-92b3-8ee139eaf195 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:25.374273 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc72e77-c3a8-4780-92b3-8ee139eaf195 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:25.375912 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc72e77-c3a8-4780-92b3-8ee139eaf195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:25.400489 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4648b2f4-e622-4849-a11a-bce70da92184 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:25.403276 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4648b2f4-e622-4849-a11a-bce70da92184 service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:25.412748 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc72e77-c3a8-4780-92b3-8ee139eaf195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:25.415173 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc72e77-c3a8-4780-92b3-8ee139eaf195 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:25.437119 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 831/1671] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:25 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:25.439767 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648b2f4-e622-4849-a11a-bce70da92184 service nova] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:25.441931 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 841/1672] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:25.444492 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-4648b2f4-e622-4849-a11a-bce70da92184 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:25.462731 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc72e77-c3a8-4780-92b3-8ee139eaf195 service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:25.524251 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc72e77-c3a8-4780-92b3-8ee139eaf195 service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:25.529857 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f7f30-6146-4efa-98f3-cd415e12b0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:25.530723 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f7f30-6146-4efa-98f3-cd415e12b0ce admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:25.531202 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f7f30-6146-4efa-98f3-cd415e12b0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:25.531708 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f7f30-6146-4efa-98f3-cd415e12b0ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:25.532846 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f7f30-6146-4efa-98f3-cd415e12b0ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:25.536228 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f7f30-6146-4efa-98f3-cd415e12b0ce admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:25.601100 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648b2f4-e622-4849-a11a-bce70da92184 service nova] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:25.604978 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5343ef-0989-45ed-8672-1cb79273ffc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:25.606175 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5343ef-0989-45ed-8672-1cb79273ffc8 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:25.607192 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5343ef-0989-45ed-8672-1cb79273ffc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:25.607480 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5343ef-0989-45ed-8672-1cb79273ffc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:25.611718 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 842/1673] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:25 2021] POST /identity/v3/projects => generated 369 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:25.615092 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f7f30-6146-4efa-98f3-cd415e12b0ce admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:25.645281 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5343ef-0989-45ed-8672-1cb79273ffc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:25.648794 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5343ef-0989-45ed-8672-1cb79273ffc8 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:25.692328 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 832/1674] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:25 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:25.810847 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f7f30-6146-4efa-98f3-cd415e12b0ce admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:25.822216 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225e113-9ee1-4379-8ad6-d527b3770d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:25.832728 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225e113-9ee1-4379-8ad6-d527b3770d6e admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:25.836983 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5343ef-0989-45ed-8672-1cb79273ffc8 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:25.837492 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225e113-9ee1-4379-8ad6-d527b3770d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:25.838279 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225e113-9ee1-4379-8ad6-d527b3770d6e admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:25.839135 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225e113-9ee1-4379-8ad6-d527b3770d6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:25.859793 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5343ef-0989-45ed-8672-1cb79273ffc8 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:25.860707 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225e113-9ee1-4379-8ad6-d527b3770d6e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:25.951972 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 843/1675] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:25 2021] POST /identity/v3/users => generated 285 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:25.956748 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225e113-9ee1-4379-8ad6-d527b3770d6e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:25.977126 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225e113-9ee1-4379-8ad6-d527b3770d6e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:25.989964 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659e9db-8a2a-4032-90bc-6c75c32dd16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:25.990658 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659e9db-8a2a-4032-90bc-6c75c32dd16e admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:25.990942 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659e9db-8a2a-4032-90bc-6c75c32dd16e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:25.991832 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659e9db-8a2a-4032-90bc-6c75c32dd16e admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:25.992610 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659e9db-8a2a-4032-90bc-6c75c32dd16e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:25.999751 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659e9db-8a2a-4032-90bc-6c75c32dd16e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:26.046145 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 844/1676] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:25 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:26.055739 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659e9db-8a2a-4032-90bc-6c75c32dd16e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:26.071283 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659e9db-8a2a-4032-90bc-6c75c32dd16e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:26.082008 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e8aea-94a7-4f76-8d5a-1a4d3f66e3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:26.082692 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e8aea-94a7-4f76-8d5a-1a4d3f66e3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:26.083036 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e8aea-94a7-4f76-8d5a-1a4d3f66e3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:26.083240 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e8aea-94a7-4f76-8d5a-1a4d3f66e3f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:26.100474 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e8aea-94a7-4f76-8d5a-1a4d3f66e3f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:26.103655 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a1ef8-e070-47e3-b641-71ef525f7bba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:26.104373 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a1ef8-e070-47e3-b641-71ef525f7bba service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:26.104663 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a1ef8-e070-47e3-b641-71ef525f7bba service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:26.104941 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a1ef8-e070-47e3-b641-71ef525f7bba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:26.109536 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-869a1ef8-e070-47e3-b641-71ef525f7bba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:26.109987 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e8aea-94a7-4f76-8d5a-1a4d3f66e3f9 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:26.148660 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 845/1677] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:26 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:38:26.152815 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e8aea-94a7-4f76-8d5a-1a4d3f66e3f9 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:26.172872 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e8aea-94a7-4f76-8d5a-1a4d3f66e3f9 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:26.183370 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191759ae-befc-4f1a-a796-61c1944ead30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:26.185245 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191759ae-befc-4f1a-a796-61c1944ead30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:26.185672 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191759ae-befc-4f1a-a796-61c1944ead30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:26.186084 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191759ae-befc-4f1a-a796-61c1944ead30 admin admin] PATH_INFO: `/v3/projects/1e57d88e2fc54151a7d137754337c3e1/users/af7f367464864f40ab020463a4a04d47/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:26.218637 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191759ae-befc-4f1a-a796-61c1944ead30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e57d88e2fc54151a7d137754337c3e1, user_id=af7f367464864f40ab020463a4a04d47, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:26.221654 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191759ae-befc-4f1a-a796-61c1944ead30 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:26.262629 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 846/1678] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:26 2021] PUT /identity/v3/projects/1e57d88e2fc54151a7d137754337c3e1/users/af7f367464864f40ab020463a4a04d47/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:26.334253 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5d133-00b6-4bb9-bedd-153f3b21f6a0 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:26.334602 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5d133-00b6-4bb9-bedd-153f3b21f6a0 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:26.335051 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5d133-00b6-4bb9-bedd-153f3b21f6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:26.348913 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a1ef8-e070-47e3-b641-71ef525f7bba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:26.350390 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a1ef8-e070-47e3-b641-71ef525f7bba service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:26.378439 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 833/1679] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:25 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:38:26.399209 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a1ef8-e070-47e3-b641-71ef525f7bba service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:26.401322 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-869a1ef8-e070-47e3-b641-71ef525f7bba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:26.408885 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-4ae5d133-00b6-4bb9-bedd-153f3b21f6a0 None None] MFA Rules not processed for user `af7f367464864f40ab020463a4a04d47`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:26.412685 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-4ae5d133-00b6-4bb9-bedd-153f3b21f6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:26.425068 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a1ef8-e070-47e3-b641-71ef525f7bba service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:26.571823 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ababf-01ac-4ae1-8b91-9a2b9321a0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:26.573240 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ababf-01ac-4ae1-8b91-9a2b9321a0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:26.573665 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ababf-01ac-4ae1-8b91-9a2b9321a0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:26.574703 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ababf-01ac-4ae1-8b91-9a2b9321a0bb admin admin] PATH_INFO: `/v3/projects/76d19e2158b04733b678a44fb39408ad` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:26.578019 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ababf-01ac-4ae1-8b91-9a2b9321a0bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d19e2158b04733b678a44fb39408ad)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:26.584419 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 847/1680] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:26 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:26.588263 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ababf-01ac-4ae1-8b91-9a2b9321a0bb admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:26.599387 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5d133-00b6-4bb9-bedd-153f3b21f6a0 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:26.624835 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5d133-00b6-4bb9-bedd-153f3b21f6a0 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:26.639109 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e53f5f-40c0-4033-95b1-0f1644c30a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:26.641239 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e53f5f-40c0-4033-95b1-0f1644c30a36 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:26.641637 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e53f5f-40c0-4033-95b1-0f1644c30a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:26.642936 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e53f5f-40c0-4033-95b1-0f1644c30a36 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:26.645302 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e53f5f-40c0-4033-95b1-0f1644c30a36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:26.651514 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e53f5f-40c0-4033-95b1-0f1644c30a36 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:26.737434 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 848/1681] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:26 2021] POST /identity/v3/projects => generated 369 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:26.744596 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e53f5f-40c0-4033-95b1-0f1644c30a36 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:26.754039 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-886ababf-01ac-4ae1-8b91-9a2b9321a0bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d19e2158b04733b678a44fb39408ad', 'request_id': 'req-886ababf-01ac-4ae1-8b91-9a2b9321a0bb'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:26.767142 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-886ababf-01ac-4ae1-8b91-9a2b9321a0bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d19e2158b04733b678a44fb39408ad', 'request_id': 'req-886ababf-01ac-4ae1-8b91-9a2b9321a0bb'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:26.787453 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-886ababf-01ac-4ae1-8b91-9a2b9321a0bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d19e2158b04733b678a44fb39408ad', 'request_id': 'req-886ababf-01ac-4ae1-8b91-9a2b9321a0bb'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:26.813280 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-886ababf-01ac-4ae1-8b91-9a2b9321a0bb admin admin] The token cache is being invalidate because project 76d19e2158b04733b678a44fb39408ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:38:26.813903 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-886ababf-01ac-4ae1-8b91-9a2b9321a0bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:26.815271 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-886ababf-01ac-4ae1-8b91-9a2b9321a0bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:26.817530 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 834/1682] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:38:26 2021] DELETE /identity/v3/projects/76d19e2158b04733b678a44fb39408ad => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:26.823525 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37adec5-9fd6-4a68-a4eb-91c3342344c7 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:26.825105 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37adec5-9fd6-4a68-a4eb-91c3342344c7 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:26.825670 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37adec5-9fd6-4a68-a4eb-91c3342344c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:26.857430 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-c37adec5-9fd6-4a68-a4eb-91c3342344c7 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:26.860443 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c37adec5-9fd6-4a68-a4eb-91c3342344c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:26.988594 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 835/1683] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:26.998217 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d615c79-fc6d-46c1-8bd7-d48a24ed917b None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:26.998736 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d615c79-fc6d-46c1-8bd7-d48a24ed917b None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:27.002291 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d615c79-fc6d-46c1-8bd7-d48a24ed917b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:27.015301 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e53f5f-40c0-4033-95b1-0f1644c30a36 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:27.036563 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9550a-7872-4d89-81ef-f62dbb0e82d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:27.037257 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-1d615c79-fc6d-46c1-8bd7-d48a24ed917b None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:27.037338 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9550a-7872-4d89-81ef-f62dbb0e82d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:27.037548 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9550a-7872-4d89-81ef-f62dbb0e82d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:27.037830 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9550a-7872-4d89-81ef-f62dbb0e82d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:27.038589 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9550a-7872-4d89-81ef-f62dbb0e82d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:27.038687 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-1d615c79-fc6d-46c1-8bd7-d48a24ed917b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:27.049969 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 836/1684] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:27.052217 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9550a-7872-4d89-81ef-f62dbb0e82d0 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:27.067837 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d615c79-fc6d-46c1-8bd7-d48a24ed917b None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:27.080100 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d615c79-fc6d-46c1-8bd7-d48a24ed917b None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:27.092099 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd12ea-d5ca-4aab-a035-c59e6db76304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:27.092784 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd12ea-d5ca-4aab-a035-c59e6db76304 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:27.093717 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd12ea-d5ca-4aab-a035-c59e6db76304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:27.094009 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd12ea-d5ca-4aab-a035-c59e6db76304 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:27.094942 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd12ea-d5ca-4aab-a035-c59e6db76304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:38:27.114564 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd12ea-d5ca-4aab-a035-c59e6db76304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:27.116464 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 849/1685] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:26 2021] POST /identity/v3/users => generated 291 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:27.119235 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd12ea-d5ca-4aab-a035-c59e6db76304 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:27.126722 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9550a-7872-4d89-81ef-f62dbb0e82d0 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:27.130356 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-48d9550a-7872-4d89-81ef-f62dbb0e82d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:27.166647 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 837/1686] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:38:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:38:27.170130 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9550a-7872-4d89-81ef-f62dbb0e82d0 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:27.171872 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd12ea-d5ca-4aab-a035-c59e6db76304 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:27.193145 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dee4ed-48e1-4eb3-9895-e700844300e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:27.194530 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dee4ed-48e1-4eb3-9895-e700844300e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:27.195195 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dee4ed-48e1-4eb3-9895-e700844300e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:27.195866 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dee4ed-48e1-4eb3-9895-e700844300e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:27.196580 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd12ea-d5ca-4aab-a035-c59e6db76304 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:27.199833 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dee4ed-48e1-4eb3-9895-e700844300e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:27.202250 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dee4ed-48e1-4eb3-9895-e700844300e9 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:27.211069 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136fac3-242b-48e5-b349-5a630d7286df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:27.211069 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136fac3-242b-48e5-b349-5a630d7286df admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:27.211069 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136fac3-242b-48e5-b349-5a630d7286df admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:27.211069 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136fac3-242b-48e5-b349-5a630d7286df admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:27.212060 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136fac3-242b-48e5-b349-5a630d7286df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:27.214267 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136fac3-242b-48e5-b349-5a630d7286df admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:27.236141 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 850/1687] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:27 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:27.240644 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dee4ed-48e1-4eb3-9895-e700844300e9 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:27.269017 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dee4ed-48e1-4eb3-9895-e700844300e9 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:27.281055 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6b3aa-5ddd-467e-874d-77fe98815d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:27.284535 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6b3aa-5ddd-467e-874d-77fe98815d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:27.284826 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6b3aa-5ddd-467e-874d-77fe98815d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:27.285348 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6b3aa-5ddd-467e-874d-77fe98815d43 admin admin] PATH_INFO: `/v3/projects/95e0e26d1b994cf5a231eb3cc03ff90c/users/f0bcf1af179c410b86c1ae1c679ca2e7/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:27.320573 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 838/1688] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:27 2021] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:38:27.334356 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136fac3-242b-48e5-b349-5a630d7286df admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:27.355185 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e6b3aa-5ddd-467e-874d-77fe98815d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e0e26d1b994cf5a231eb3cc03ff90c, user_id=f0bcf1af179c410b86c1ae1c679ca2e7, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:27.358486 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e6b3aa-5ddd-467e-874d-77fe98815d43 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:27.399242 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 851/1689] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:27 2021] PUT /identity/v3/projects/95e0e26d1b994cf5a231eb3cc03ff90c/users/f0bcf1af179c410b86c1ae1c679ca2e7/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:27.401547 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6b3aa-5ddd-467e-874d-77fe98815d43 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:27.464698 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136fac3-242b-48e5-b349-5a630d7286df admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:27.567163 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6b3aa-5ddd-467e-874d-77fe98815d43 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:27.583057 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c277e58-12f4-4968-977e-80adda4f798b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:27.583870 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c277e58-12f4-4968-977e-80adda4f798b admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:27.584090 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c277e58-12f4-4968-977e-80adda4f798b admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:27.584367 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c277e58-12f4-4968-977e-80adda4f798b admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:27.585387 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c277e58-12f4-4968-977e-80adda4f798b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:27.586740 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c277e58-12f4-4968-977e-80adda4f798b admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:27.611427 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 852/1690] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:27 2021] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:27.615771 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c277e58-12f4-4968-977e-80adda4f798b admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:27.636523 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cc8ab-e26c-4cfa-b510-e48b4ee10b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:27.637489 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cc8ab-e26c-4cfa-b510-e48b4ee10b28 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:27.637862 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cc8ab-e26c-4cfa-b510-e48b4ee10b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:27.638235 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cc8ab-e26c-4cfa-b510-e48b4ee10b28 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:27.639088 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cc8ab-e26c-4cfa-b510-e48b4ee10b28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:27.641237 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cc8ab-e26c-4cfa-b510-e48b4ee10b28 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:27.642181 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c277e58-12f4-4968-977e-80adda4f798b admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:27.657049 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f0bde-a451-499c-9a15-3fdfe8cee52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:27.658993 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f0bde-a451-499c-9a15-3fdfe8cee52e admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:27.659447 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f0bde-a451-499c-9a15-3fdfe8cee52e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:27.660892 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f0bde-a451-499c-9a15-3fdfe8cee52e admin admin] PATH_INFO: `/v3/projects/95e0e26d1b994cf5a231eb3cc03ff90c/users/f0bcf1af179c410b86c1ae1c679ca2e7/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:27.662052 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f0bde-a451-499c-9a15-3fdfe8cee52e admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e0e26d1b994cf5a231eb3cc03ff90c, user_id=f0bcf1af179c410b86c1ae1c679ca2e7, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:27.665160 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f0bde-a451-499c-9a15-3fdfe8cee52e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:27.704058 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 853/1691] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:27 2021] PUT /identity/v3/projects/95e0e26d1b994cf5a231eb3cc03ff90c/users/f0bcf1af179c410b86c1ae1c679ca2e7/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:27.705610 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b537ac8-a537-4ef0-89f6-dbba532f51ae None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:27.705928 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 839/1692] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:27 2021] POST /identity/v3/users => generated 283 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:27.706146 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b537ac8-a537-4ef0-89f6-dbba532f51ae None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:27.706428 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b537ac8-a537-4ef0-89f6-dbba532f51ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:27.710281 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cc8ab-e26c-4cfa-b510-e48b4ee10b28 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:27.743929 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cc8ab-e26c-4cfa-b510-e48b4ee10b28 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:27.763278 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-5b537ac8-a537-4ef0-89f6-dbba532f51ae None None] MFA Rules not processed for user `f0bcf1af179c410b86c1ae1c679ca2e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:27.764841 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-5b537ac8-a537-4ef0-89f6-dbba532f51ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:27.937250 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb109b7-adb0-4d53-9ab8-2d5f2b5e17ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:27.937958 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb109b7-adb0-4d53-9ab8-2d5f2b5e17ef admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:27.938251 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb109b7-adb0-4d53-9ab8-2d5f2b5e17ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:27.938530 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb109b7-adb0-4d53-9ab8-2d5f2b5e17ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:27.939287 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb109b7-adb0-4d53-9ab8-2d5f2b5e17ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:27.943388 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb109b7-adb0-4d53-9ab8-2d5f2b5e17ef admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:27.991589 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 840/1693] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:27 2021] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:38:27.992621 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb109b7-adb0-4d53-9ab8-2d5f2b5e17ef admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:28.007822 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 854/1694] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:27 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:28.021300 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb109b7-adb0-4d53-9ab8-2d5f2b5e17ef admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:28.041339 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a147a5-7a3c-4eea-8e38-155f5374dbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:28.042046 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a147a5-7a3c-4eea-8e38-155f5374dbd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:28.042374 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a147a5-7a3c-4eea-8e38-155f5374dbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:28.042588 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a147a5-7a3c-4eea-8e38-155f5374dbd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:28.043351 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a147a5-7a3c-4eea-8e38-155f5374dbd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:28.045200 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a147a5-7a3c-4eea-8e38-155f5374dbd2 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:28.051086 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b537ac8-a537-4ef0-89f6-dbba532f51ae None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:28.053485 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-5b537ac8-a537-4ef0-89f6-dbba532f51ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:28.083233 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 841/1695] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:27 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:28.084177 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a147a5-7a3c-4eea-8e38-155f5374dbd2 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:28.084509 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b537ac8-a537-4ef0-89f6-dbba532f51ae None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:28.118511 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3371163-1ec9-44c5-926a-23f4a8c9cb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:28.119194 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a147a5-7a3c-4eea-8e38-155f5374dbd2 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:28.123282 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3371163-1ec9-44c5-926a-23f4a8c9cb08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:28.123897 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3371163-1ec9-44c5-926a-23f4a8c9cb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:28.124820 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3371163-1ec9-44c5-926a-23f4a8c9cb08 admin admin] PATH_INFO: `/v3/projects/d6c17981f1ce4d7c88b53e155ea14ad2` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:28.126898 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3371163-1ec9-44c5-926a-23f4a8c9cb08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c17981f1ce4d7c88b53e155ea14ad2)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:28.133457 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2727ef5-616f-45a3-b0d6-58670d03239c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:28.134359 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2727ef5-616f-45a3-b0d6-58670d03239c admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:28.134647 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2727ef5-616f-45a3-b0d6-58670d03239c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:28.134925 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2727ef5-616f-45a3-b0d6-58670d03239c admin admin] PATH_INFO: `/v3/projects/c77028318bf34142b032679ca3c590af/users/0319cf152f1045bc8bf7d014cf43a234/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:28.136184 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3371163-1ec9-44c5-926a-23f4a8c9cb08 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:28.169685 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2727ef5-616f-45a3-b0d6-58670d03239c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77028318bf34142b032679ca3c590af, user_id=0319cf152f1045bc8bf7d014cf43a234, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:28.172415 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2727ef5-616f-45a3-b0d6-58670d03239c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:28.202875 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 842/1696] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:28 2021] PUT /identity/v3/projects/c77028318bf34142b032679ca3c590af/users/0319cf152f1045bc8bf7d014cf43a234/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:28.213905 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2727ef5-616f-45a3-b0d6-58670d03239c admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:28.219493 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-b2727ef5-616f-45a3-b0d6-58670d03239c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:28.268982 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d3371163-1ec9-44c5-926a-23f4a8c9cb08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c17981f1ce4d7c88b53e155ea14ad2', 'request_id': 'req-d3371163-1ec9-44c5-926a-23f4a8c9cb08'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:28.286085 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d3371163-1ec9-44c5-926a-23f4a8c9cb08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c17981f1ce4d7c88b53e155ea14ad2', 'request_id': 'req-d3371163-1ec9-44c5-926a-23f4a8c9cb08'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:28.318176 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d3371163-1ec9-44c5-926a-23f4a8c9cb08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c17981f1ce4d7c88b53e155ea14ad2', 'request_id': 'req-d3371163-1ec9-44c5-926a-23f4a8c9cb08'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:28.356425 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d3371163-1ec9-44c5-926a-23f4a8c9cb08 admin admin] The token cache is being invalidate because project d6c17981f1ce4d7c88b53e155ea14ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:38:28.356898 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d3371163-1ec9-44c5-926a-23f4a8c9cb08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:28.358866 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d3371163-1ec9-44c5-926a-23f4a8c9cb08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:28.365820 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 855/1697] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:38:28 2021] DELETE /identity/v3/projects/d6c17981f1ce4d7c88b53e155ea14ad2 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:28.368912 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c4d78-74e9-44d0-907a-53dd43ea01e6 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:28.369213 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c4d78-74e9-44d0-907a-53dd43ea01e6 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:28.373612 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c4d78-74e9-44d0-907a-53dd43ea01e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:28.408090 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2727ef5-616f-45a3-b0d6-58670d03239c admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:28.464569 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-018c4d78-74e9-44d0-907a-53dd43ea01e6 None None] MFA Rules not processed for user `0319cf152f1045bc8bf7d014cf43a234`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:28.473164 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-018c4d78-74e9-44d0-907a-53dd43ea01e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:28.625938 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78350557-9840-46cd-8aaf-fe58ca467112 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:28.629033 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78350557-9840-46cd-8aaf-fe58ca467112 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:28.634156 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78350557-9840-46cd-8aaf-fe58ca467112 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:28.634561 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78350557-9840-46cd-8aaf-fe58ca467112 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:28.638551 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-78350557-9840-46cd-8aaf-fe58ca467112 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:28.745939 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 856/1698] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:28 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:28.749295 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c4d78-74e9-44d0-907a-53dd43ea01e6 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:28.762509 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-018c4d78-74e9-44d0-907a-53dd43ea01e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:28.839323 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78350557-9840-46cd-8aaf-fe58ca467112 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:28.844000 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78350557-9840-46cd-8aaf-fe58ca467112 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:28.879640 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 843/1699] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:28 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 676 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:28.904678 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcca3b-373a-4129-b741-59d205de1098 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:28.904978 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcca3b-373a-4129-b741-59d205de1098 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:28.905418 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcca3b-373a-4129-b741-59d205de1098 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:28.908877 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 844/1700] 10.222.0.30 () {54 vars in 921 bytes} [Fri Oct 15 03:38:28 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:38:28.978273 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcca3b-373a-4129-b741-59d205de1098 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:28.980309 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-68bcca3b-373a-4129-b741-59d205de1098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:29.034276 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c4d78-74e9-44d0-907a-53dd43ea01e6 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:29.047608 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf695e9-5c5b-49a1-80f5-d0b80f441349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:29.048464 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcca3b-373a-4129-b741-59d205de1098 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:29.049469 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf695e9-5c5b-49a1-80f5-d0b80f441349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:29.057594 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf695e9-5c5b-49a1-80f5-d0b80f441349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:29.058002 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf695e9-5c5b-49a1-80f5-d0b80f441349 admin admin] PATH_INFO: `/v3/users/b71534cddaeb42589af7acf42c690adf` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:29.064865 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ad3a4-0fcd-454f-9c59-9e482f6c3747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:29.065634 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ad3a4-0fcd-454f-9c59-9e482f6c3747 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:29.069273 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf695e9-5c5b-49a1-80f5-d0b80f441349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b71534cddaeb42589af7acf42c690adf)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:29.070154 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ad3a4-0fcd-454f-9c59-9e482f6c3747 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:29.070465 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ad3a4-0fcd-454f-9c59-9e482f6c3747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:29.073958 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf695e9-5c5b-49a1-80f5-d0b80f441349 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:29.104706 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ad3a4-0fcd-454f-9c59-9e482f6c3747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:29.106289 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ad3a4-0fcd-454f-9c59-9e482f6c3747 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:29.150536 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 845/1701] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:28 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:38:29.163390 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20f52d-b3a2-4dba-9e85-bd146c13d630 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:29.163809 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20f52d-b3a2-4dba-9e85-bd146c13d630 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:29.164195 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20f52d-b3a2-4dba-9e85-bd146c13d630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:29.193190 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-0bf695e9-5c5b-49a1-80f5-d0b80f441349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b71534cddaeb42589af7acf42c690adf'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:29.216976 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-ec20f52d-b3a2-4dba-9e85-bd146c13d630 None None] MFA Rules not processed for user `3d71a1bd93b04249b2b8e6a054de44c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:29.218392 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-ec20f52d-b3a2-4dba-9e85-bd146c13d630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:29.237865 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-0bf695e9-5c5b-49a1-80f5-d0b80f441349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b71534cddaeb42589af7acf42c690adf'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:29.277115 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-0bf695e9-5c5b-49a1-80f5-d0b80f441349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b71534cddaeb42589af7acf42c690adf'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:29.277423 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-0bf695e9-5c5b-49a1-80f5-d0b80f441349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b71534cddaeb42589af7acf42c690adf'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:29.304732 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-0bf695e9-5c5b-49a1-80f5-d0b80f441349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b71534cddaeb42589af7acf42c690adf'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:29.341048 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 857/1702] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:38:28 2021] DELETE /identity/v3/users/b71534cddaeb42589af7acf42c690adf => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:29.342200 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf695e9-5c5b-49a1-80f5-d0b80f441349 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:29.347376 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-0bf695e9-5c5b-49a1-80f5-d0b80f441349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:29.438281 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 846/1703] 10.222.0.30 () {58 vars in 1018 bytes} [Fri Oct 15 03:38:29 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:29.489745 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf695e9-5c5b-49a1-80f5-d0b80f441349 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:29.493403 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1a89f-b49d-436d-a1df-a9ff78883db7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:29.494055 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1a89f-b49d-436d-a1df-a9ff78883db7 service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:29.494337 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1a89f-b49d-436d-a1df-a9ff78883db7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:29.494608 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1a89f-b49d-436d-a1df-a9ff78883db7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:29.499734 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-10f1a89f-b49d-436d-a1df-a9ff78883db7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:29.573002 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f91ea-9bf7-48ba-8d1a-b0611814390c None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:29.573310 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f91ea-9bf7-48ba-8d1a-b0611814390c None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:29.573660 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f91ea-9bf7-48ba-8d1a-b0611814390c None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:29.576602 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 847/1704] 10.222.0.30 () {54 vars in 921 bytes} [Fri Oct 15 03:38:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:38:29.637570 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1a89f-b49d-436d-a1df-a9ff78883db7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:29.637570 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1a89f-b49d-436d-a1df-a9ff78883db7 service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:29.671022 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 858/1705] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:29 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:29.789683 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d2904-53ad-4610-9c40-2ff335a56bf6 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:29.790410 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d2904-53ad-4610-9c40-2ff335a56bf6 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:29.791032 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d2904-53ad-4610-9c40-2ff335a56bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:29.858562 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-675d2904-53ad-4610-9c40-2ff335a56bf6 None None] MFA Rules not processed for user `3d71a1bd93b04249b2b8e6a054de44c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:29.867406 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-675d2904-53ad-4610-9c40-2ff335a56bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:30.088192 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 848/1706] 10.222.0.30 () {58 vars in 1018 bytes} [Fri Oct 15 03:38:29 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:38:30.249597 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1a89f-b49d-436d-a1df-a9ff78883db7 service cinder] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:30.262110 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-10f1a89f-b49d-436d-a1df-a9ff78883db7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:30.301309 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1a89f-b49d-436d-a1df-a9ff78883db7 service cinder] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:30.308464 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdc132-d018-4d27-a6d8-99a5a9d25dd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:30.309304 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdc132-d018-4d27-a6d8-99a5a9d25dd9 service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:30.309598 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdc132-d018-4d27-a6d8-99a5a9d25dd9 service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:30.318017 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdc132-d018-4d27-a6d8-99a5a9d25dd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:30.333332 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fdc132-d018-4d27-a6d8-99a5a9d25dd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:30.336149 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fdc132-d018-4d27-a6d8-99a5a9d25dd9 service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:30.363926 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 859/1707] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:30 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:30.623708 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d2904-53ad-4610-9c40-2ff335a56bf6 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:30.625778 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-675d2904-53ad-4610-9c40-2ff335a56bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:30.657982 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d2904-53ad-4610-9c40-2ff335a56bf6 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:30.691982 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f503c-5dd4-43b5-bc79-0a2d6c8ae5be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:30.692702 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f503c-5dd4-43b5-bc79-0a2d6c8ae5be service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:30.692989 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f503c-5dd4-43b5-bc79-0a2d6c8ae5be service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:30.693269 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f503c-5dd4-43b5-bc79-0a2d6c8ae5be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:30.744351 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f503c-5dd4-43b5-bc79-0a2d6c8ae5be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:30.763158 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f503c-5dd4-43b5-bc79-0a2d6c8ae5be service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:30.819519 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 849/1708] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:30 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:31.560622 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdc132-d018-4d27-a6d8-99a5a9d25dd9 service nova] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:31.563296 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-16fdc132-d018-4d27-a6d8-99a5a9d25dd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:31.806837 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdc132-d018-4d27-a6d8-99a5a9d25dd9 service nova] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:31.835382 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0935b4-41b8-4379-9567-3a52371dc8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:31.836773 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0935b4-41b8-4379-9567-3a52371dc8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:31.837947 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0935b4-41b8-4379-9567-3a52371dc8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:31.840974 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0935b4-41b8-4379-9567-3a52371dc8ec admin admin] PATH_INFO: `/v3/projects/9f9d1510272545d0a45b7383be9a447c` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:31.844732 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0935b4-41b8-4379-9567-3a52371dc8ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f9d1510272545d0a45b7383be9a447c)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:31.853338 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0935b4-41b8-4379-9567-3a52371dc8ec admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:32.039799 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-3b0935b4-41b8-4379-9567-3a52371dc8ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f9d1510272545d0a45b7383be9a447c', 'request_id': 'req-3b0935b4-41b8-4379-9567-3a52371dc8ec'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:32.056613 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-3b0935b4-41b8-4379-9567-3a52371dc8ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f9d1510272545d0a45b7383be9a447c', 'request_id': 'req-3b0935b4-41b8-4379-9567-3a52371dc8ec'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:32.073912 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-3b0935b4-41b8-4379-9567-3a52371dc8ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f9d1510272545d0a45b7383be9a447c', 'request_id': 'req-3b0935b4-41b8-4379-9567-3a52371dc8ec'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:32.108723 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-3b0935b4-41b8-4379-9567-3a52371dc8ec admin admin] The token cache is being invalidate because project 9f9d1510272545d0a45b7383be9a447c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:38:32.109024 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-3b0935b4-41b8-4379-9567-3a52371dc8ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:32.109818 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-3b0935b4-41b8-4379-9567-3a52371dc8ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:32.118165 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 860/1709] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:38:31 2021] DELETE /identity/v3/projects/9f9d1510272545d0a45b7383be9a447c => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:32.119986 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47081625-4d0e-4f82-a4f2-140bea6d5076 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:32.120510 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47081625-4d0e-4f82-a4f2-140bea6d5076 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:32.120585 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47081625-4d0e-4f82-a4f2-140bea6d5076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:32.177345 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-47081625-4d0e-4f82-a4f2-140bea6d5076 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:32.178602 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-47081625-4d0e-4f82-a4f2-140bea6d5076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:32.326514 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 850/1710] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:32.334196 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845982e-a23f-408e-aee9-3e523c60639e None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:32.334486 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845982e-a23f-408e-aee9-3e523c60639e None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:32.334766 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845982e-a23f-408e-aee9-3e523c60639e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:32.367360 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-5845982e-a23f-408e-aee9-3e523c60639e None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:32.368610 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-5845982e-a23f-408e-aee9-3e523c60639e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:32.379777 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 861/1711] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:32.382951 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47081625-4d0e-4f82-a4f2-140bea6d5076 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:32.396134 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47081625-4d0e-4f82-a4f2-140bea6d5076 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:32.407622 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b644a0-2569-47cb-9b1b-615734bb786a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:32.414804 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c643871-0c7b-44e4-9baa-6f203074f64d None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:32.415094 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c643871-0c7b-44e4-9baa-6f203074f64d None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:32.415372 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c643871-0c7b-44e4-9baa-6f203074f64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:32.418144 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b644a0-2569-47cb-9b1b-615734bb786a admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:32.418370 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b644a0-2569-47cb-9b1b-615734bb786a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:32.420165 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b644a0-2569-47cb-9b1b-615734bb786a admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:32.421087 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b644a0-2569-47cb-9b1b-615734bb786a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:38:32.421539 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b644a0-2569-47cb-9b1b-615734bb786a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:32.423269 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b644a0-2569-47cb-9b1b-615734bb786a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:32.435506 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 851/1712] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:38:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:38:32.440349 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b644a0-2569-47cb-9b1b-615734bb786a admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:32.440762 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-3c643871-0c7b-44e4-9baa-6f203074f64d None None] MFA Rules not processed for user `d795b4264cbe4aff82f5a2b0275ca972`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:32.441976 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-3c643871-0c7b-44e4-9baa-6f203074f64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:32.453946 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b644a0-2569-47cb-9b1b-615734bb786a admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:32.460604 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cad3d9-99fd-41b0-8f8f-2d74f6f62d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:32.461278 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cad3d9-99fd-41b0-8f8f-2d74f6f62d3d admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:32.461632 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cad3d9-99fd-41b0-8f8f-2d74f6f62d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:32.461915 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cad3d9-99fd-41b0-8f8f-2d74f6f62d3d admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:32.462668 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cad3d9-99fd-41b0-8f8f-2d74f6f62d3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:32.465396 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cad3d9-99fd-41b0-8f8f-2d74f6f62d3d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:32.493631 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 852/1713] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:32 2021] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:38:32.498254 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cad3d9-99fd-41b0-8f8f-2d74f6f62d3d admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:32.512856 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 862/1714] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:32 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:38:32.573184 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cad3d9-99fd-41b0-8f8f-2d74f6f62d3d admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:32.578700 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0e2ed-1be5-4dd1-abe6-88ff5d80657b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:32.579367 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0e2ed-1be5-4dd1-abe6-88ff5d80657b admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:32.579652 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0e2ed-1be5-4dd1-abe6-88ff5d80657b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:32.579956 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0e2ed-1be5-4dd1-abe6-88ff5d80657b admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:32.580778 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0e2ed-1be5-4dd1-abe6-88ff5d80657b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:32.582596 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0e2ed-1be5-4dd1-abe6-88ff5d80657b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:32.610508 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 853/1715] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:32 2021] POST /identity/v3/users => generated 291 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:38:32.615915 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c643871-0c7b-44e4-9baa-6f203074f64d None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:32.635712 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c643871-0c7b-44e4-9baa-6f203074f64d None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:32.641675 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9c4c6-f39e-4f61-a8f2-95b044571895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:32.642446 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9c4c6-f39e-4f61-a8f2-95b044571895 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:32.642797 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9c4c6-f39e-4f61-a8f2-95b044571895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:32.643144 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9c4c6-f39e-4f61-a8f2-95b044571895 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:32.644067 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9c4c6-f39e-4f61-a8f2-95b044571895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:32.646192 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9c4c6-f39e-4f61-a8f2-95b044571895 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:32.661864 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 863/1716] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:32 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:38:32.663162 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0e2ed-1be5-4dd1-abe6-88ff5d80657b admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:32.673922 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0e2ed-1be5-4dd1-abe6-88ff5d80657b admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:32.679245 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26e8f3-abcc-43f6-aebd-53bbee6ab99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:32.680213 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26e8f3-abcc-43f6-aebd-53bbee6ab99a admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:32.680674 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26e8f3-abcc-43f6-aebd-53bbee6ab99a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:32.681085 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26e8f3-abcc-43f6-aebd-53bbee6ab99a admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:32.690460 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26e8f3-abcc-43f6-aebd-53bbee6ab99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:32.690460 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26e8f3-abcc-43f6-aebd-53bbee6ab99a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:32.695725 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 854/1717] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:32 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:32.704486 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9c4c6-f39e-4f61-a8f2-95b044571895 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:32.715430 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9c4c6-f39e-4f61-a8f2-95b044571895 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:32.720989 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ba6f2-1031-47ad-be51-7941acdff280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:32.722041 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ba6f2-1031-47ad-be51-7941acdff280 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:32.722389 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ba6f2-1031-47ad-be51-7941acdff280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:32.722744 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ba6f2-1031-47ad-be51-7941acdff280 admin admin] PATH_INFO: `/v3/projects/fefc35f734964f9f98448709ad9159d2/users/e44421c0415d4cdbbd1cde6989ad5931/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:32.738910 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ba6f2-1031-47ad-be51-7941acdff280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fefc35f734964f9f98448709ad9159d2, user_id=e44421c0415d4cdbbd1cde6989ad5931, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:32.741755 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ba6f2-1031-47ad-be51-7941acdff280 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:32.758327 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 864/1718] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:32 2021] PUT /identity/v3/projects/fefc35f734964f9f98448709ad9159d2/users/e44421c0415d4cdbbd1cde6989ad5931/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:32.805903 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c7ca7-ca04-4b0d-a3a2-3c4f3a580c74 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:32.806192 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c7ca7-ca04-4b0d-a3a2-3c4f3a580c74 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:32.806472 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c7ca7-ca04-4b0d-a3a2-3c4f3a580c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:32.833403 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-3c8c7ca7-ca04-4b0d-a3a2-3c4f3a580c74 None None] MFA Rules not processed for user `e44421c0415d4cdbbd1cde6989ad5931`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:32.834624 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-3c8c7ca7-ca04-4b0d-a3a2-3c4f3a580c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:32.897039 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 855/1719] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:32 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:32.901481 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ba6f2-1031-47ad-be51-7941acdff280 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:32.968623 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ba6f2-1031-47ad-be51-7941acdff280 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:32.973636 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5256839-cde1-4875-90db-5c4b0fb6baf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:32.974298 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5256839-cde1-4875-90db-5c4b0fb6baf8 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:32.974582 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5256839-cde1-4875-90db-5c4b0fb6baf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:32.974856 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5256839-cde1-4875-90db-5c4b0fb6baf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:32.975582 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5256839-cde1-4875-90db-5c4b0fb6baf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:32.977522 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5256839-cde1-4875-90db-5c4b0fb6baf8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:33.006439 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 865/1720] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:32 2021] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:33.007644 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c7ca7-ca04-4b0d-a3a2-3c4f3a580c74 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:33.017998 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c7ca7-ca04-4b0d-a3a2-3c4f3a580c74 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:33.078178 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688473e-1006-4b60-844a-3b6b6e3b8674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:33.078893 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688473e-1006-4b60-844a-3b6b6e3b8674 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:33.079173 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688473e-1006-4b60-844a-3b6b6e3b8674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:33.079445 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688473e-1006-4b60-844a-3b6b6e3b8674 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:33.080190 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688473e-1006-4b60-844a-3b6b6e3b8674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:33.082121 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688473e-1006-4b60-844a-3b6b6e3b8674 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:33.110499 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 856/1721] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:33 2021] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:38:33.111991 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5256839-cde1-4875-90db-5c4b0fb6baf8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:33.122931 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5256839-cde1-4875-90db-5c4b0fb6baf8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:33.133300 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966376d-25ce-4b9a-9607-5732f4555653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:33.134164 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966376d-25ce-4b9a-9607-5732f4555653 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:33.134602 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966376d-25ce-4b9a-9607-5732f4555653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:33.135206 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966376d-25ce-4b9a-9607-5732f4555653 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:33.136058 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966376d-25ce-4b9a-9607-5732f4555653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:33.137905 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966376d-25ce-4b9a-9607-5732f4555653 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:33.154488 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 866/1722] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:33 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:33.158817 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688473e-1006-4b60-844a-3b6b6e3b8674 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:33.170976 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688473e-1006-4b60-844a-3b6b6e3b8674 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:33.179306 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bf09b-9606-4860-8225-bff93d3034e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:33.180232 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bf09b-9606-4860-8225-bff93d3034e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:33.180514 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bf09b-9606-4860-8225-bff93d3034e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:33.180851 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bf09b-9606-4860-8225-bff93d3034e7 admin admin] PATH_INFO: `/v3/projects/be4107714f254d27be3fe7c40658ddab/users/0a8d1a477fc142fe9d92370cbb4f7484/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:33.198840 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605bf09b-9606-4860-8225-bff93d3034e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be4107714f254d27be3fe7c40658ddab, user_id=0a8d1a477fc142fe9d92370cbb4f7484, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:33.201564 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605bf09b-9606-4860-8225-bff93d3034e7 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:33.216475 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 857/1723] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:33 2021] PUT /identity/v3/projects/be4107714f254d27be3fe7c40658ddab/users/0a8d1a477fc142fe9d92370cbb4f7484/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:33.220707 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966376d-25ce-4b9a-9607-5732f4555653 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:33.232220 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966376d-25ce-4b9a-9607-5732f4555653 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:33.319264 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcef69e-ee87-4726-ae93-23556bf297cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:33.320098 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcef69e-ee87-4726-ae93-23556bf297cb admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:33.320687 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcef69e-ee87-4726-ae93-23556bf297cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:33.320956 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcef69e-ee87-4726-ae93-23556bf297cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:33.321695 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcef69e-ee87-4726-ae93-23556bf297cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:33.323349 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcef69e-ee87-4726-ae93-23556bf297cb admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:33.337391 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 867/1724] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:33 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:38:33.338478 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bf09b-9606-4860-8225-bff93d3034e7 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:33.352319 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bf09b-9606-4860-8225-bff93d3034e7 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:33.359018 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc01beb-22c4-4e6b-92ca-ed0ea89f76d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:33.360143 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc01beb-22c4-4e6b-92ca-ed0ea89f76d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:33.360515 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc01beb-22c4-4e6b-92ca-ed0ea89f76d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:33.361012 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc01beb-22c4-4e6b-92ca-ed0ea89f76d5 admin admin] PATH_INFO: `/v3/projects/be4107714f254d27be3fe7c40658ddab/users/0a8d1a477fc142fe9d92370cbb4f7484/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:33.363135 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc01beb-22c4-4e6b-92ca-ed0ea89f76d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be4107714f254d27be3fe7c40658ddab, user_id=0a8d1a477fc142fe9d92370cbb4f7484, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:33.365950 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc01beb-22c4-4e6b-92ca-ed0ea89f76d5 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:33.377809 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 858/1725] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:33 2021] PUT /identity/v3/projects/be4107714f254d27be3fe7c40658ddab/users/0a8d1a477fc142fe9d92370cbb4f7484/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:33.388337 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcc64b-fa80-451a-b0fa-f86e33895a55 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:33.388726 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcc64b-fa80-451a-b0fa-f86e33895a55 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:33.389105 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcc64b-fa80-451a-b0fa-f86e33895a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:33.423022 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-43fcc64b-fa80-451a-b0fa-f86e33895a55 None None] MFA Rules not processed for user `0a8d1a477fc142fe9d92370cbb4f7484`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:33.424248 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-43fcc64b-fa80-451a-b0fa-f86e33895a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:33.533098 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 868/1726] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:33 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:33.543535 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc01beb-22c4-4e6b-92ca-ed0ea89f76d5 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:33.546216 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7dc01beb-22c4-4e6b-92ca-ed0ea89f76d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:33.608596 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc01beb-22c4-4e6b-92ca-ed0ea89f76d5 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:33.612596 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a6bbb-c09f-494e-b79a-750480bc6540 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:33.613331 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a6bbb-c09f-494e-b79a-750480bc6540 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:33.613665 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a6bbb-c09f-494e-b79a-750480bc6540 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:33.614008 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a6bbb-c09f-494e-b79a-750480bc6540 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:33.639312 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a6bbb-c09f-494e-b79a-750480bc6540 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:33.641702 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a6bbb-c09f-494e-b79a-750480bc6540 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:33.660420 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 859/1727] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:33 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:33.779212 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcc64b-fa80-451a-b0fa-f86e33895a55 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:33.790110 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcc64b-fa80-451a-b0fa-f86e33895a55 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:33.793880 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452ca75-5380-4e0b-9e5c-464e8e992297 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:33.794533 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452ca75-5380-4e0b-9e5c-464e8e992297 service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:33.794822 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452ca75-5380-4e0b-9e5c-464e8e992297 service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:33.795115 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452ca75-5380-4e0b-9e5c-464e8e992297 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:33.862135 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452ca75-5380-4e0b-9e5c-464e8e992297 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:33.863894 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452ca75-5380-4e0b-9e5c-464e8e992297 service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:33.884794 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 869/1728] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:33 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:38:34.361195 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a6bbb-c09f-494e-b79a-750480bc6540 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:34.362714 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-656a6bbb-c09f-494e-b79a-750480bc6540 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:34.468845 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a6bbb-c09f-494e-b79a-750480bc6540 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:34.477637 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f471d9b-fbeb-4432-8259-0e180f3726df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:34.478858 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f471d9b-fbeb-4432-8259-0e180f3726df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:34.479368 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f471d9b-fbeb-4432-8259-0e180f3726df admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:34.479855 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f471d9b-fbeb-4432-8259-0e180f3726df admin admin] PATH_INFO: `/v3/users/af7f367464864f40ab020463a4a04d47` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:34.481638 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f471d9b-fbeb-4432-8259-0e180f3726df admin admin] RBAC: Authorizing `identity:delete_user(user_id=af7f367464864f40ab020463a4a04d47)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:34.483607 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f471d9b-fbeb-4432-8259-0e180f3726df admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:34.533110 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-8f471d9b-fbeb-4432-8259-0e180f3726df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af7f367464864f40ab020463a4a04d47'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:34.560692 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-8f471d9b-fbeb-4432-8259-0e180f3726df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af7f367464864f40ab020463a4a04d47'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:34.569328 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-8f471d9b-fbeb-4432-8259-0e180f3726df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af7f367464864f40ab020463a4a04d47'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:34.570024 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-8f471d9b-fbeb-4432-8259-0e180f3726df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af7f367464864f40ab020463a4a04d47'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:34.578244 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-8f471d9b-fbeb-4432-8259-0e180f3726df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af7f367464864f40ab020463a4a04d47'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:34.588576 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 860/1729] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:38:34 2021] DELETE /identity/v3/users/af7f367464864f40ab020463a4a04d47 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:34.600912 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe976e3-711a-4542-a91b-11f93545cabb None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:34.601918 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe976e3-711a-4542-a91b-11f93545cabb None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:34.602401 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe976e3-711a-4542-a91b-11f93545cabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:34.647809 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-5fe976e3-711a-4542-a91b-11f93545cabb None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:34.650112 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-5fe976e3-711a-4542-a91b-11f93545cabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:34.723245 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 870/1730] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:34.741793 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f471d9b-fbeb-4432-8259-0e180f3726df admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:34.743516 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-8f471d9b-fbeb-4432-8259-0e180f3726df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:34.813920 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f471d9b-fbeb-4432-8259-0e180f3726df admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:34.817560 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288c1fc-ecad-436b-bc4d-2592660f63f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:34.818206 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288c1fc-ecad-436b-bc4d-2592660f63f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:34.818487 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288c1fc-ecad-436b-bc4d-2592660f63f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:34.818760 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288c1fc-ecad-436b-bc4d-2592660f63f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:34.829694 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288c1fc-ecad-436b-bc4d-2592660f63f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:34.831462 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288c1fc-ecad-436b-bc4d-2592660f63f3 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:34.841897 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 861/1731] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:35.132077 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe976e3-711a-4542-a91b-11f93545cabb None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:35.134351 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-5fe976e3-711a-4542-a91b-11f93545cabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:35.146730 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe976e3-711a-4542-a91b-11f93545cabb None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:35.156631 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9644b2-aa43-4e12-8723-64c0ac30f58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:35.157542 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9644b2-aa43-4e12-8723-64c0ac30f58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:35.157832 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9644b2-aa43-4e12-8723-64c0ac30f58f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:35.158115 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9644b2-aa43-4e12-8723-64c0ac30f58f admin admin] PATH_INFO: `/v3/projects/1e57d88e2fc54151a7d137754337c3e1` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:35.159307 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9644b2-aa43-4e12-8723-64c0ac30f58f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e57d88e2fc54151a7d137754337c3e1)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:35.161286 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9644b2-aa43-4e12-8723-64c0ac30f58f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:35.205842 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-7c9644b2-aa43-4e12-8723-64c0ac30f58f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e57d88e2fc54151a7d137754337c3e1', 'request_id': 'req-7c9644b2-aa43-4e12-8723-64c0ac30f58f'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:35.213761 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-7c9644b2-aa43-4e12-8723-64c0ac30f58f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e57d88e2fc54151a7d137754337c3e1', 'request_id': 'req-7c9644b2-aa43-4e12-8723-64c0ac30f58f'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:35.220121 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-7c9644b2-aa43-4e12-8723-64c0ac30f58f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e57d88e2fc54151a7d137754337c3e1', 'request_id': 'req-7c9644b2-aa43-4e12-8723-64c0ac30f58f'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:35.233213 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-7c9644b2-aa43-4e12-8723-64c0ac30f58f admin admin] The token cache is being invalidate because project 1e57d88e2fc54151a7d137754337c3e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:38:35.233413 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-7c9644b2-aa43-4e12-8723-64c0ac30f58f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:35.234086 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-7c9644b2-aa43-4e12-8723-64c0ac30f58f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:35.235841 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 871/1732] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:38:35 2021] DELETE /identity/v3/projects/1e57d88e2fc54151a7d137754337c3e1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:35.242211 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288c1fc-ecad-436b-bc4d-2592660f63f3 service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:35.251227 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288c1fc-ecad-436b-bc4d-2592660f63f3 service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:35.336153 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309fdbf-89e4-46d5-ac9a-2186dc0ab76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:35.337113 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309fdbf-89e4-46d5-ac9a-2186dc0ab76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:35.337462 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309fdbf-89e4-46d5-ac9a-2186dc0ab76f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:35.337809 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309fdbf-89e4-46d5-ac9a-2186dc0ab76f admin admin] PATH_INFO: `/v3/users/f0bcf1af179c410b86c1ae1c679ca2e7` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:35.339042 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309fdbf-89e4-46d5-ac9a-2186dc0ab76f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0bcf1af179c410b86c1ae1c679ca2e7)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:35.341661 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309fdbf-89e4-46d5-ac9a-2186dc0ab76f admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:35.391786 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-3309fdbf-89e4-46d5-ac9a-2186dc0ab76f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0bcf1af179c410b86c1ae1c679ca2e7'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:35.418824 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-3309fdbf-89e4-46d5-ac9a-2186dc0ab76f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0bcf1af179c410b86c1ae1c679ca2e7'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:35.439717 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-3309fdbf-89e4-46d5-ac9a-2186dc0ab76f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0bcf1af179c410b86c1ae1c679ca2e7'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:35.440445 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-3309fdbf-89e4-46d5-ac9a-2186dc0ab76f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0bcf1af179c410b86c1ae1c679ca2e7'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:35.456101 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-3309fdbf-89e4-46d5-ac9a-2186dc0ab76f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0bcf1af179c410b86c1ae1c679ca2e7'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:35.472206 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 862/1733] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:38:35 2021] DELETE /identity/v3/users/f0bcf1af179c410b86c1ae1c679ca2e7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:38:36.057469 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9644b2-aa43-4e12-8723-64c0ac30f58f admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:36.059793 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-7c9644b2-aa43-4e12-8723-64c0ac30f58f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:36.118653 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9644b2-aa43-4e12-8723-64c0ac30f58f admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:36.281771 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1eba9-5cad-4ddb-bcbb-f7da08d79aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:36.282743 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1eba9-5cad-4ddb-bcbb-f7da08d79aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:36.283024 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1eba9-5cad-4ddb-bcbb-f7da08d79aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:36.283465 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1eba9-5cad-4ddb-bcbb-f7da08d79aa2 admin admin] PATH_INFO: `/v3/projects/95e0e26d1b994cf5a231eb3cc03ff90c` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:36.285026 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1eba9-5cad-4ddb-bcbb-f7da08d79aa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95e0e26d1b994cf5a231eb3cc03ff90c)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:36.287268 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1eba9-5cad-4ddb-bcbb-f7da08d79aa2 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:36.354609 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-33e1eba9-5cad-4ddb-bcbb-f7da08d79aa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95e0e26d1b994cf5a231eb3cc03ff90c', 'request_id': 'req-33e1eba9-5cad-4ddb-bcbb-f7da08d79aa2'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:36.361452 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-33e1eba9-5cad-4ddb-bcbb-f7da08d79aa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95e0e26d1b994cf5a231eb3cc03ff90c', 'request_id': 'req-33e1eba9-5cad-4ddb-bcbb-f7da08d79aa2'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:36.368770 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-33e1eba9-5cad-4ddb-bcbb-f7da08d79aa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95e0e26d1b994cf5a231eb3cc03ff90c', 'request_id': 'req-33e1eba9-5cad-4ddb-bcbb-f7da08d79aa2'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:36.388847 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-33e1eba9-5cad-4ddb-bcbb-f7da08d79aa2 admin admin] The token cache is being invalidate because project 95e0e26d1b994cf5a231eb3cc03ff90c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:38:36.389551 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-33e1eba9-5cad-4ddb-bcbb-f7da08d79aa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:36.390361 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-33e1eba9-5cad-4ddb-bcbb-f7da08d79aa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:36.391955 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 872/1734] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:38:36 2021] DELETE /identity/v3/projects/95e0e26d1b994cf5a231eb3cc03ff90c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:36.397521 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca1162-b413-427b-bb3c-be3c4c3d3dc8 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:36.398022 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca1162-b413-427b-bb3c-be3c4c3d3dc8 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:36.398111 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca1162-b413-427b-bb3c-be3c4c3d3dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:36.426562 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-44ca1162-b413-427b-bb3c-be3c4c3d3dc8 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:36.429339 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-44ca1162-b413-427b-bb3c-be3c4c3d3dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:36.498318 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 863/1735] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:36.506823 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00b6ce-f66b-41bf-91b0-3fecf099541e None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:36.507351 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00b6ce-f66b-41bf-91b0-3fecf099541e None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:36.507914 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00b6ce-f66b-41bf-91b0-3fecf099541e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:36.589599 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-8f00b6ce-f66b-41bf-91b0-3fecf099541e None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:36.591301 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-8f00b6ce-f66b-41bf-91b0-3fecf099541e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:36.602128 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 873/1736] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:36.606801 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca1162-b413-427b-bb3c-be3c4c3d3dc8 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:36.618308 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca1162-b413-427b-bb3c-be3c4c3d3dc8 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:36.624176 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129b1b6-70bb-4760-a80a-21ee8f925abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:36.624975 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129b1b6-70bb-4760-a80a-21ee8f925abf admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:36.625376 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129b1b6-70bb-4760-a80a-21ee8f925abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:36.625718 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129b1b6-70bb-4760-a80a-21ee8f925abf admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:36.626513 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129b1b6-70bb-4760-a80a-21ee8f925abf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:38:36.627050 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129b1b6-70bb-4760-a80a-21ee8f925abf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:36.628762 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129b1b6-70bb-4760-a80a-21ee8f925abf admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:36.641234 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 864/1737] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:38:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:38:36.645742 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00b6ce-f66b-41bf-91b0-3fecf099541e None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:36.655541 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00b6ce-f66b-41bf-91b0-3fecf099541e None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:36.661041 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b65c2b-5618-4762-a806-aea443a8dc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:36.661778 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b65c2b-5618-4762-a806-aea443a8dc25 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:36.662081 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b65c2b-5618-4762-a806-aea443a8dc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:36.662344 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b65c2b-5618-4762-a806-aea443a8dc25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:36.663149 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b65c2b-5618-4762-a806-aea443a8dc25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:36.665382 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b65c2b-5618-4762-a806-aea443a8dc25 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:36.722826 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129b1b6-70bb-4760-a80a-21ee8f925abf admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:36.723360 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 874/1738] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:36 2021] POST /identity/v3/projects => generated 399 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:36.733599 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129b1b6-70bb-4760-a80a-21ee8f925abf admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:36.813322 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abef56-cdd7-4f44-9f23-56d478791e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:36.814008 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abef56-cdd7-4f44-9f23-56d478791e26 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:36.814754 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abef56-cdd7-4f44-9f23-56d478791e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:36.815034 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abef56-cdd7-4f44-9f23-56d478791e26 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:36.815774 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abef56-cdd7-4f44-9f23-56d478791e26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:36.817867 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abef56-cdd7-4f44-9f23-56d478791e26 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:36.847203 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 865/1739] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:36 2021] POST /identity/v3/users => generated 300 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:38:36.851010 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b65c2b-5618-4762-a806-aea443a8dc25 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:36.862798 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b65c2b-5618-4762-a806-aea443a8dc25 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:36.868141 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb1287-0c08-4577-ad8d-d043c696c36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:36.869206 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb1287-0c08-4577-ad8d-d043c696c36a admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:36.869643 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb1287-0c08-4577-ad8d-d043c696c36a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:36.870069 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb1287-0c08-4577-ad8d-d043c696c36a admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:36.871555 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb1287-0c08-4577-ad8d-d043c696c36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:36.873340 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb1287-0c08-4577-ad8d-d043c696c36a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:36.885663 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 875/1740] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:36 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:36.889263 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abef56-cdd7-4f44-9f23-56d478791e26 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:36.908336 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abef56-cdd7-4f44-9f23-56d478791e26 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:36.917578 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391a9df-8d29-41a2-8ba2-c21ae8dbefe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:36.919104 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391a9df-8d29-41a2-8ba2-c21ae8dbefe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:36.919715 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391a9df-8d29-41a2-8ba2-c21ae8dbefe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:36.920177 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391a9df-8d29-41a2-8ba2-c21ae8dbefe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:36.921263 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391a9df-8d29-41a2-8ba2-c21ae8dbefe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:36.923094 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391a9df-8d29-41a2-8ba2-c21ae8dbefe7 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:36.935110 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 866/1741] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:36 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:36.939244 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb1287-0c08-4577-ad8d-d043c696c36a admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:36.949836 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb1287-0c08-4577-ad8d-d043c696c36a admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:36.954664 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071ac0a-fe05-4b6a-895f-a711795665a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:36.955627 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071ac0a-fe05-4b6a-895f-a711795665a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:36.956011 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071ac0a-fe05-4b6a-895f-a711795665a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:36.956384 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071ac0a-fe05-4b6a-895f-a711795665a7 admin admin] PATH_INFO: `/v3/projects/ab48c07b3b7f4b549f6cac7600ce83c7/users/ea4ff403d62d41509404c883bc7d9c30/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:36.971935 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071ac0a-fe05-4b6a-895f-a711795665a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab48c07b3b7f4b549f6cac7600ce83c7, user_id=ea4ff403d62d41509404c883bc7d9c30, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:36.974632 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071ac0a-fe05-4b6a-895f-a711795665a7 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:36.988414 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 876/1742] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:36 2021] PUT /identity/v3/projects/ab48c07b3b7f4b549f6cac7600ce83c7/users/ea4ff403d62d41509404c883bc7d9c30/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:36.999898 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019124f6-f17f-4583-b93f-71cafb61aa0e None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:37.000189 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019124f6-f17f-4583-b93f-71cafb61aa0e None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:37.000469 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019124f6-f17f-4583-b93f-71cafb61aa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:37.028830 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-019124f6-f17f-4583-b93f-71cafb61aa0e None None] MFA Rules not processed for user `ea4ff403d62d41509404c883bc7d9c30`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:37.029959 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-019124f6-f17f-4583-b93f-71cafb61aa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:37.071275 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071ac0a-fe05-4b6a-895f-a711795665a7 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:37.072993 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-2071ac0a-fe05-4b6a-895f-a711795665a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:37.114374 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 867/1743] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:36 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:38:37.119365 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019124f6-f17f-4583-b93f-71cafb61aa0e None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:37.153245 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071ac0a-fe05-4b6a-895f-a711795665a7 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:37.159422 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af31b3e-9589-44f3-b3d5-2e6f570e69ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:37.160403 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af31b3e-9589-44f3-b3d5-2e6f570e69ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:37.161101 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af31b3e-9589-44f3-b3d5-2e6f570e69ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:37.161385 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af31b3e-9589-44f3-b3d5-2e6f570e69ef admin admin] PATH_INFO: `/v3/users/e44421c0415d4cdbbd1cde6989ad5931` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:37.162997 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af31b3e-9589-44f3-b3d5-2e6f570e69ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=e44421c0415d4cdbbd1cde6989ad5931)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:37.166468 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af31b3e-9589-44f3-b3d5-2e6f570e69ef admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:37.204785 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019124f6-f17f-4583-b93f-71cafb61aa0e None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:37.212759 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c88a0-fb66-4e1f-8fbc-04a2974af2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:37.213429 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c88a0-fb66-4e1f-8fbc-04a2974af2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:37.213723 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c88a0-fb66-4e1f-8fbc-04a2974af2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:37.213984 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c88a0-fb66-4e1f-8fbc-04a2974af2a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:37.215615 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c88a0-fb66-4e1f-8fbc-04a2974af2a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:37.222884 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c88a0-fb66-4e1f-8fbc-04a2974af2a4 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:37.236570 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-3af31b3e-9589-44f3-b3d5-2e6f570e69ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e44421c0415d4cdbbd1cde6989ad5931'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:37.257744 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-3af31b3e-9589-44f3-b3d5-2e6f570e69ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e44421c0415d4cdbbd1cde6989ad5931'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:37.266202 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-3af31b3e-9589-44f3-b3d5-2e6f570e69ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e44421c0415d4cdbbd1cde6989ad5931'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:37.267215 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-3af31b3e-9589-44f3-b3d5-2e6f570e69ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e44421c0415d4cdbbd1cde6989ad5931'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:37.272344 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 868/1744] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:37 2021] POST /identity/v3/projects => generated 399 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:37.276183 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c88a0-fb66-4e1f-8fbc-04a2974af2a4 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:37.277541 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-3af31b3e-9589-44f3-b3d5-2e6f570e69ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e44421c0415d4cdbbd1cde6989ad5931'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:37.279087 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-794c88a0-fb66-4e1f-8fbc-04a2974af2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:37.296089 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 877/1745] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:38:37 2021] DELETE /identity/v3/users/e44421c0415d4cdbbd1cde6989ad5931 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:37.314407 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed55b5-aade-4e02-80d7-d6916a5e0cb8 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:37.314752 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed55b5-aade-4e02-80d7-d6916a5e0cb8 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:37.314967 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed55b5-aade-4e02-80d7-d6916a5e0cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:37.335018 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-7eed55b5-aade-4e02-80d7-d6916a5e0cb8 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:37.336685 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-7eed55b5-aade-4e02-80d7-d6916a5e0cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:37.381145 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c88a0-fb66-4e1f-8fbc-04a2974af2a4 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:37.406470 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 878/1746] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:37.416769 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed55b5-aade-4e02-80d7-d6916a5e0cb8 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:37.418982 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-7eed55b5-aade-4e02-80d7-d6916a5e0cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:37.469113 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38915c1-4cb0-4ed0-bdbe-8212d660b837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:37.471615 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38915c1-4cb0-4ed0-bdbe-8212d660b837 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:37.472074 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38915c1-4cb0-4ed0-bdbe-8212d660b837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:37.472514 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38915c1-4cb0-4ed0-bdbe-8212d660b837 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:37.473545 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38915c1-4cb0-4ed0-bdbe-8212d660b837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:37.475970 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38915c1-4cb0-4ed0-bdbe-8212d660b837 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:37.500835 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 869/1747] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:37 2021] POST /identity/v3/users => generated 306 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:38:37.501036 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed55b5-aade-4e02-80d7-d6916a5e0cb8 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:37.501735 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38915c1-4cb0-4ed0-bdbe-8212d660b837 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:37.505946 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe29fd-4da6-47f5-b01f-a095414fe9b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:37.506659 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe29fd-4da6-47f5-b01f-a095414fe9b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:37.506987 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe29fd-4da6-47f5-b01f-a095414fe9b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:37.508501 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe29fd-4da6-47f5-b01f-a095414fe9b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:37.512800 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38915c1-4cb0-4ed0-bdbe-8212d660b837 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:37.517578 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934e0d0-52a0-4f97-8d41-9bba59517e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:37.518225 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934e0d0-52a0-4f97-8d41-9bba59517e5a admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:37.518509 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934e0d0-52a0-4f97-8d41-9bba59517e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:37.518779 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934e0d0-52a0-4f97-8d41-9bba59517e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:37.519509 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934e0d0-52a0-4f97-8d41-9bba59517e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:37.519694 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe29fd-4da6-47f5-b01f-a095414fe9b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:37.521138 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934e0d0-52a0-4f97-8d41-9bba59517e5a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:37.521488 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe29fd-4da6-47f5-b01f-a095414fe9b6 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:37.532029 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 870/1749] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:37 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:37.532169 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 879/1749] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:37.536230 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe29fd-4da6-47f5-b01f-a095414fe9b6 service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:37.546315 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe29fd-4da6-47f5-b01f-a095414fe9b6 service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:37.552097 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f8891-523a-427a-bf19-da017bdfbc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:37.553052 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f8891-523a-427a-bf19-da017bdfbc72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:37.553412 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f8891-523a-427a-bf19-da017bdfbc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:37.553758 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f8891-523a-427a-bf19-da017bdfbc72 admin admin] PATH_INFO: `/v3/projects/50e3d9a85d8647a5ae499be7e1f0f14a/users/b9cfdde4efad450faa2d01a294c2bfe1/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:37.572441 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f8891-523a-427a-bf19-da017bdfbc72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e3d9a85d8647a5ae499be7e1f0f14a, user_id=b9cfdde4efad450faa2d01a294c2bfe1, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:37.576768 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f8891-523a-427a-bf19-da017bdfbc72 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:37.603036 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 880/1750] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:37 2021] PUT /identity/v3/projects/50e3d9a85d8647a5ae499be7e1f0f14a/users/b9cfdde4efad450faa2d01a294c2bfe1/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:37.607659 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934e0d0-52a0-4f97-8d41-9bba59517e5a admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:37.618972 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934e0d0-52a0-4f97-8d41-9bba59517e5a admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:37.684901 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc42d1b-c887-4323-86b0-ddeee0f89428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:37.685895 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc42d1b-c887-4323-86b0-ddeee0f89428 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:37.686184 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc42d1b-c887-4323-86b0-ddeee0f89428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:37.686474 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc42d1b-c887-4323-86b0-ddeee0f89428 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:37.687374 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc42d1b-c887-4323-86b0-ddeee0f89428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:37.689422 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc42d1b-c887-4323-86b0-ddeee0f89428 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:37.716824 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 871/1751] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:37 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:38:37.721002 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f8891-523a-427a-bf19-da017bdfbc72 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:37.739513 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f8891-523a-427a-bf19-da017bdfbc72 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:37.745316 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30973616-1f8a-4fd9-8afd-45757e66f641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:37.747362 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30973616-1f8a-4fd9-8afd-45757e66f641 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:37.747938 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30973616-1f8a-4fd9-8afd-45757e66f641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:37.748506 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30973616-1f8a-4fd9-8afd-45757e66f641 admin admin] PATH_INFO: `/v3/projects/50e3d9a85d8647a5ae499be7e1f0f14a/users/b9cfdde4efad450faa2d01a294c2bfe1/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:37.750749 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30973616-1f8a-4fd9-8afd-45757e66f641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e3d9a85d8647a5ae499be7e1f0f14a, user_id=b9cfdde4efad450faa2d01a294c2bfe1, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:37.754146 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30973616-1f8a-4fd9-8afd-45757e66f641 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:37.766378 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 881/1752] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:37 2021] PUT /identity/v3/projects/50e3d9a85d8647a5ae499be7e1f0f14a/users/b9cfdde4efad450faa2d01a294c2bfe1/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:37.776521 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3db29-c136-4ce4-8633-5423d040defe None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:37.777146 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3db29-c136-4ce4-8633-5423d040defe None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:37.777661 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3db29-c136-4ce4-8633-5423d040defe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:37.816695 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-4ef3db29-c136-4ce4-8633-5423d040defe None None] MFA Rules not processed for user `b9cfdde4efad450faa2d01a294c2bfe1`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:37.817946 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-4ef3db29-c136-4ce4-8633-5423d040defe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:37.884181 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30973616-1f8a-4fd9-8afd-45757e66f641 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:37.886007 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-30973616-1f8a-4fd9-8afd-45757e66f641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:37.974966 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 872/1753] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:37 2021] POST /identity/v3/auth/tokens => generated 3486 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:38.082267 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30973616-1f8a-4fd9-8afd-45757e66f641 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:38.088458 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484e07a-5664-469d-a7eb-3422c0339c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:38.089511 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484e07a-5664-469d-a7eb-3422c0339c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:38.090200 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484e07a-5664-469d-a7eb-3422c0339c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:38.090611 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484e07a-5664-469d-a7eb-3422c0339c2b admin admin] PATH_INFO: `/v3/projects/fefc35f734964f9f98448709ad9159d2` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:38.092025 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484e07a-5664-469d-a7eb-3422c0339c2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fefc35f734964f9f98448709ad9159d2)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:38.094352 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484e07a-5664-469d-a7eb-3422c0339c2b admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:38.097465 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3db29-c136-4ce4-8633-5423d040defe None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:38.099267 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-4ef3db29-c136-4ce4-8633-5423d040defe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:38.147947 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-7484e07a-5664-469d-a7eb-3422c0339c2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fefc35f734964f9f98448709ad9159d2', 'request_id': 'req-7484e07a-5664-469d-a7eb-3422c0339c2b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:38.155571 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-7484e07a-5664-469d-a7eb-3422c0339c2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fefc35f734964f9f98448709ad9159d2', 'request_id': 'req-7484e07a-5664-469d-a7eb-3422c0339c2b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:38.161970 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-7484e07a-5664-469d-a7eb-3422c0339c2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fefc35f734964f9f98448709ad9159d2', 'request_id': 'req-7484e07a-5664-469d-a7eb-3422c0339c2b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:38.185890 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-7484e07a-5664-469d-a7eb-3422c0339c2b admin admin] The token cache is being invalidate because project fefc35f734964f9f98448709ad9159d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:38:38.186187 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-7484e07a-5664-469d-a7eb-3422c0339c2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:38.189985 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-7484e07a-5664-469d-a7eb-3422c0339c2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:38.197356 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 882/1754] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:38:37 2021] DELETE /identity/v3/projects/fefc35f734964f9f98448709ad9159d2 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:38:38.201266 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484e07a-5664-469d-a7eb-3422c0339c2b admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:38.202819 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-7484e07a-5664-469d-a7eb-3422c0339c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:38.250872 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3db29-c136-4ce4-8633-5423d040defe None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:38.349637 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484e07a-5664-469d-a7eb-3422c0339c2b admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:38.366760 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a22d11-c1f8-4739-8bed-8a49029ff998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:38.367925 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a22d11-c1f8-4739-8bed-8a49029ff998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:38.368379 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a22d11-c1f8-4739-8bed-8a49029ff998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:38.368846 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a22d11-c1f8-4739-8bed-8a49029ff998 admin admin] PATH_INFO: `/v3/users/0a8d1a477fc142fe9d92370cbb4f7484` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:38.372318 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a22d11-c1f8-4739-8bed-8a49029ff998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a8d1a477fc142fe9d92370cbb4f7484)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:38.372459 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69256e72-c372-4fd4-89fb-fac13c5bd381 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:38.373091 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69256e72-c372-4fd4-89fb-fac13c5bd381 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:38.373374 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69256e72-c372-4fd4-89fb-fac13c5bd381 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:38.373647 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69256e72-c372-4fd4-89fb-fac13c5bd381 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:38.375416 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a22d11-c1f8-4739-8bed-8a49029ff998 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:38.377289 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-69256e72-c372-4fd4-89fb-fac13c5bd381 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:38.463265 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69256e72-c372-4fd4-89fb-fac13c5bd381 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:38.466470 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69256e72-c372-4fd4-89fb-fac13c5bd381 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:38.474716 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-80a22d11-c1f8-4739-8bed-8a49029ff998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a8d1a477fc142fe9d92370cbb4f7484'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:38.478907 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 873/1755] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:38 2021] GET /identity/v3/auth/tokens => generated 3486 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:38.498426 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-80a22d11-c1f8-4739-8bed-8a49029ff998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a8d1a477fc142fe9d92370cbb4f7484'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:38.507738 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-80a22d11-c1f8-4739-8bed-8a49029ff998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a8d1a477fc142fe9d92370cbb4f7484'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:38.508392 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-80a22d11-c1f8-4739-8bed-8a49029ff998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a8d1a477fc142fe9d92370cbb4f7484'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:38.517991 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-80a22d11-c1f8-4739-8bed-8a49029ff998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a8d1a477fc142fe9d92370cbb4f7484'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:38.536698 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 883/1756] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:38:38 2021] DELETE /identity/v3/users/0a8d1a477fc142fe9d92370cbb4f7484 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:38:38.681790 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69256e72-c372-4fd4-89fb-fac13c5bd381 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:38.683423 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-69256e72-c372-4fd4-89fb-fac13c5bd381 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:38.702010 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69256e72-c372-4fd4-89fb-fac13c5bd381 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:38.790917 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b867c-e9f1-4b32-a683-4d09e8bab492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:38.791672 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b867c-e9f1-4b32-a683-4d09e8bab492 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:38.792078 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b867c-e9f1-4b32-a683-4d09e8bab492 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:38.792436 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b867c-e9f1-4b32-a683-4d09e8bab492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:38.794471 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-ea4b867c-e9f1-4b32-a683-4d09e8bab492 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:38.937652 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b867c-e9f1-4b32-a683-4d09e8bab492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:38.939628 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b867c-e9f1-4b32-a683-4d09e8bab492 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:38.950025 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 874/1757] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:38 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:38:39.503252 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a22d11-c1f8-4739-8bed-8a49029ff998 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:39.505029 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-80a22d11-c1f8-4739-8bed-8a49029ff998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:39.578167 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a22d11-c1f8-4739-8bed-8a49029ff998 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:39.583059 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4af5b8-7321-485f-b281-103a9f16a1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:39.583938 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4af5b8-7321-485f-b281-103a9f16a1dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:39.584227 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4af5b8-7321-485f-b281-103a9f16a1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:39.584526 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4af5b8-7321-485f-b281-103a9f16a1dc admin admin] PATH_INFO: `/v3/projects/be4107714f254d27be3fe7c40658ddab` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:39.585718 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4af5b8-7321-485f-b281-103a9f16a1dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=be4107714f254d27be3fe7c40658ddab)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:39.587743 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4af5b8-7321-485f-b281-103a9f16a1dc admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:39.634951 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-bb4af5b8-7321-485f-b281-103a9f16a1dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be4107714f254d27be3fe7c40658ddab', 'request_id': 'req-bb4af5b8-7321-485f-b281-103a9f16a1dc'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:39.641947 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-bb4af5b8-7321-485f-b281-103a9f16a1dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be4107714f254d27be3fe7c40658ddab', 'request_id': 'req-bb4af5b8-7321-485f-b281-103a9f16a1dc'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:39.648393 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-bb4af5b8-7321-485f-b281-103a9f16a1dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be4107714f254d27be3fe7c40658ddab', 'request_id': 'req-bb4af5b8-7321-485f-b281-103a9f16a1dc'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:39.662615 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-bb4af5b8-7321-485f-b281-103a9f16a1dc admin admin] The token cache is being invalidate because project be4107714f254d27be3fe7c40658ddab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:38:39.663143 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-bb4af5b8-7321-485f-b281-103a9f16a1dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:39.665150 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-bb4af5b8-7321-485f-b281-103a9f16a1dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:39.672143 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 884/1758] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:38:39 2021] DELETE /identity/v3/projects/be4107714f254d27be3fe7c40658ddab => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:39.673376 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138c005-66fa-4bbb-a309-f3a419ec790e None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:39.674050 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138c005-66fa-4bbb-a309-f3a419ec790e None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:39.674050 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138c005-66fa-4bbb-a309-f3a419ec790e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:39.697130 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-a138c005-66fa-4bbb-a309-f3a419ec790e None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:39.698797 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-a138c005-66fa-4bbb-a309-f3a419ec790e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:39.774762 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 875/1759] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:38:39.784278 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f99e5-5103-4eed-b726-2243eb989827 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:39.785000 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f99e5-5103-4eed-b726-2243eb989827 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:39.785504 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f99e5-5103-4eed-b726-2243eb989827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:39.811132 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-8a9f99e5-5103-4eed-b726-2243eb989827 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:39.812423 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-8a9f99e5-5103-4eed-b726-2243eb989827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:39.824854 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 885/1760] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:39.833203 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138c005-66fa-4bbb-a309-f3a419ec790e None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:39.859199 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138c005-66fa-4bbb-a309-f3a419ec790e None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:39.865758 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd8fdd-8165-44d5-97bc-7f8b3ccd0f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:39.866926 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd8fdd-8165-44d5-97bc-7f8b3ccd0f2c admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:39.867023 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd8fdd-8165-44d5-97bc-7f8b3ccd0f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:39.867306 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd8fdd-8165-44d5-97bc-7f8b3ccd0f2c admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:39.868401 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd8fdd-8165-44d5-97bc-7f8b3ccd0f2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:38:39.868866 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd8fdd-8165-44d5-97bc-7f8b3ccd0f2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:39.872268 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd8fdd-8165-44d5-97bc-7f8b3ccd0f2c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:39.891042 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 876/1761] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:38:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:38:39.896130 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f99e5-5103-4eed-b726-2243eb989827 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:39.910284 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f99e5-5103-4eed-b726-2243eb989827 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:39.917748 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a9d1a-f69b-4884-9d26-22915acd3d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:39.918713 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a9d1a-f69b-4884-9d26-22915acd3d7f admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:39.919571 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a9d1a-f69b-4884-9d26-22915acd3d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:39.920334 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a9d1a-f69b-4884-9d26-22915acd3d7f admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:39.921059 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a9d1a-f69b-4884-9d26-22915acd3d7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:39.926562 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a9d1a-f69b-4884-9d26-22915acd3d7f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:39.961259 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 886/1762] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:39 2021] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:39.966098 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd8fdd-8165-44d5-97bc-7f8b3ccd0f2c admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:39.979748 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd8fdd-8165-44d5-97bc-7f8b3ccd0f2c admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:40.047146 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82620114-b0d4-4ed9-a9dd-99fcf854f285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:40.048629 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82620114-b0d4-4ed9-a9dd-99fcf854f285 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:40.049218 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82620114-b0d4-4ed9-a9dd-99fcf854f285 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:40.049503 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82620114-b0d4-4ed9-a9dd-99fcf854f285 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:40.050226 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82620114-b0d4-4ed9-a9dd-99fcf854f285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:40.052824 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82620114-b0d4-4ed9-a9dd-99fcf854f285 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:40.076921 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 877/1763] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:39 2021] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:38:40.081107 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a9d1a-f69b-4884-9d26-22915acd3d7f admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:40.093096 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a9d1a-f69b-4884-9d26-22915acd3d7f admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:40.097848 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ace88c-be3d-44be-96e5-d557b76ae0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:40.098515 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ace88c-be3d-44be-96e5-d557b76ae0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:40.098796 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ace88c-be3d-44be-96e5-d557b76ae0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:40.099131 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ace88c-be3d-44be-96e5-d557b76ae0f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:40.100120 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ace88c-be3d-44be-96e5-d557b76ae0f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:40.101829 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ace88c-be3d-44be-96e5-d557b76ae0f4 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:40.114300 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 887/1764] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:40 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:40.118277 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82620114-b0d4-4ed9-a9dd-99fcf854f285 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:40.130299 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82620114-b0d4-4ed9-a9dd-99fcf854f285 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:40.135122 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b51b2-5f10-46ad-9888-c52bdb0fd28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:40.136079 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b51b2-5f10-46ad-9888-c52bdb0fd28d admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:40.136615 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b51b2-5f10-46ad-9888-c52bdb0fd28d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:40.137095 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b51b2-5f10-46ad-9888-c52bdb0fd28d admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:40.138029 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b51b2-5f10-46ad-9888-c52bdb0fd28d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:40.139966 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b51b2-5f10-46ad-9888-c52bdb0fd28d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:40.155475 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 878/1765] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:40 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:40.156285 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ace88c-be3d-44be-96e5-d557b76ae0f4 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:40.185727 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ace88c-be3d-44be-96e5-d557b76ae0f4 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:40.196776 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449926d-3dd0-4a56-903c-25fc066d18db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:40.199987 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449926d-3dd0-4a56-903c-25fc066d18db admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:40.199987 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449926d-3dd0-4a56-903c-25fc066d18db admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:40.199987 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449926d-3dd0-4a56-903c-25fc066d18db admin admin] PATH_INFO: `/v3/projects/98516a9bc4ad4cbba1e7fd47d8065771/users/df950f2adedb423d825878c25c15a955/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:40.215402 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449926d-3dd0-4a56-903c-25fc066d18db admin admin] RBAC: Authorizing `identity:create_grant(project_id=98516a9bc4ad4cbba1e7fd47d8065771, user_id=df950f2adedb423d825878c25c15a955, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:40.218197 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449926d-3dd0-4a56-903c-25fc066d18db admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:40.243750 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 888/1766] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:40 2021] PUT /identity/v3/projects/98516a9bc4ad4cbba1e7fd47d8065771/users/df950f2adedb423d825878c25c15a955/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:38:40.247788 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534d0de-3d56-45b9-a6c3-eeba3d9d89c8 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:40.248093 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534d0de-3d56-45b9-a6c3-eeba3d9d89c8 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:40.248377 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534d0de-3d56-45b9-a6c3-eeba3d9d89c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:40.292405 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-e534d0de-3d56-45b9-a6c3-eeba3d9d89c8 None None] MFA Rules not processed for user `df950f2adedb423d825878c25c15a955`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:40.294348 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e534d0de-3d56-45b9-a6c3-eeba3d9d89c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:40.369196 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 879/1767] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:40 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:40.375277 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449926d-3dd0-4a56-903c-25fc066d18db admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:40.519807 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449926d-3dd0-4a56-903c-25fc066d18db admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:40.529753 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6696c-0991-419d-b1c8-cb098f05aaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:40.530662 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6696c-0991-419d-b1c8-cb098f05aaba admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:40.531088 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6696c-0991-419d-b1c8-cb098f05aaba admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:40.531514 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6696c-0991-419d-b1c8-cb098f05aaba admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:40.532429 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6696c-0991-419d-b1c8-cb098f05aaba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:40.534681 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6696c-0991-419d-b1c8-cb098f05aaba admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:40.577945 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 889/1768] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:40 2021] POST /identity/v3/projects => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:40.582115 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534d0de-3d56-45b9-a6c3-eeba3d9d89c8 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:40.600916 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534d0de-3d56-45b9-a6c3-eeba3d9d89c8 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:40.682352 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f747bd-206b-42b4-a092-dc4bc4b82332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:40.684264 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f747bd-206b-42b4-a092-dc4bc4b82332 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:40.684823 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f747bd-206b-42b4-a092-dc4bc4b82332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:40.685175 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f747bd-206b-42b4-a092-dc4bc4b82332 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:40.686130 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f747bd-206b-42b4-a092-dc4bc4b82332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:40.688463 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f747bd-206b-42b4-a092-dc4bc4b82332 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:40.724704 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 880/1769] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:40 2021] POST /identity/v3/users => generated 298 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:38:40.728823 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6696c-0991-419d-b1c8-cb098f05aaba admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:40.746619 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6696c-0991-419d-b1c8-cb098f05aaba admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:40.752770 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8df7a-b1aa-4912-bcc3-529428094ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:40.753444 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8df7a-b1aa-4912-bcc3-529428094ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:40.753727 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8df7a-b1aa-4912-bcc3-529428094ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:40.754002 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8df7a-b1aa-4912-bcc3-529428094ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:40.754774 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8df7a-b1aa-4912-bcc3-529428094ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:40.756600 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8df7a-b1aa-4912-bcc3-529428094ca5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:40.768709 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 890/1770] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:40 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:40.775020 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f747bd-206b-42b4-a092-dc4bc4b82332 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:40.788272 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f747bd-206b-42b4-a092-dc4bc4b82332 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:40.794873 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db065a-3c50-46af-8b00-406387888911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:40.795791 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db065a-3c50-46af-8b00-406387888911 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:40.796074 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db065a-3c50-46af-8b00-406387888911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:40.796496 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db065a-3c50-46af-8b00-406387888911 admin admin] PATH_INFO: `/v3/projects/555581043ffa49f8adfae04de230fce9/users/a0ca00a3db314c01bd8206f194352e7d/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:40.819189 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db065a-3c50-46af-8b00-406387888911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=555581043ffa49f8adfae04de230fce9, user_id=a0ca00a3db314c01bd8206f194352e7d, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:40.822975 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db065a-3c50-46af-8b00-406387888911 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:40.859646 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 881/1771] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:40 2021] PUT /identity/v3/projects/555581043ffa49f8adfae04de230fce9/users/a0ca00a3db314c01bd8206f194352e7d/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:40.863318 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8df7a-b1aa-4912-bcc3-529428094ca5 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:40.875854 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8df7a-b1aa-4912-bcc3-529428094ca5 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:40.954544 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa301d7-34c3-4053-a409-022156a8cf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:40.955506 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa301d7-34c3-4053-a409-022156a8cf31 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:40.956193 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa301d7-34c3-4053-a409-022156a8cf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:40.956662 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa301d7-34c3-4053-a409-022156a8cf31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:40.958312 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa301d7-34c3-4053-a409-022156a8cf31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:40.960371 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa301d7-34c3-4053-a409-022156a8cf31 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:40.976395 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 891/1772] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:40 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:40.981012 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db065a-3c50-46af-8b00-406387888911 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:40.996473 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db065a-3c50-46af-8b00-406387888911 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:41.003431 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee238a61-4e5a-448f-b363-a5d0f60c3a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:41.004630 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee238a61-4e5a-448f-b363-a5d0f60c3a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:41.005099 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee238a61-4e5a-448f-b363-a5d0f60c3a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:41.005519 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee238a61-4e5a-448f-b363-a5d0f60c3a58 admin admin] PATH_INFO: `/v3/projects/555581043ffa49f8adfae04de230fce9/users/a0ca00a3db314c01bd8206f194352e7d/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:41.008330 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee238a61-4e5a-448f-b363-a5d0f60c3a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=555581043ffa49f8adfae04de230fce9, user_id=a0ca00a3db314c01bd8206f194352e7d, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:41.011873 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee238a61-4e5a-448f-b363-a5d0f60c3a58 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:41.027883 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 882/1773] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:40 2021] PUT /identity/v3/projects/555581043ffa49f8adfae04de230fce9/users/a0ca00a3db314c01bd8206f194352e7d/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:38:41.045664 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c2715-5ddc-45e7-ac01-ba51f0073601 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:41.046045 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c2715-5ddc-45e7-ac01-ba51f0073601 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:41.046580 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c2715-5ddc-45e7-ac01-ba51f0073601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:41.086329 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-0f0c2715-5ddc-45e7-ac01-ba51f0073601 None None] MFA Rules not processed for user `a0ca00a3db314c01bd8206f194352e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:41.088413 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-0f0c2715-5ddc-45e7-ac01-ba51f0073601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:41.193144 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 892/1774] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:41 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:41.203931 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee238a61-4e5a-448f-b363-a5d0f60c3a58 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:41.205597 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-ee238a61-4e5a-448f-b363-a5d0f60c3a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:41.265464 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee238a61-4e5a-448f-b363-a5d0f60c3a58 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:41.268961 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd165f-418e-44f2-a6b8-749d7c666939 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:41.269840 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd165f-418e-44f2-a6b8-749d7c666939 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:41.269840 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd165f-418e-44f2-a6b8-749d7c666939 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:41.270175 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd165f-418e-44f2-a6b8-749d7c666939 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:41.282955 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd165f-418e-44f2-a6b8-749d7c666939 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:41.284414 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd165f-418e-44f2-a6b8-749d7c666939 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:41.307150 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 883/1775] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:41 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:41.392060 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c2715-5ddc-45e7-ac01-ba51f0073601 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:41.401645 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c2715-5ddc-45e7-ac01-ba51f0073601 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:41.405971 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd37b8-ef1a-47b4-823b-49f6afba9b24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:41.406542 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd37b8-ef1a-47b4-823b-49f6afba9b24 service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:41.406822 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd37b8-ef1a-47b4-823b-49f6afba9b24 service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:41.407095 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd37b8-ef1a-47b4-823b-49f6afba9b24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:41.470889 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd37b8-ef1a-47b4-823b-49f6afba9b24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:41.472911 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd37b8-ef1a-47b4-823b-49f6afba9b24 service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:41.485241 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 893/1776] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:41 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:41.988893 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd165f-418e-44f2-a6b8-749d7c666939 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:42.062796 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd165f-418e-44f2-a6b8-749d7c666939 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:42.069256 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607266a-70b0-4a8d-9deb-5f893ce08140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:42.070489 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607266a-70b0-4a8d-9deb-5f893ce08140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:42.070763 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607266a-70b0-4a8d-9deb-5f893ce08140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:42.071188 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607266a-70b0-4a8d-9deb-5f893ce08140 admin admin] PATH_INFO: `/v3/users/df950f2adedb423d825878c25c15a955` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:42.072442 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607266a-70b0-4a8d-9deb-5f893ce08140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df950f2adedb423d825878c25c15a955)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:42.074940 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607266a-70b0-4a8d-9deb-5f893ce08140 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:42.139711 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7607266a-70b0-4a8d-9deb-5f893ce08140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df950f2adedb423d825878c25c15a955'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:42.152667 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7607266a-70b0-4a8d-9deb-5f893ce08140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df950f2adedb423d825878c25c15a955'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:42.162074 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7607266a-70b0-4a8d-9deb-5f893ce08140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df950f2adedb423d825878c25c15a955'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:42.162950 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7607266a-70b0-4a8d-9deb-5f893ce08140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df950f2adedb423d825878c25c15a955'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:42.171290 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7607266a-70b0-4a8d-9deb-5f893ce08140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df950f2adedb423d825878c25c15a955'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:42.179158 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 884/1777] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:38:41 2021] DELETE /identity/v3/users/df950f2adedb423d825878c25c15a955 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:42.185507 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebcf58-d387-4405-8b17-5384fe8341b0 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:42.187558 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebcf58-d387-4405-8b17-5384fe8341b0 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:42.189071 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebcf58-d387-4405-8b17-5384fe8341b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:42.227192 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-adebcf58-d387-4405-8b17-5384fe8341b0 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:42.231223 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-adebcf58-d387-4405-8b17-5384fe8341b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:42.353126 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 894/1778] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:42.372807 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607266a-70b0-4a8d-9deb-5f893ce08140 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:42.374507 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7607266a-70b0-4a8d-9deb-5f893ce08140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:42.453605 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607266a-70b0-4a8d-9deb-5f893ce08140 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:42.457446 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b52449-eaa6-49af-ba1d-d4550b796260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:42.458145 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b52449-eaa6-49af-ba1d-d4550b796260 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:42.458432 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b52449-eaa6-49af-ba1d-d4550b796260 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:42.458700 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b52449-eaa6-49af-ba1d-d4550b796260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:42.469385 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b52449-eaa6-49af-ba1d-d4550b796260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:42.470915 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b52449-eaa6-49af-ba1d-d4550b796260 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:42.482212 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 885/1779] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:42.755658 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebcf58-d387-4405-8b17-5384fe8341b0 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:42.757082 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-adebcf58-d387-4405-8b17-5384fe8341b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:42.769943 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebcf58-d387-4405-8b17-5384fe8341b0 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:42.775661 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a089a-f888-40aa-ae32-0dd43cbbc8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:42.776549 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a089a-f888-40aa-ae32-0dd43cbbc8aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:42.776833 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a089a-f888-40aa-ae32-0dd43cbbc8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:42.777663 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a089a-f888-40aa-ae32-0dd43cbbc8aa admin admin] PATH_INFO: `/v3/projects/98516a9bc4ad4cbba1e7fd47d8065771` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:42.778893 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a089a-f888-40aa-ae32-0dd43cbbc8aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=98516a9bc4ad4cbba1e7fd47d8065771)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:42.780838 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a089a-f888-40aa-ae32-0dd43cbbc8aa admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:42.825741 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-004a089a-f888-40aa-ae32-0dd43cbbc8aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98516a9bc4ad4cbba1e7fd47d8065771', 'request_id': 'req-004a089a-f888-40aa-ae32-0dd43cbbc8aa'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:42.831480 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-004a089a-f888-40aa-ae32-0dd43cbbc8aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98516a9bc4ad4cbba1e7fd47d8065771', 'request_id': 'req-004a089a-f888-40aa-ae32-0dd43cbbc8aa'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:42.836620 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-004a089a-f888-40aa-ae32-0dd43cbbc8aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98516a9bc4ad4cbba1e7fd47d8065771', 'request_id': 'req-004a089a-f888-40aa-ae32-0dd43cbbc8aa'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:42.848831 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-004a089a-f888-40aa-ae32-0dd43cbbc8aa admin admin] The token cache is being invalidate because project 98516a9bc4ad4cbba1e7fd47d8065771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:38:42.849113 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-004a089a-f888-40aa-ae32-0dd43cbbc8aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:42.849741 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-004a089a-f888-40aa-ae32-0dd43cbbc8aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:42.851234 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 895/1780] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:38:42 2021] DELETE /identity/v3/projects/98516a9bc4ad4cbba1e7fd47d8065771 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:42.855861 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b52449-eaa6-49af-ba1d-d4550b796260 service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:42.865317 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b52449-eaa6-49af-ba1d-d4550b796260 service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:42.897185 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a089a-f888-40aa-ae32-0dd43cbbc8aa admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:42.898578 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-004a089a-f888-40aa-ae32-0dd43cbbc8aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:42.921321 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3b27d-6e8a-4511-8ecc-1db27bf304df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:42.922110 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3b27d-6e8a-4511-8ecc-1db27bf304df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:42.922392 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3b27d-6e8a-4511-8ecc-1db27bf304df admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:42.922672 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3b27d-6e8a-4511-8ecc-1db27bf304df admin admin] PATH_INFO: `/v3/users/a0ca00a3db314c01bd8206f194352e7d` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:42.923889 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3b27d-6e8a-4511-8ecc-1db27bf304df admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ca00a3db314c01bd8206f194352e7d)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:42.925805 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3b27d-6e8a-4511-8ecc-1db27bf304df admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:42.961216 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a089a-f888-40aa-ae32-0dd43cbbc8aa admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:42.966619 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d20412-672b-4165-93fc-3852b92d3cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:42.967487 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d20412-672b-4165-93fc-3852b92d3cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:42.967820 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d20412-672b-4165-93fc-3852b92d3cda admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:42.968101 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d20412-672b-4165-93fc-3852b92d3cda admin admin] PATH_INFO: `/v3/users/0319cf152f1045bc8bf7d014cf43a234` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:42.969305 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d20412-672b-4165-93fc-3852b92d3cda admin admin] RBAC: Authorizing `identity:delete_user(user_id=0319cf152f1045bc8bf7d014cf43a234)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:42.970456 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-05d3b27d-6e8a-4511-8ecc-1db27bf304df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ca00a3db314c01bd8206f194352e7d'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:42.971212 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d20412-672b-4165-93fc-3852b92d3cda admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:42.982277 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-05d3b27d-6e8a-4511-8ecc-1db27bf304df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ca00a3db314c01bd8206f194352e7d'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:42.991618 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-05d3b27d-6e8a-4511-8ecc-1db27bf304df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ca00a3db314c01bd8206f194352e7d'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:42.992414 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-05d3b27d-6e8a-4511-8ecc-1db27bf304df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ca00a3db314c01bd8206f194352e7d'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:43.000214 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-05d3b27d-6e8a-4511-8ecc-1db27bf304df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ca00a3db314c01bd8206f194352e7d'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:43.006237 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 886/1781] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:38:42 2021] DELETE /identity/v3/users/a0ca00a3db314c01bd8206f194352e7d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:43.028585 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-33d20412-672b-4165-93fc-3852b92d3cda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0319cf152f1045bc8bf7d014cf43a234'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:43.040483 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-33d20412-672b-4165-93fc-3852b92d3cda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0319cf152f1045bc8bf7d014cf43a234'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:43.048527 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-33d20412-672b-4165-93fc-3852b92d3cda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0319cf152f1045bc8bf7d014cf43a234'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:43.049153 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-33d20412-672b-4165-93fc-3852b92d3cda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0319cf152f1045bc8bf7d014cf43a234'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:43.056243 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-33d20412-672b-4165-93fc-3852b92d3cda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0319cf152f1045bc8bf7d014cf43a234'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:43.065539 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 896/1782] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:38:42 2021] DELETE /identity/v3/users/0319cf152f1045bc8bf7d014cf43a234 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:43.067664 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4d8e8-1e62-4b74-91e0-2debec320e39 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:43.067974 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4d8e8-1e62-4b74-91e0-2debec320e39 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:43.068299 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4d8e8-1e62-4b74-91e0-2debec320e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:43.086753 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-d3a4d8e8-1e62-4b74-91e0-2debec320e39 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:43.088130 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d3a4d8e8-1e62-4b74-91e0-2debec320e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:43.181156 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 887/1783] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:38:43.191612 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d20412-672b-4165-93fc-3852b92d3cda admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:43.193686 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-33d20412-672b-4165-93fc-3852b92d3cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:43.260668 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d20412-672b-4165-93fc-3852b92d3cda admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:43.265609 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed4211-9283-4e14-9403-abc078a0a3e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:43.266215 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed4211-9283-4e14-9403-abc078a0a3e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:43.266500 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed4211-9283-4e14-9403-abc078a0a3e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:43.266786 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed4211-9283-4e14-9403-abc078a0a3e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:43.277666 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed4211-9283-4e14-9403-abc078a0a3e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:43.279362 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed4211-9283-4e14-9403-abc078a0a3e8 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:43.295176 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 897/1784] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:43.415145 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4d8e8-1e62-4b74-91e0-2debec320e39 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:43.416857 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d3a4d8e8-1e62-4b74-91e0-2debec320e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:43.434604 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4d8e8-1e62-4b74-91e0-2debec320e39 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:43.445182 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa510fb8-7203-46ca-b0c7-6f78a0bc9a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:43.446927 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa510fb8-7203-46ca-b0c7-6f78a0bc9a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:43.446927 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa510fb8-7203-46ca-b0c7-6f78a0bc9a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:43.447180 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa510fb8-7203-46ca-b0c7-6f78a0bc9a4c admin admin] PATH_INFO: `/v3/projects/555581043ffa49f8adfae04de230fce9` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:43.448569 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa510fb8-7203-46ca-b0c7-6f78a0bc9a4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=555581043ffa49f8adfae04de230fce9)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:43.451262 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa510fb8-7203-46ca-b0c7-6f78a0bc9a4c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:43.541432 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-fa510fb8-7203-46ca-b0c7-6f78a0bc9a4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '555581043ffa49f8adfae04de230fce9', 'request_id': 'req-fa510fb8-7203-46ca-b0c7-6f78a0bc9a4c'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:43.560794 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-fa510fb8-7203-46ca-b0c7-6f78a0bc9a4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '555581043ffa49f8adfae04de230fce9', 'request_id': 'req-fa510fb8-7203-46ca-b0c7-6f78a0bc9a4c'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:43.568705 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-fa510fb8-7203-46ca-b0c7-6f78a0bc9a4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '555581043ffa49f8adfae04de230fce9', 'request_id': 'req-fa510fb8-7203-46ca-b0c7-6f78a0bc9a4c'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:43.583309 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481fc05-e195-4c99-861c-f7d45df6c2b6 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:43.583841 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481fc05-e195-4c99-861c-f7d45df6c2b6 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:43.584250 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481fc05-e195-4c99-861c-f7d45df6c2b6 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:43.586748 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 898/1785] 10.222.0.30 () {54 vars in 921 bytes} [Fri Oct 15 03:38:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:38:43.596394 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-fa510fb8-7203-46ca-b0c7-6f78a0bc9a4c admin admin] The token cache is being invalidate because project 555581043ffa49f8adfae04de230fce9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:38:43.596698 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-fa510fb8-7203-46ca-b0c7-6f78a0bc9a4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:43.598993 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-fa510fb8-7203-46ca-b0c7-6f78a0bc9a4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:43.603726 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 888/1786] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:38:43 2021] DELETE /identity/v3/projects/555581043ffa49f8adfae04de230fce9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:43.610413 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d747e9b-2280-4ae9-b597-60ed2a0f2eec None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:43.610538 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a0a97-3804-451a-b8d1-254c44085841 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:43.610798 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a0a97-3804-451a-b8d1-254c44085841 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:43.611079 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a0a97-3804-451a-b8d1-254c44085841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:43.611348 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d747e9b-2280-4ae9-b597-60ed2a0f2eec None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:43.611794 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d747e9b-2280-4ae9-b597-60ed2a0f2eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:43.642513 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-3d747e9b-2280-4ae9-b597-60ed2a0f2eec None None] MFA Rules not processed for user `3d71a1bd93b04249b2b8e6a054de44c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:43.643982 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-3d747e9b-2280-4ae9-b597-60ed2a0f2eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:43.652070 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-299a0a97-3804-451a-b8d1-254c44085841 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:43.656391 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-299a0a97-3804-451a-b8d1-254c44085841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:43.804960 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 889/1787] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:43.805641 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 899/1788] 10.222.0.30 () {58 vars in 1018 bytes} [Fri Oct 15 03:38:43 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:43.806498 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7a8c3-ce2c-496e-af62-1ec75291a471 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:43.807460 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7a8c3-ce2c-496e-af62-1ec75291a471 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:43.807460 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7a8c3-ce2c-496e-af62-1ec75291a471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:43.861663 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-cba7a8c3-ce2c-496e-af62-1ec75291a471 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:43.864590 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-cba7a8c3-ce2c-496e-af62-1ec75291a471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:43.885712 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 890/1789] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:43.890375 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d747e9b-2280-4ae9-b597-60ed2a0f2eec None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:43.918877 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d747e9b-2280-4ae9-b597-60ed2a0f2eec None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:43.939991 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba2bf5-33d0-4eec-9b6f-91006078a5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:43.943592 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba2bf5-33d0-4eec-9b6f-91006078a5dc admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:43.944069 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba2bf5-33d0-4eec-9b6f-91006078a5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:43.944483 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba2bf5-33d0-4eec-9b6f-91006078a5dc admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:43.945386 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba2bf5-33d0-4eec-9b6f-91006078a5dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:38:43.952871 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba2bf5-33d0-4eec-9b6f-91006078a5dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:43.954754 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba2bf5-33d0-4eec-9b6f-91006078a5dc admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:44.015714 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 900/1790] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:38:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:38:44.021652 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7a8c3-ce2c-496e-af62-1ec75291a471 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:44.036585 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba2bf5-33d0-4eec-9b6f-91006078a5dc admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:44.040681 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7a8c3-ce2c-496e-af62-1ec75291a471 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:44.045086 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-87ba2bf5-33d0-4eec-9b6f-91006078a5dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:44.059117 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c52e8-d819-4a20-856f-495ab897d6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:44.059964 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c52e8-d819-4a20-856f-495ab897d6aa admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:44.060333 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c52e8-d819-4a20-856f-495ab897d6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:44.061066 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c52e8-d819-4a20-856f-495ab897d6aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:44.061974 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c52e8-d819-4a20-856f-495ab897d6aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:44.066308 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c52e8-d819-4a20-856f-495ab897d6aa admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:44.067955 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba2bf5-33d0-4eec-9b6f-91006078a5dc admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:44.080365 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ab3ae-6b6e-4ed9-a28b-34ca7d291ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:44.081515 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ab3ae-6b6e-4ed9-a28b-34ca7d291ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:44.082178 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ab3ae-6b6e-4ed9-a28b-34ca7d291ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:44.082640 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ab3ae-6b6e-4ed9-a28b-34ca7d291ef0 admin admin] PATH_INFO: `/v3/projects/c77028318bf34142b032679ca3c590af` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:44.084163 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ab3ae-6b6e-4ed9-a28b-34ca7d291ef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c77028318bf34142b032679ca3c590af)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:44.086521 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ab3ae-6b6e-4ed9-a28b-34ca7d291ef0 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:44.160493 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 891/1791] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:44 2021] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:44.163761 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c52e8-d819-4a20-856f-495ab897d6aa admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:44.174876 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-606ab3ae-6b6e-4ed9-a28b-34ca7d291ef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c77028318bf34142b032679ca3c590af', 'request_id': 'req-606ab3ae-6b6e-4ed9-a28b-34ca7d291ef0'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:44.183705 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-606ab3ae-6b6e-4ed9-a28b-34ca7d291ef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c77028318bf34142b032679ca3c590af', 'request_id': 'req-606ab3ae-6b6e-4ed9-a28b-34ca7d291ef0'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:44.189602 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-606ab3ae-6b6e-4ed9-a28b-34ca7d291ef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c77028318bf34142b032679ca3c590af', 'request_id': 'req-606ab3ae-6b6e-4ed9-a28b-34ca7d291ef0'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:44.222897 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-606ab3ae-6b6e-4ed9-a28b-34ca7d291ef0 admin admin] The token cache is being invalidate because project c77028318bf34142b032679ca3c590af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:38:44.224784 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-606ab3ae-6b6e-4ed9-a28b-34ca7d291ef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:44.226992 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-606ab3ae-6b6e-4ed9-a28b-34ca7d291ef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:44.229853 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 901/1792] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:38:44 2021] DELETE /identity/v3/projects/c77028318bf34142b032679ca3c590af => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:44.230953 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ab3ae-6b6e-4ed9-a28b-34ca7d291ef0 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:44.233028 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-606ab3ae-6b6e-4ed9-a28b-34ca7d291ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:44.309642 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c52e8-d819-4a20-856f-495ab897d6aa admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:44.314653 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42b231-b3b7-4918-9cf4-5cdf49e36033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:44.315434 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42b231-b3b7-4918-9cf4-5cdf49e36033 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:44.315974 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42b231-b3b7-4918-9cf4-5cdf49e36033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:44.316106 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42b231-b3b7-4918-9cf4-5cdf49e36033 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:44.318169 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42b231-b3b7-4918-9cf4-5cdf49e36033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:44.319589 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42b231-b3b7-4918-9cf4-5cdf49e36033 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:44.348068 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 892/1793] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:44 2021] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:44.354532 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48583437-9e4b-4dbe-88d3-950fc46b8770 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:44.354986 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48583437-9e4b-4dbe-88d3-950fc46b8770 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:44.355235 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48583437-9e4b-4dbe-88d3-950fc46b8770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:44.377842 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ab3ae-6b6e-4ed9-a28b-34ca7d291ef0 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:44.394602 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-48583437-9e4b-4dbe-88d3-950fc46b8770 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:44.396456 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-48583437-9e4b-4dbe-88d3-950fc46b8770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:44.408737 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 893/1794] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:44.409712 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48583437-9e4b-4dbe-88d3-950fc46b8770 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:44.411067 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-48583437-9e4b-4dbe-88d3-950fc46b8770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:44.425529 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48583437-9e4b-4dbe-88d3-950fc46b8770 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:44.454346 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13f6a2-d95f-4b4f-a5d6-a727bb5dc6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:44.455418 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13f6a2-d95f-4b4f-a5d6-a727bb5dc6ba admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:44.456102 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13f6a2-d95f-4b4f-a5d6-a727bb5dc6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:44.456653 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13f6a2-d95f-4b4f-a5d6-a727bb5dc6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:44.457722 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13f6a2-d95f-4b4f-a5d6-a727bb5dc6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:44.460568 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13f6a2-d95f-4b4f-a5d6-a727bb5dc6ba admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:44.470862 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83952f6b-3e76-44e1-b333-08ef1f8d6dff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:44.471532 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83952f6b-3e76-44e1-b333-08ef1f8d6dff service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:44.471866 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83952f6b-3e76-44e1-b333-08ef1f8d6dff service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:44.472171 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83952f6b-3e76-44e1-b333-08ef1f8d6dff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:44.477134 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-83952f6b-3e76-44e1-b333-08ef1f8d6dff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:44.486102 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 894/1795] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:44 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:44.486102 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5995555-1c8f-4aa2-a073-8d8330699ef7 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:44.486102 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5995555-1c8f-4aa2-a073-8d8330699ef7 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:44.486102 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5995555-1c8f-4aa2-a073-8d8330699ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:44.500292 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83952f6b-3e76-44e1-b333-08ef1f8d6dff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:44.502252 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83952f6b-3e76-44e1-b333-08ef1f8d6dff service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:44.507285 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-c5995555-1c8f-4aa2-a073-8d8330699ef7 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:44.509147 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c5995555-1c8f-4aa2-a073-8d8330699ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:44.518363 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 902/1796] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:44 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:44.519415 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 895/1797] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:44.519646 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5995555-1c8f-4aa2-a073-8d8330699ef7 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:44.532900 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5995555-1c8f-4aa2-a073-8d8330699ef7 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:44.533595 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83952f6b-3e76-44e1-b333-08ef1f8d6dff service nova] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:44.538685 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa3973-9b6a-4c28-b1a6-68bf62a330da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:44.539530 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa3973-9b6a-4c28-b1a6-68bf62a330da admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:44.539844 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa3973-9b6a-4c28-b1a6-68bf62a330da admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:44.540118 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa3973-9b6a-4c28-b1a6-68bf62a330da admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:44.540966 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa3973-9b6a-4c28-b1a6-68bf62a330da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:44.543467 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa3973-9b6a-4c28-b1a6-68bf62a330da admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:44.556111 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 896/1798] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:44 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:44.560923 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa3973-9b6a-4c28-b1a6-68bf62a330da admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:44.570814 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83952f6b-3e76-44e1-b333-08ef1f8d6dff service nova] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:44.575948 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa3973-9b6a-4c28-b1a6-68bf62a330da admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:44.577827 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6396c6-8798-4c1f-aead-3dcc58f1e420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:44.579497 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6396c6-8798-4c1f-aead-3dcc58f1e420 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:44.580576 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6396c6-8798-4c1f-aead-3dcc58f1e420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:44.581914 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6396c6-8798-4c1f-aead-3dcc58f1e420 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:44.582828 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277fb2a-d0e6-4141-a83c-961298bcf002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:44.583141 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6396c6-8798-4c1f-aead-3dcc58f1e420 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:38:44.583378 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6396c6-8798-4c1f-aead-3dcc58f1e420 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:44.584203 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277fb2a-d0e6-4141-a83c-961298bcf002 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:44.584609 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277fb2a-d0e6-4141-a83c-961298bcf002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:44.585020 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277fb2a-d0e6-4141-a83c-961298bcf002 admin admin] PATH_INFO: `/v3/projects/b27b0e089f8243ca9d70719c9b171e80/users/f8363e8fb2a94171a33d096903c7adac/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:44.585217 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6396c6-8798-4c1f-aead-3dcc58f1e420 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:44.604519 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 903/1799] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:38:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:38:44.606362 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6396c6-8798-4c1f-aead-3dcc58f1e420 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:44.610007 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-3c6396c6-8798-4c1f-aead-3dcc58f1e420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:44.613024 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277fb2a-d0e6-4141-a83c-961298bcf002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b27b0e089f8243ca9d70719c9b171e80, user_id=f8363e8fb2a94171a33d096903c7adac, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:44.616348 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277fb2a-d0e6-4141-a83c-961298bcf002 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:44.631939 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6396c6-8798-4c1f-aead-3dcc58f1e420 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:44.643811 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 897/1800] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:44 2021] PUT /identity/v3/projects/b27b0e089f8243ca9d70719c9b171e80/users/f8363e8fb2a94171a33d096903c7adac/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:44.643811 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277fb2a-d0e6-4141-a83c-961298bcf002 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:44.718217 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2c26c-467a-4098-b748-5a673185eb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:44.719020 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2c26c-467a-4098-b748-5a673185eb4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:44.719337 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2c26c-467a-4098-b748-5a673185eb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:44.719613 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2c26c-467a-4098-b748-5a673185eb4c admin admin] PATH_INFO: `/v3/users/ea4ff403d62d41509404c883bc7d9c30` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:44.726111 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277fb2a-d0e6-4141-a83c-961298bcf002 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:44.729413 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2c26c-467a-4098-b748-5a673185eb4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea4ff403d62d41509404c883bc7d9c30)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:44.731912 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166635b3-3e81-4fa2-86f0-d2c46215fb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:44.732568 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166635b3-3e81-4fa2-86f0-d2c46215fb50 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:44.732681 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2c26c-467a-4098-b748-5a673185eb4c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:44.732849 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166635b3-3e81-4fa2-86f0-d2c46215fb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:44.733121 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166635b3-3e81-4fa2-86f0-d2c46215fb50 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:44.733848 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166635b3-3e81-4fa2-86f0-d2c46215fb50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:44.735764 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166635b3-3e81-4fa2-86f0-d2c46215fb50 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:44.769790 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 898/1801] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:44 2021] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:44.769790 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9ac23-923b-4479-ba08-5a6fefb7f8de None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:44.769790 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9ac23-923b-4479-ba08-5a6fefb7f8de None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:44.769790 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9ac23-923b-4479-ba08-5a6fefb7f8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:44.790385 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-61c2c26c-467a-4098-b748-5a673185eb4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea4ff403d62d41509404c883bc7d9c30'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:44.797634 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-6ca9ac23-923b-4479-ba08-5a6fefb7f8de None None] MFA Rules not processed for user `f8363e8fb2a94171a33d096903c7adac`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:44.799217 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-6ca9ac23-923b-4479-ba08-5a6fefb7f8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:44.803180 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-61c2c26c-467a-4098-b748-5a673185eb4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea4ff403d62d41509404c883bc7d9c30'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:44.812786 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-61c2c26c-467a-4098-b748-5a673185eb4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea4ff403d62d41509404c883bc7d9c30'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:44.813455 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-61c2c26c-467a-4098-b748-5a673185eb4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea4ff403d62d41509404c883bc7d9c30'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:44.826518 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-61c2c26c-467a-4098-b748-5a673185eb4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea4ff403d62d41509404c883bc7d9c30'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:44.834212 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 904/1802] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:38:44 2021] DELETE /identity/v3/users/ea4ff403d62d41509404c883bc7d9c30 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:44.837299 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2c26c-467a-4098-b748-5a673185eb4c admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:44.838438 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-61c2c26c-467a-4098-b748-5a673185eb4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:44.877903 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 899/1803] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:44 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:44.879397 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4067b1-7141-474e-8169-64bcf38e90da None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:44.879709 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4067b1-7141-474e-8169-64bcf38e90da None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:44.880008 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4067b1-7141-474e-8169-64bcf38e90da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:44.899046 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-bd4067b1-7141-474e-8169-64bcf38e90da None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:44.900319 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-bd4067b1-7141-474e-8169-64bcf38e90da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:44.912862 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2c26c-467a-4098-b748-5a673185eb4c admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:44.919958 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46113a7e-59cc-47c6-a28e-f1c7ac651df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:44.920833 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46113a7e-59cc-47c6-a28e-f1c7ac651df4 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:44.921085 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46113a7e-59cc-47c6-a28e-f1c7ac651df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:44.921443 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46113a7e-59cc-47c6-a28e-f1c7ac651df4 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:44.922200 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46113a7e-59cc-47c6-a28e-f1c7ac651df4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:44.924165 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46113a7e-59cc-47c6-a28e-f1c7ac651df4 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:44.947476 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 905/1804] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:44 2021] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:44.947476 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46113a7e-59cc-47c6-a28e-f1c7ac651df4 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:44.947476 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-46113a7e-59cc-47c6-a28e-f1c7ac651df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:44.978245 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 900/1805] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:44.979318 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4067b1-7141-474e-8169-64bcf38e90da None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:44.989468 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4067b1-7141-474e-8169-64bcf38e90da None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:44.994763 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed1c53-932c-4abe-888d-d308674ad54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:44.995514 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed1c53-932c-4abe-888d-d308674ad54d admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:44.996551 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed1c53-932c-4abe-888d-d308674ad54d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:44.996832 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed1c53-932c-4abe-888d-d308674ad54d admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:44.997568 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed1c53-932c-4abe-888d-d308674ad54d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:44.999197 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed1c53-932c-4abe-888d-d308674ad54d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:45.009712 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 901/1806] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:44 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:45.010634 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed1c53-932c-4abe-888d-d308674ad54d admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:45.014102 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-36ed1c53-932c-4abe-888d-d308674ad54d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:45.016291 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46113a7e-59cc-47c6-a28e-f1c7ac651df4 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:45.021807 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aadcc1-4085-43c7-b100-669c7d120860 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:45.022559 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aadcc1-4085-43c7-b100-669c7d120860 service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:45.022939 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aadcc1-4085-43c7-b100-669c7d120860 service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:45.023314 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aadcc1-4085-43c7-b100-669c7d120860 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:45.070194 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed1c53-932c-4abe-888d-d308674ad54d admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:45.074731 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742009e-581f-4a15-8bd2-35466eaf0fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:45.075372 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742009e-581f-4a15-8bd2-35466eaf0fdd service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:45.075701 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742009e-581f-4a15-8bd2-35466eaf0fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:45.076002 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742009e-581f-4a15-8bd2-35466eaf0fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:45.083076 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aadcc1-4085-43c7-b100-669c7d120860 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:45.084870 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aadcc1-4085-43c7-b100-669c7d120860 service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:45.085580 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742009e-581f-4a15-8bd2-35466eaf0fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:45.087115 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742009e-581f-4a15-8bd2-35466eaf0fdd service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:45.094601 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 906/1807] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:44 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:45.096812 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aadcc1-4085-43c7-b100-669c7d120860 service cinder] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:45.097345 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 902/1808] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:45.118096 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aadcc1-4085-43c7-b100-669c7d120860 service cinder] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:45.123735 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd9fd4-39fd-498e-a32b-99498b191d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:45.124407 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd9fd4-39fd-498e-a32b-99498b191d26 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:45.124822 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd9fd4-39fd-498e-a32b-99498b191d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:45.124980 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd9fd4-39fd-498e-a32b-99498b191d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:45.125710 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd9fd4-39fd-498e-a32b-99498b191d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:45.127544 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd9fd4-39fd-498e-a32b-99498b191d26 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:45.140439 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 907/1809] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:45 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:45.144622 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742009e-581f-4a15-8bd2-35466eaf0fdd service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:45.155909 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742009e-581f-4a15-8bd2-35466eaf0fdd service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:45.161415 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e39b5c-7aed-48d6-8779-9523b243a407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:45.162746 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e39b5c-7aed-48d6-8779-9523b243a407 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:45.163089 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e39b5c-7aed-48d6-8779-9523b243a407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:45.163374 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e39b5c-7aed-48d6-8779-9523b243a407 admin admin] PATH_INFO: `/v3/projects/99eb2a7c6737459180ce1d6a49a28ae2/users/78654eee91594d7d896671ad3f9e9b58/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:45.185878 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e39b5c-7aed-48d6-8779-9523b243a407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99eb2a7c6737459180ce1d6a49a28ae2, user_id=78654eee91594d7d896671ad3f9e9b58, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:45.189413 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e39b5c-7aed-48d6-8779-9523b243a407 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:45.215650 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 903/1810] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:45 2021] PUT /identity/v3/projects/99eb2a7c6737459180ce1d6a49a28ae2/users/78654eee91594d7d896671ad3f9e9b58/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:38:45.226231 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27222a4-ef38-48e5-8282-578e06586ff4 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:45.226934 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27222a4-ef38-48e5-8282-578e06586ff4 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:45.226934 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27222a4-ef38-48e5-8282-578e06586ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:45.322579 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-b27222a4-ef38-48e5-8282-578e06586ff4 None None] MFA Rules not processed for user `78654eee91594d7d896671ad3f9e9b58`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:45.324850 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-b27222a4-ef38-48e5-8282-578e06586ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:45.459179 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 908/1811] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:45 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:45.461037 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e39b5c-7aed-48d6-8779-9523b243a407 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:45.628725 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e39b5c-7aed-48d6-8779-9523b243a407 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:45.645577 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27222a4-ef38-48e5-8282-578e06586ff4 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:45.645696 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602927aa-8d2f-4899-95d9-e9c99f3ab686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:45.646383 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602927aa-8d2f-4899-95d9-e9c99f3ab686 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:45.646681 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602927aa-8d2f-4899-95d9-e9c99f3ab686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:45.646990 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602927aa-8d2f-4899-95d9-e9c99f3ab686 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:45.647833 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-b27222a4-ef38-48e5-8282-578e06586ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:45.648070 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602927aa-8d2f-4899-95d9-e9c99f3ab686 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:45.650974 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602927aa-8d2f-4899-95d9-e9c99f3ab686 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:45.676839 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27222a4-ef38-48e5-8282-578e06586ff4 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:45.705386 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519b07d-a4d3-4823-9947-bb13644409f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:45.706311 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519b07d-a4d3-4823-9947-bb13644409f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:45.706558 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519b07d-a4d3-4823-9947-bb13644409f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:45.706844 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519b07d-a4d3-4823-9947-bb13644409f4 admin admin] PATH_INFO: `/v3/projects/ab48c07b3b7f4b549f6cac7600ce83c7` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:45.710813 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519b07d-a4d3-4823-9947-bb13644409f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab48c07b3b7f4b549f6cac7600ce83c7)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:45.712861 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519b07d-a4d3-4823-9947-bb13644409f4 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:45.752051 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 904/1812] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:45 2021] POST /identity/v3/projects => generated 377 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:45.753737 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602927aa-8d2f-4899-95d9-e9c99f3ab686 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:45.788095 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2519b07d-a4d3-4823-9947-bb13644409f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab48c07b3b7f4b549f6cac7600ce83c7', 'request_id': 'req-2519b07d-a4d3-4823-9947-bb13644409f4'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:45.799827 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2519b07d-a4d3-4823-9947-bb13644409f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab48c07b3b7f4b549f6cac7600ce83c7', 'request_id': 'req-2519b07d-a4d3-4823-9947-bb13644409f4'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:45.810964 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2519b07d-a4d3-4823-9947-bb13644409f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab48c07b3b7f4b549f6cac7600ce83c7', 'request_id': 'req-2519b07d-a4d3-4823-9947-bb13644409f4'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:45.836623 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2519b07d-a4d3-4823-9947-bb13644409f4 admin admin] The token cache is being invalidate because project ab48c07b3b7f4b549f6cac7600ce83c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:38:45.836916 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2519b07d-a4d3-4823-9947-bb13644409f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:45.838234 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2519b07d-a4d3-4823-9947-bb13644409f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:45.840335 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 909/1813] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:38:45 2021] DELETE /identity/v3/projects/ab48c07b3b7f4b549f6cac7600ce83c7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:38:45.844012 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519b07d-a4d3-4823-9947-bb13644409f4 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:45.845682 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-2519b07d-a4d3-4823-9947-bb13644409f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:45.848129 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602927aa-8d2f-4899-95d9-e9c99f3ab686 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:45.978663 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130148ff-892e-4b36-8cf9-efa4a6c99ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:45.979286 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130148ff-892e-4b36-8cf9-efa4a6c99ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:45.979566 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130148ff-892e-4b36-8cf9-efa4a6c99ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:45.979913 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130148ff-892e-4b36-8cf9-efa4a6c99ff6 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:45.980613 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130148ff-892e-4b36-8cf9-efa4a6c99ff6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:45.982948 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130148ff-892e-4b36-8cf9-efa4a6c99ff6 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:45.992870 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519b07d-a4d3-4823-9947-bb13644409f4 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:45.998469 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e5cb9-85cc-47fa-a4f5-63c3656082c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:45.999338 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e5cb9-85cc-47fa-a4f5-63c3656082c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:45.999753 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e5cb9-85cc-47fa-a4f5-63c3656082c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:46.000041 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e5cb9-85cc-47fa-a4f5-63c3656082c5 admin admin] PATH_INFO: `/v3/users/b9cfdde4efad450faa2d01a294c2bfe1` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:46.001275 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e5cb9-85cc-47fa-a4f5-63c3656082c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9cfdde4efad450faa2d01a294c2bfe1)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:46.003276 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e5cb9-85cc-47fa-a4f5-63c3656082c5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:46.007729 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 905/1814] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:45 2021] POST /identity/v3/users => generated 295 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:46.007729 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130148ff-892e-4b36-8cf9-efa4a6c99ff6 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:46.009447 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-130148ff-892e-4b36-8cf9-efa4a6c99ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:46.022538 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130148ff-892e-4b36-8cf9-efa4a6c99ff6 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:46.027833 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bedb8-bd48-437f-86d5-8fb8672d5ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:46.028748 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bedb8-bd48-437f-86d5-8fb8672d5ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:46.029415 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bedb8-bd48-437f-86d5-8fb8672d5ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:46.030177 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bedb8-bd48-437f-86d5-8fb8672d5ff8 admin admin] PATH_INFO: `/v3/users/10c2e1f041cd4f4ab043b3b1c0627da3` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:46.031857 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1bedb8-bd48-437f-86d5-8fb8672d5ff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c2e1f041cd4f4ab043b3b1c0627da3)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:46.033803 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1bedb8-bd48-437f-86d5-8fb8672d5ff8 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:46.052485 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-253e5cb9-85cc-47fa-a4f5-63c3656082c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9cfdde4efad450faa2d01a294c2bfe1'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:46.066443 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-253e5cb9-85cc-47fa-a4f5-63c3656082c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9cfdde4efad450faa2d01a294c2bfe1'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:46.073197 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-253e5cb9-85cc-47fa-a4f5-63c3656082c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9cfdde4efad450faa2d01a294c2bfe1'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:46.074410 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-253e5cb9-85cc-47fa-a4f5-63c3656082c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9cfdde4efad450faa2d01a294c2bfe1'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:46.081153 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-253e5cb9-85cc-47fa-a4f5-63c3656082c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9cfdde4efad450faa2d01a294c2bfe1'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:46.081584 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-dc1bedb8-bd48-437f-86d5-8fb8672d5ff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c2e1f041cd4f4ab043b3b1c0627da3'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:46.086956 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 910/1815] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:38:45 2021] DELETE /identity/v3/users/b9cfdde4efad450faa2d01a294c2bfe1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:46.088483 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e5cb9-85cc-47fa-a4f5-63c3656082c5 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:46.090175 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-253e5cb9-85cc-47fa-a4f5-63c3656082c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:46.094282 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-dc1bedb8-bd48-437f-86d5-8fb8672d5ff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c2e1f041cd4f4ab043b3b1c0627da3'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:46.102279 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-dc1bedb8-bd48-437f-86d5-8fb8672d5ff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c2e1f041cd4f4ab043b3b1c0627da3'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:46.102939 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-dc1bedb8-bd48-437f-86d5-8fb8672d5ff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c2e1f041cd4f4ab043b3b1c0627da3'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:46.110947 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-dc1bedb8-bd48-437f-86d5-8fb8672d5ff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c2e1f041cd4f4ab043b3b1c0627da3'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:46.117470 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 906/1816] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:38:46 2021] DELETE /identity/v3/users/10c2e1f041cd4f4ab043b3b1c0627da3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:46.122835 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef980127-904d-45aa-af6e-a63b47fc573c None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:46.123193 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef980127-904d-45aa-af6e-a63b47fc573c None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:46.123541 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef980127-904d-45aa-af6e-a63b47fc573c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:46.143094 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-ef980127-904d-45aa-af6e-a63b47fc573c None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:46.144508 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-ef980127-904d-45aa-af6e-a63b47fc573c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:46.156668 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e5cb9-85cc-47fa-a4f5-63c3656082c5 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:46.204382 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 907/1817] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:46.218499 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef980127-904d-45aa-af6e-a63b47fc573c None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:46.219969 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-ef980127-904d-45aa-af6e-a63b47fc573c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:46.221990 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcaa92-d76f-458b-8d3c-2a429ee89955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:46.222763 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcaa92-d76f-458b-8d3c-2a429ee89955 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:46.223159 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcaa92-d76f-458b-8d3c-2a429ee89955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:46.223506 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcaa92-d76f-458b-8d3c-2a429ee89955 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:46.224343 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcaa92-d76f-458b-8d3c-2a429ee89955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:46.226100 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcaa92-d76f-458b-8d3c-2a429ee89955 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:46.246735 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 911/1818] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:46 2021] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:46.248243 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcaa92-d76f-458b-8d3c-2a429ee89955 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:46.249581 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-a4bcaa92-d76f-458b-8d3c-2a429ee89955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:46.267313 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcaa92-d76f-458b-8d3c-2a429ee89955 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:46.272812 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1163447-a5a8-4e7a-a0c0-cd6a4ce65cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:46.273704 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1163447-a5a8-4e7a-a0c0-cd6a4ce65cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:46.273986 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1163447-a5a8-4e7a-a0c0-cd6a4ce65cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:46.274266 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1163447-a5a8-4e7a-a0c0-cd6a4ce65cc9 admin admin] PATH_INFO: `/v3/projects/39aa653296d8428e9e90c1287f58ceca/users/a8801bc96dad414bbd4a5b92cc281f47/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:46.289553 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1163447-a5a8-4e7a-a0c0-cd6a4ce65cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39aa653296d8428e9e90c1287f58ceca, user_id=a8801bc96dad414bbd4a5b92cc281f47, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:46.292269 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1163447-a5a8-4e7a-a0c0-cd6a4ce65cc9 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:46.295430 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef980127-904d-45aa-af6e-a63b47fc573c None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:46.299999 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22d1d7-8d09-41a7-ab0c-bcdd7505423c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:46.300777 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22d1d7-8d09-41a7-ab0c-bcdd7505423c service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:46.301271 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22d1d7-8d09-41a7-ab0c-bcdd7505423c service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:46.301724 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22d1d7-8d09-41a7-ab0c-bcdd7505423c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:46.307832 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 912/1819] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:46 2021] PUT /identity/v3/projects/39aa653296d8428e9e90c1287f58ceca/users/a8801bc96dad414bbd4a5b92cc281f47/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:46.312370 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1163447-a5a8-4e7a-a0c0-cd6a4ce65cc9 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:46.312619 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22d1d7-8d09-41a7-ab0c-bcdd7505423c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:46.314071 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22d1d7-8d09-41a7-ab0c-bcdd7505423c service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:46.325367 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 908/1820] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:46.374921 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1163447-a5a8-4e7a-a0c0-cd6a4ce65cc9 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:46.380423 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa3fa0-76a5-488d-b999-24a339044114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:46.381091 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa3fa0-76a5-488d-b999-24a339044114 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:46.381374 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa3fa0-76a5-488d-b999-24a339044114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:46.381778 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa3fa0-76a5-488d-b999-24a339044114 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:46.382915 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa3fa0-76a5-488d-b999-24a339044114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:46.384693 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa3fa0-76a5-488d-b999-24a339044114 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:46.396344 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 913/1821] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:46 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:38:46.400558 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22d1d7-8d09-41a7-ab0c-bcdd7505423c service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:46.402036 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa3fa0-76a5-488d-b999-24a339044114 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:46.404534 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-1afa3fa0-76a5-488d-b999-24a339044114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:46.411091 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22d1d7-8d09-41a7-ab0c-bcdd7505423c service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:46.417902 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7955b-fb86-4fac-b656-44dc21ff84af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:46.418805 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7955b-fb86-4fac-b656-44dc21ff84af admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:46.419152 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7955b-fb86-4fac-b656-44dc21ff84af admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:46.419383 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7955b-fb86-4fac-b656-44dc21ff84af admin admin] PATH_INFO: `/v3/projects/39aa653296d8428e9e90c1287f58ceca/users/a8801bc96dad414bbd4a5b92cc281f47/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:46.422703 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7955b-fb86-4fac-b656-44dc21ff84af admin admin] RBAC: Authorizing `identity:create_grant(project_id=39aa653296d8428e9e90c1287f58ceca, user_id=a8801bc96dad414bbd4a5b92cc281f47, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:46.424273 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa3fa0-76a5-488d-b999-24a339044114 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:46.425584 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7955b-fb86-4fac-b656-44dc21ff84af admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:46.430257 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d9905-d095-4b1d-8363-477a69759b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:46.431122 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d9905-d095-4b1d-8363-477a69759b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:46.431460 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d9905-d095-4b1d-8363-477a69759b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:46.431778 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d9905-d095-4b1d-8363-477a69759b93 admin admin] PATH_INFO: `/v3/projects/50e3d9a85d8647a5ae499be7e1f0f14a` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:46.433036 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d9905-d095-4b1d-8363-477a69759b93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50e3d9a85d8647a5ae499be7e1f0f14a)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:46.435924 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d9905-d095-4b1d-8363-477a69759b93 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:46.447300 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 909/1822] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:46 2021] PUT /identity/v3/projects/39aa653296d8428e9e90c1287f58ceca/users/a8801bc96dad414bbd4a5b92cc281f47/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:46.449355 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df132b49-5900-4ccc-9077-5d382cc83238 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:46.449644 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df132b49-5900-4ccc-9077-5d382cc83238 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:46.449920 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df132b49-5900-4ccc-9077-5d382cc83238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:46.480083 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-df132b49-5900-4ccc-9077-5d382cc83238 None None] MFA Rules not processed for user `a8801bc96dad414bbd4a5b92cc281f47`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:46.481388 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-df132b49-5900-4ccc-9077-5d382cc83238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:46.484215 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a55d9905-d095-4b1d-8363-477a69759b93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50e3d9a85d8647a5ae499be7e1f0f14a', 'request_id': 'req-a55d9905-d095-4b1d-8363-477a69759b93'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:46.490402 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a55d9905-d095-4b1d-8363-477a69759b93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50e3d9a85d8647a5ae499be7e1f0f14a', 'request_id': 'req-a55d9905-d095-4b1d-8363-477a69759b93'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:46.496650 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a55d9905-d095-4b1d-8363-477a69759b93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50e3d9a85d8647a5ae499be7e1f0f14a', 'request_id': 'req-a55d9905-d095-4b1d-8363-477a69759b93'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:46.509601 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a55d9905-d095-4b1d-8363-477a69759b93 admin admin] The token cache is being invalidate because project 50e3d9a85d8647a5ae499be7e1f0f14a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:38:46.509897 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a55d9905-d095-4b1d-8363-477a69759b93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:46.510620 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a55d9905-d095-4b1d-8363-477a69759b93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:46.513104 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 914/1823] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:38:46 2021] DELETE /identity/v3/projects/50e3d9a85d8647a5ae499be7e1f0f14a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:46.518760 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cc95b-c3d5-4ced-895e-6eb0f500b1a9 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:46.519044 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cc95b-c3d5-4ced-895e-6eb0f500b1a9 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:46.519320 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cc95b-c3d5-4ced-895e-6eb0f500b1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:46.540959 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-a62cc95b-c3d5-4ced-895e-6eb0f500b1a9 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:46.543850 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-a62cc95b-c3d5-4ced-895e-6eb0f500b1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:46.584040 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 910/1824] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:46 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:46.594233 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df132b49-5900-4ccc-9077-5d382cc83238 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:46.596694 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-df132b49-5900-4ccc-9077-5d382cc83238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:46.651110 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 915/1825] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:38:46.660842 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3786b-8dba-4071-81f0-c02d4b5ba043 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:46.661400 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3786b-8dba-4071-81f0-c02d4b5ba043 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:46.661829 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3786b-8dba-4071-81f0-c02d4b5ba043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:46.706602 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-65b3786b-8dba-4071-81f0-c02d4b5ba043 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:46.709436 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-65b3786b-8dba-4071-81f0-c02d4b5ba043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:46.726315 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df132b49-5900-4ccc-9077-5d382cc83238 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:46.733918 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 916/1826] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:38:46.735628 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3786b-8dba-4071-81f0-c02d4b5ba043 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:46.740829 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b3349-301e-4311-a170-9e5ee49172dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:46.741515 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b3349-301e-4311-a170-9e5ee49172dc service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:46.741805 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b3349-301e-4311-a170-9e5ee49172dc service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:46.742088 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b3349-301e-4311-a170-9e5ee49172dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:46.753965 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3786b-8dba-4071-81f0-c02d4b5ba043 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:46.760566 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-355b3349-301e-4311-a170-9e5ee49172dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:46.766079 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c69f69-d243-4d32-a28c-c5b923544ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:46.766919 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c69f69-d243-4d32-a28c-c5b923544ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:46.767248 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c69f69-d243-4d32-a28c-c5b923544ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:46.767635 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c69f69-d243-4d32-a28c-c5b923544ad2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:46.769349 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c69f69-d243-4d32-a28c-c5b923544ad2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:38:46.771387 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c69f69-d243-4d32-a28c-c5b923544ad2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:46.774686 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c69f69-d243-4d32-a28c-c5b923544ad2 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:46.802330 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 917/1827] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:38:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:38:46.802330 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c69f69-d243-4d32-a28c-c5b923544ad2 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:46.815048 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-08c69f69-d243-4d32-a28c-c5b923544ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:46.860003 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c69f69-d243-4d32-a28c-c5b923544ad2 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:46.868139 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0707df1-7c67-4278-b965-b0db59f7c0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:46.869091 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0707df1-7c67-4278-b965-b0db59f7c0b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:46.869450 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0707df1-7c67-4278-b965-b0db59f7c0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:46.869800 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0707df1-7c67-4278-b965-b0db59f7c0b1 admin admin] PATH_INFO: `/v3/projects/3d8dd9aab31b4356916f66c805c08c9f` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:46.871993 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0707df1-7c67-4278-b965-b0db59f7c0b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d8dd9aab31b4356916f66c805c08c9f)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:46.877130 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0707df1-7c67-4278-b965-b0db59f7c0b1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:46.908578 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b3349-301e-4311-a170-9e5ee49172dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:46.909797 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b3349-301e-4311-a170-9e5ee49172dc service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:46.920121 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 911/1828] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:46 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:38:46.921275 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b3349-301e-4311-a170-9e5ee49172dc service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:46.932744 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b3349-301e-4311-a170-9e5ee49172dc service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:46.943985 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f0707df1-7c67-4278-b965-b0db59f7c0b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d8dd9aab31b4356916f66c805c08c9f', 'request_id': 'req-f0707df1-7c67-4278-b965-b0db59f7c0b1'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:46.956603 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f0707df1-7c67-4278-b965-b0db59f7c0b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d8dd9aab31b4356916f66c805c08c9f', 'request_id': 'req-f0707df1-7c67-4278-b965-b0db59f7c0b1'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:46.964047 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f0707df1-7c67-4278-b965-b0db59f7c0b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d8dd9aab31b4356916f66c805c08c9f', 'request_id': 'req-f0707df1-7c67-4278-b965-b0db59f7c0b1'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:46.985366 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f0707df1-7c67-4278-b965-b0db59f7c0b1 admin admin] The token cache is being invalidate because project 3d8dd9aab31b4356916f66c805c08c9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:38:46.986526 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f0707df1-7c67-4278-b965-b0db59f7c0b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:46.988847 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f0707df1-7c67-4278-b965-b0db59f7c0b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:46.998320 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 918/1829] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:38:46 2021] DELETE /identity/v3/projects/3d8dd9aab31b4356916f66c805c08c9f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:47.003744 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0707df1-7c67-4278-b965-b0db59f7c0b1 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:47.006799 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-f0707df1-7c67-4278-b965-b0db59f7c0b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:47.066802 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b81e8-e871-491e-9b47-68b71e76f447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:47.067524 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b81e8-e871-491e-9b47-68b71e76f447 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:47.067841 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b81e8-e871-491e-9b47-68b71e76f447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:47.068112 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b81e8-e871-491e-9b47-68b71e76f447 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:47.069637 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b81e8-e871-491e-9b47-68b71e76f447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:47.072432 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b81e8-e871-491e-9b47-68b71e76f447 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:47.108582 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0707df1-7c67-4278-b965-b0db59f7c0b1 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:47.115160 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 912/1830] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:46 2021] POST /identity/v3/projects => generated 407 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:47.116312 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b81e8-e871-491e-9b47-68b71e76f447 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:47.118916 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-851b81e8-e871-491e-9b47-68b71e76f447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:47.126891 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aebf97-b48d-43d7-ac98-9d2cfff4d0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:47.127451 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aebf97-b48d-43d7-ac98-9d2cfff4d0d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:47.127791 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aebf97-b48d-43d7-ac98-9d2cfff4d0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:47.129767 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aebf97-b48d-43d7-ac98-9d2cfff4d0d4 admin admin] PATH_INFO: `/v3/users/bb8748ad7f2643a187f2f9ca192174ae` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:47.133191 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aebf97-b48d-43d7-ac98-9d2cfff4d0d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb8748ad7f2643a187f2f9ca192174ae)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:47.138726 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aebf97-b48d-43d7-ac98-9d2cfff4d0d4 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:47.195545 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b81e8-e871-491e-9b47-68b71e76f447 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:47.200961 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03aa7b-db9a-4eac-915d-0a3b33463c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:47.201774 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03aa7b-db9a-4eac-915d-0a3b33463c92 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:47.202156 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03aa7b-db9a-4eac-915d-0a3b33463c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:47.202651 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03aa7b-db9a-4eac-915d-0a3b33463c92 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:47.203574 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03aa7b-db9a-4eac-915d-0a3b33463c92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:47.205959 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03aa7b-db9a-4eac-915d-0a3b33463c92 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:47.216707 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-e7aebf97-b48d-43d7-ac98-9d2cfff4d0d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb8748ad7f2643a187f2f9ca192174ae'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:47.235796 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 913/1831] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:47 2021] POST /identity/v3/users => generated 304 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:47.237385 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-e7aebf97-b48d-43d7-ac98-9d2cfff4d0d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb8748ad7f2643a187f2f9ca192174ae'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:47.238357 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03aa7b-db9a-4eac-915d-0a3b33463c92 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:47.249322 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-e7aebf97-b48d-43d7-ac98-9d2cfff4d0d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb8748ad7f2643a187f2f9ca192174ae'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:47.250014 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-e7aebf97-b48d-43d7-ac98-9d2cfff4d0d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb8748ad7f2643a187f2f9ca192174ae'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:47.257113 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03aa7b-db9a-4eac-915d-0a3b33463c92 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:47.257845 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-e7aebf97-b48d-43d7-ac98-9d2cfff4d0d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb8748ad7f2643a187f2f9ca192174ae'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:47.263768 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a345dc-1e8f-43c5-9ee9-50ff12aad852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:47.264581 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a345dc-1e8f-43c5-9ee9-50ff12aad852 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:47.265508 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a345dc-1e8f-43c5-9ee9-50ff12aad852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:47.265913 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a345dc-1e8f-43c5-9ee9-50ff12aad852 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:47.267045 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 919/1832] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:38:47 2021] DELETE /identity/v3/users/bb8748ad7f2643a187f2f9ca192174ae => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:47.267597 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a345dc-1e8f-43c5-9ee9-50ff12aad852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:47.269307 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a345dc-1e8f-43c5-9ee9-50ff12aad852 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:47.283123 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 914/1833] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:47 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:47.287022 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aebf97-b48d-43d7-ac98-9d2cfff4d0d4 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:47.289969 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-e7aebf97-b48d-43d7-ac98-9d2cfff4d0d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:47.384494 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aebf97-b48d-43d7-ac98-9d2cfff4d0d4 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:47.396156 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595381e-50d0-45ee-a051-cec1a70dc4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:47.396970 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595381e-50d0-45ee-a051-cec1a70dc4dc admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:47.397380 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595381e-50d0-45ee-a051-cec1a70dc4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:47.397759 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595381e-50d0-45ee-a051-cec1a70dc4dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:47.398630 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595381e-50d0-45ee-a051-cec1a70dc4dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:47.401137 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595381e-50d0-45ee-a051-cec1a70dc4dc admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:47.428336 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 920/1834] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:47 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:38:47.433750 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a345dc-1e8f-43c5-9ee9-50ff12aad852 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:47.447242 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a345dc-1e8f-43c5-9ee9-50ff12aad852 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:47.461098 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c1460-e163-4101-b4ff-d1ec2964cf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:47.462178 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c1460-e163-4101-b4ff-d1ec2964cf58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:47.462576 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c1460-e163-4101-b4ff-d1ec2964cf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:47.462962 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c1460-e163-4101-b4ff-d1ec2964cf58 admin admin] PATH_INFO: `/v3/projects/2402a857bcd04d459005c63b57caa964/users/2ec44c6bb252488aaab66bd1db0ebf7e/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:47.498423 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c1460-e163-4101-b4ff-d1ec2964cf58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2402a857bcd04d459005c63b57caa964, user_id=2ec44c6bb252488aaab66bd1db0ebf7e, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:47.501814 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c1460-e163-4101-b4ff-d1ec2964cf58 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:47.534971 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 915/1835] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:47 2021] PUT /identity/v3/projects/2402a857bcd04d459005c63b57caa964/users/2ec44c6bb252488aaab66bd1db0ebf7e/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:47.547041 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190440b8-b5b6-42b2-a1a7-1c722b1e1750 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:47.547412 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190440b8-b5b6-42b2-a1a7-1c722b1e1750 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:47.547806 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190440b8-b5b6-42b2-a1a7-1c722b1e1750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:47.598408 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-190440b8-b5b6-42b2-a1a7-1c722b1e1750 None None] MFA Rules not processed for user `2ec44c6bb252488aaab66bd1db0ebf7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:47.601930 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-190440b8-b5b6-42b2-a1a7-1c722b1e1750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:47.736389 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 921/1836] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:47 2021] POST /identity/v3/auth/tokens => generated 3427 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:47.740971 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c1460-e163-4101-b4ff-d1ec2964cf58 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:47.755212 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190440b8-b5b6-42b2-a1a7-1c722b1e1750 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:47.757003 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-190440b8-b5b6-42b2-a1a7-1c722b1e1750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:47.835551 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c1460-e163-4101-b4ff-d1ec2964cf58 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:47.840458 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190440b8-b5b6-42b2-a1a7-1c722b1e1750 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:47.840640 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d2f07-acda-45eb-a968-8eaca44a7691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:47.841298 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d2f07-acda-45eb-a968-8eaca44a7691 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:47.841610 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d2f07-acda-45eb-a968-8eaca44a7691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:47.841886 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d2f07-acda-45eb-a968-8eaca44a7691 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:47.842591 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d2f07-acda-45eb-a968-8eaca44a7691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:47.845189 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d2f07-acda-45eb-a968-8eaca44a7691 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:47.845616 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f79ad-e7b3-443b-90f6-24db5ddcc31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:47.846655 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f79ad-e7b3-443b-90f6-24db5ddcc31b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:47.847014 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f79ad-e7b3-443b-90f6-24db5ddcc31b admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:47.847358 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f79ad-e7b3-443b-90f6-24db5ddcc31b admin admin] PATH_INFO: `/v3/projects/e93116e19b154d7687210e4e8b5a5fbd` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:47.848676 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f79ad-e7b3-443b-90f6-24db5ddcc31b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e93116e19b154d7687210e4e8b5a5fbd)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:47.850731 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f79ad-e7b3-443b-90f6-24db5ddcc31b admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:47.886888 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 916/1837] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:47 2021] POST /identity/v3/projects => generated 409 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:47.887929 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d2f07-acda-45eb-a968-8eaca44a7691 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:47.910843 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-e51f79ad-e7b3-443b-90f6-24db5ddcc31b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e93116e19b154d7687210e4e8b5a5fbd', 'request_id': 'req-e51f79ad-e7b3-443b-90f6-24db5ddcc31b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:47.919255 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-e51f79ad-e7b3-443b-90f6-24db5ddcc31b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e93116e19b154d7687210e4e8b5a5fbd', 'request_id': 'req-e51f79ad-e7b3-443b-90f6-24db5ddcc31b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:47.926792 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-e51f79ad-e7b3-443b-90f6-24db5ddcc31b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e93116e19b154d7687210e4e8b5a5fbd', 'request_id': 'req-e51f79ad-e7b3-443b-90f6-24db5ddcc31b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:47.942099 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-e51f79ad-e7b3-443b-90f6-24db5ddcc31b admin admin] The token cache is being invalidate because project e93116e19b154d7687210e4e8b5a5fbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:38:47.942516 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-e51f79ad-e7b3-443b-90f6-24db5ddcc31b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:47.943497 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-e51f79ad-e7b3-443b-90f6-24db5ddcc31b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:47.949394 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 922/1838] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:38:47 2021] DELETE /identity/v3/projects/e93116e19b154d7687210e4e8b5a5fbd => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:47.952603 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73ce84-b3b6-4ece-96be-977bde0ea732 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:47.953223 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73ce84-b3b6-4ece-96be-977bde0ea732 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:47.953717 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73ce84-b3b6-4ece-96be-977bde0ea732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:47.974706 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d2f07-acda-45eb-a968-8eaca44a7691 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:47.978244 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-8b73ce84-b3b6-4ece-96be-977bde0ea732 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:47.980865 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-8b73ce84-b3b6-4ece-96be-977bde0ea732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:48.055005 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10966cfd-7d71-40cc-8e10-05159bc74b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:48.055931 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10966cfd-7d71-40cc-8e10-05159bc74b4a admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:48.056076 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10966cfd-7d71-40cc-8e10-05159bc74b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:48.056352 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10966cfd-7d71-40cc-8e10-05159bc74b4a admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:48.058970 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 923/1839] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:48.060564 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10966cfd-7d71-40cc-8e10-05159bc74b4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:48.062608 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10966cfd-7d71-40cc-8e10-05159bc74b4a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:48.067272 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac833d-dab3-45cc-b69e-c9927d6ddcbc None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:48.067568 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac833d-dab3-45cc-b69e-c9927d6ddcbc None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:48.067878 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac833d-dab3-45cc-b69e-c9927d6ddcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:48.090902 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-1bac833d-dab3-45cc-b69e-c9927d6ddcbc None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:48.092109 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-1bac833d-dab3-45cc-b69e-c9927d6ddcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:48.100903 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 917/1840] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:47 2021] POST /identity/v3/users => generated 311 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:38:48.103235 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 924/1841] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:48.107237 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10966cfd-7d71-40cc-8e10-05159bc74b4a admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:48.108322 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac833d-dab3-45cc-b69e-c9927d6ddcbc None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:48.109116 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-10966cfd-7d71-40cc-8e10-05159bc74b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:48.122518 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac833d-dab3-45cc-b69e-c9927d6ddcbc None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:48.122656 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10966cfd-7d71-40cc-8e10-05159bc74b4a admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:48.127710 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c395d-fa5a-47cf-b8a0-f7d8cf447912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:48.127844 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85193b7f-d51b-4140-9086-567a47e5e0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:48.128446 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c395d-fa5a-47cf-b8a0-f7d8cf447912 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:48.128545 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85193b7f-d51b-4140-9086-567a47e5e0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:48.129311 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c395d-fa5a-47cf-b8a0-f7d8cf447912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:48.129425 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85193b7f-d51b-4140-9086-567a47e5e0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:48.129520 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c395d-fa5a-47cf-b8a0-f7d8cf447912 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:48.129615 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85193b7f-d51b-4140-9086-567a47e5e0e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:48.129871 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c395d-fa5a-47cf-b8a0-f7d8cf447912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:48.130191 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85193b7f-d51b-4140-9086-567a47e5e0e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:38:48.131467 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85193b7f-d51b-4140-9086-567a47e5e0e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:48.131945 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c395d-fa5a-47cf-b8a0-f7d8cf447912 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:48.133835 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85193b7f-d51b-4140-9086-567a47e5e0e1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:48.144756 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 918/1842] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:48 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:38:48.148671 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 925/1843] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:38:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:38:48.149031 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c395d-fa5a-47cf-b8a0-f7d8cf447912 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:48.153003 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85193b7f-d51b-4140-9086-567a47e5e0e1 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:48.163771 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c395d-fa5a-47cf-b8a0-f7d8cf447912 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:48.166605 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85193b7f-d51b-4140-9086-567a47e5e0e1 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:48.169094 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a76687-fcda-46b8-b74c-bc9f07fef50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:48.170209 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a76687-fcda-46b8-b74c-bc9f07fef50d admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:48.170617 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a76687-fcda-46b8-b74c-bc9f07fef50d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:48.171015 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a76687-fcda-46b8-b74c-bc9f07fef50d admin admin] PATH_INFO: `/v3/projects/57dfcb9e384c4fa7b7417284da7f6a8b/users/d5c3310e410142c893df38042732fdda/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:48.172583 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b36de-0b75-4b1f-90d3-2feb43db0d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:48.173301 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b36de-0b75-4b1f-90d3-2feb43db0d5a admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:48.173593 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b36de-0b75-4b1f-90d3-2feb43db0d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:48.173869 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b36de-0b75-4b1f-90d3-2feb43db0d5a admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:48.174729 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b36de-0b75-4b1f-90d3-2feb43db0d5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:48.176904 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b36de-0b75-4b1f-90d3-2feb43db0d5a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:48.188527 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a76687-fcda-46b8-b74c-bc9f07fef50d admin admin] RBAC: Authorizing `identity:create_grant(project_id=57dfcb9e384c4fa7b7417284da7f6a8b, user_id=d5c3310e410142c893df38042732fdda, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:48.191569 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a76687-fcda-46b8-b74c-bc9f07fef50d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:48.211874 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 919/1844] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:48 2021] PUT /identity/v3/projects/57dfcb9e384c4fa7b7417284da7f6a8b/users/d5c3310e410142c893df38042732fdda/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:38:48.216534 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a76687-fcda-46b8-b74c-bc9f07fef50d admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:48.225154 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 926/1845] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:48 2021] POST /identity/v3/projects => generated 365 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:38:48.230203 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b36de-0b75-4b1f-90d3-2feb43db0d5a admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:48.324350 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b36de-0b75-4b1f-90d3-2feb43db0d5a admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:48.326869 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a76687-fcda-46b8-b74c-bc9f07fef50d admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:48.329919 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1573fbe-83c9-4625-9993-befbbfa35a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:48.330757 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1573fbe-83c9-4625-9993-befbbfa35a01 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:48.331108 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1573fbe-83c9-4625-9993-befbbfa35a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:48.331465 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1573fbe-83c9-4625-9993-befbbfa35a01 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:48.332279 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1573fbe-83c9-4625-9993-befbbfa35a01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:48.332405 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde689ec-6b92-42c2-914b-14130e23ffba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:48.332996 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde689ec-6b92-42c2-914b-14130e23ffba admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:48.333284 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde689ec-6b92-42c2-914b-14130e23ffba admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:48.333629 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde689ec-6b92-42c2-914b-14130e23ffba admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:48.334252 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1573fbe-83c9-4625-9993-befbbfa35a01 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:48.334358 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde689ec-6b92-42c2-914b-14130e23ffba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:48.336085 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde689ec-6b92-42c2-914b-14130e23ffba admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:48.347354 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 920/1846] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:48 2021] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:38:48.351928 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde689ec-6b92-42c2-914b-14130e23ffba admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:48.361560 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 927/1847] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:48 2021] POST /identity/v3/users => generated 283 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:48.363118 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1573fbe-83c9-4625-9993-befbbfa35a01 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:48.364466 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde689ec-6b92-42c2-914b-14130e23ffba admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:48.369529 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb772b-a942-4917-ba38-db3b792bb6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:48.371104 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb772b-a942-4917-ba38-db3b792bb6cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:48.371468 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb772b-a942-4917-ba38-db3b792bb6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:48.371865 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb772b-a942-4917-ba38-db3b792bb6cf admin admin] PATH_INFO: `/v3/projects/57dfcb9e384c4fa7b7417284da7f6a8b/users/d5c3310e410142c893df38042732fdda/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:48.377823 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1573fbe-83c9-4625-9993-befbbfa35a01 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:48.378059 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb772b-a942-4917-ba38-db3b792bb6cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=57dfcb9e384c4fa7b7417284da7f6a8b, user_id=d5c3310e410142c893df38042732fdda, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:48.381058 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb772b-a942-4917-ba38-db3b792bb6cf admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:48.383460 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ff5c5-dee6-4bf3-9549-4ff1d1963d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:48.384286 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ff5c5-dee6-4bf3-9549-4ff1d1963d92 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:48.384632 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ff5c5-dee6-4bf3-9549-4ff1d1963d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:48.384992 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ff5c5-dee6-4bf3-9549-4ff1d1963d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:48.385875 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ff5c5-dee6-4bf3-9549-4ff1d1963d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:48.387508 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ff5c5-dee6-4bf3-9549-4ff1d1963d92 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:48.394016 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 921/1848] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:48 2021] PUT /identity/v3/projects/57dfcb9e384c4fa7b7417284da7f6a8b/users/d5c3310e410142c893df38042732fdda/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:38:48.400724 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 928/1849] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:48 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:48.404254 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045627da-8f40-4d5a-a804-bc12f0fe0585 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:48.404538 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045627da-8f40-4d5a-a804-bc12f0fe0585 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:48.404679 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ff5c5-dee6-4bf3-9549-4ff1d1963d92 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:48.404812 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045627da-8f40-4d5a-a804-bc12f0fe0585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:48.420038 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ff5c5-dee6-4bf3-9549-4ff1d1963d92 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:48.433511 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-045627da-8f40-4d5a-a804-bc12f0fe0585 None None] MFA Rules not processed for user `d5c3310e410142c893df38042732fdda`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:48.434713 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-045627da-8f40-4d5a-a804-bc12f0fe0585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:48.475596 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5153f6c-b9c1-40e2-9758-58349aeb103d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:48.476284 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5153f6c-b9c1-40e2-9758-58349aeb103d admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:48.476566 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5153f6c-b9c1-40e2-9758-58349aeb103d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:48.476838 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5153f6c-b9c1-40e2-9758-58349aeb103d admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:48.477585 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5153f6c-b9c1-40e2-9758-58349aeb103d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:48.479162 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5153f6c-b9c1-40e2-9758-58349aeb103d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:48.488687 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 929/1850] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:48 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:48.492743 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5153f6c-b9c1-40e2-9758-58349aeb103d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:48.502162 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5153f6c-b9c1-40e2-9758-58349aeb103d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:48.504076 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 922/1851] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:48 2021] POST /identity/v3/auth/tokens => generated 3496 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:38:48.506695 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec35022-c7c5-48c2-bb72-d071bb6f6ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:48.507615 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec35022-c7c5-48c2-bb72-d071bb6f6ae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:48.507928 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec35022-c7c5-48c2-bb72-d071bb6f6ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:48.508204 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec35022-c7c5-48c2-bb72-d071bb6f6ae9 admin admin] PATH_INFO: `/v3/projects/8e856dafef48468b8537dea3b590e9f0/users/79738c20395a424584f8208463c7effe/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:48.514598 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045627da-8f40-4d5a-a804-bc12f0fe0585 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:48.515936 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-045627da-8f40-4d5a-a804-bc12f0fe0585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:48.523278 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec35022-c7c5-48c2-bb72-d071bb6f6ae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e856dafef48468b8537dea3b590e9f0, user_id=79738c20395a424584f8208463c7effe, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:48.525933 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec35022-c7c5-48c2-bb72-d071bb6f6ae9 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:48.538384 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 930/1852] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:48 2021] PUT /identity/v3/projects/8e856dafef48468b8537dea3b590e9f0/users/79738c20395a424584f8208463c7effe/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:38:48.550329 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1c8c4-dc63-4c5f-a102-de6347425200 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:48.550616 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1c8c4-dc63-4c5f-a102-de6347425200 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:48.550892 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1c8c4-dc63-4c5f-a102-de6347425200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:48.578694 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045627da-8f40-4d5a-a804-bc12f0fe0585 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:48.580368 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-59c1c8c4-dc63-4c5f-a102-de6347425200 None None] MFA Rules not processed for user `79738c20395a424584f8208463c7effe`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:48.581733 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-59c1c8c4-dc63-4c5f-a102-de6347425200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:48.637511 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b5121-b609-40f0-a07c-6726149d8557 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:48.638720 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b5121-b609-40f0-a07c-6726149d8557 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:48.638720 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b5121-b609-40f0-a07c-6726149d8557 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:48.638979 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b5121-b609-40f0-a07c-6726149d8557 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:48.652096 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 931/1853] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:48 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:48.656546 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1c8c4-dc63-4c5f-a102-de6347425200 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:48.728293 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b5121-b609-40f0-a07c-6726149d8557 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:48.730015 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b5121-b609-40f0-a07c-6726149d8557 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:48.739855 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1c8c4-dc63-4c5f-a102-de6347425200 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:48.759135 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 923/1854] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:48 2021] GET /identity/v3/auth/tokens => generated 3496 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:38:48.761753 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9493bb-a2e5-445d-a541-a7de38fdba6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:48.764563 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9493bb-a2e5-445d-a541-a7de38fdba6d admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:48.766923 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9493bb-a2e5-445d-a541-a7de38fdba6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:48.767666 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9493bb-a2e5-445d-a541-a7de38fdba6d admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:48.769049 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9493bb-a2e5-445d-a541-a7de38fdba6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:48.776090 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9493bb-a2e5-445d-a541-a7de38fdba6d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:48.827937 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 932/1855] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:48 2021] POST /identity/v3/projects => generated 365 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:48.832119 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b5121-b609-40f0-a07c-6726149d8557 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:48.845812 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b5121-b609-40f0-a07c-6726149d8557 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:48.935269 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32477b-7ce6-4229-a6b4-d4158f31a900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:48.936184 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32477b-7ce6-4229-a6b4-d4158f31a900 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:48.936613 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32477b-7ce6-4229-a6b4-d4158f31a900 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:48.937057 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32477b-7ce6-4229-a6b4-d4158f31a900 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:48.938416 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32477b-7ce6-4229-a6b4-d4158f31a900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:48.940896 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32477b-7ce6-4229-a6b4-d4158f31a900 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:48.966567 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 924/1856] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:48 2021] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:48.970712 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9493bb-a2e5-445d-a541-a7de38fdba6d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:48.985818 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9493bb-a2e5-445d-a541-a7de38fdba6d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:48.989612 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32477b-7ce6-4229-a6b4-d4158f31a900 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:49.000447 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d684ff-e774-4278-a61b-2688b387768d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:49.001328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d684ff-e774-4278-a61b-2688b387768d admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:49.001614 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d684ff-e774-4278-a61b-2688b387768d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:49.001888 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d684ff-e774-4278-a61b-2688b387768d admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:49.002906 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d684ff-e774-4278-a61b-2688b387768d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:49.007992 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d684ff-e774-4278-a61b-2688b387768d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:49.019661 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 933/1857] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:48 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:49.023827 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d684ff-e774-4278-a61b-2688b387768d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:49.035481 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d684ff-e774-4278-a61b-2688b387768d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:49.040245 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4bb76-0604-423a-b444-04fcdccafb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:49.041642 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4bb76-0604-423a-b444-04fcdccafb40 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:49.041950 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4bb76-0604-423a-b444-04fcdccafb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:49.042221 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4bb76-0604-423a-b444-04fcdccafb40 admin admin] PATH_INFO: `/v3/projects/786909a435934808a5b0ea03eae36ed2/users/1a0fa1e1f50d482f95c4208c763d49b0/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:49.054880 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32477b-7ce6-4229-a6b4-d4158f31a900 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:49.057407 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4bb76-0604-423a-b444-04fcdccafb40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=786909a435934808a5b0ea03eae36ed2, user_id=1a0fa1e1f50d482f95c4208c763d49b0, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:49.059063 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e34e29-ab2c-4da1-869d-ca0c6edc2381 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:49.059805 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e34e29-ab2c-4da1-869d-ca0c6edc2381 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:49.060151 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e34e29-ab2c-4da1-869d-ca0c6edc2381 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:49.060489 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e34e29-ab2c-4da1-869d-ca0c6edc2381 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:49.060600 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4bb76-0604-423a-b444-04fcdccafb40 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:49.062514 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-46e34e29-ab2c-4da1-869d-ca0c6edc2381 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:49.074134 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 934/1858] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:49 2021] PUT /identity/v3/projects/786909a435934808a5b0ea03eae36ed2/users/1a0fa1e1f50d482f95c4208c763d49b0/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:38:49.077826 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4bb76-0604-423a-b444-04fcdccafb40 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:49.128447 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e34e29-ab2c-4da1-869d-ca0c6edc2381 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:49.129980 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e34e29-ab2c-4da1-869d-ca0c6edc2381 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:49.142914 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 925/1859] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:48 2021] GET /identity/v3/auth/tokens => generated 3427 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:38:49.182939 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4bb76-0604-423a-b444-04fcdccafb40 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:49.188419 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b388d-b557-4d59-a892-827e0c89d6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:49.190734 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b388d-b557-4d59-a892-827e0c89d6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:49.190734 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b388d-b557-4d59-a892-827e0c89d6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:49.190734 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b388d-b557-4d59-a892-827e0c89d6e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:49.191379 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b388d-b557-4d59-a892-827e0c89d6e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:49.193211 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b388d-b557-4d59-a892-827e0c89d6e2 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:49.207263 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 935/1860] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:49 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:49.211408 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e34e29-ab2c-4da1-869d-ca0c6edc2381 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:49.225865 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e34e29-ab2c-4da1-869d-ca0c6edc2381 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:49.232740 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4629d-77fe-42dc-a619-f6c7e0da728b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:49.233814 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4629d-77fe-42dc-a619-f6c7e0da728b admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:49.234091 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4629d-77fe-42dc-a619-f6c7e0da728b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:49.234505 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4629d-77fe-42dc-a619-f6c7e0da728b admin admin] PATH_INFO: `/v3/projects/786909a435934808a5b0ea03eae36ed2/users/1a0fa1e1f50d482f95c4208c763d49b0/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:49.236655 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4629d-77fe-42dc-a619-f6c7e0da728b admin admin] RBAC: Authorizing `identity:create_grant(project_id=786909a435934808a5b0ea03eae36ed2, user_id=1a0fa1e1f50d482f95c4208c763d49b0, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:49.239640 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4629d-77fe-42dc-a619-f6c7e0da728b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:49.256993 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 926/1861] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:49 2021] PUT /identity/v3/projects/786909a435934808a5b0ea03eae36ed2/users/1a0fa1e1f50d482f95c4208c763d49b0/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:38:49.270522 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e561cf2-6a2f-4f5f-96e6-7a855c490b40 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:49.270725 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e561cf2-6a2f-4f5f-96e6-7a855c490b40 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:49.270997 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e561cf2-6a2f-4f5f-96e6-7a855c490b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:49.314790 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-1e561cf2-6a2f-4f5f-96e6-7a855c490b40 None None] MFA Rules not processed for user `1a0fa1e1f50d482f95c4208c763d49b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:49.316103 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-1e561cf2-6a2f-4f5f-96e6-7a855c490b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:49.367074 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4629d-77fe-42dc-a619-f6c7e0da728b admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:49.369345 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-fbd4629d-77fe-42dc-a619-f6c7e0da728b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:49.409883 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 936/1862] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:49 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:49.461618 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4629d-77fe-42dc-a619-f6c7e0da728b admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:49.472560 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21efda6-d443-4315-a6fc-032b7629672b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:49.473443 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21efda6-d443-4315-a6fc-032b7629672b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:49.473723 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21efda6-d443-4315-a6fc-032b7629672b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:49.473994 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21efda6-d443-4315-a6fc-032b7629672b admin admin] PATH_INFO: `/v3/users/f8363e8fb2a94171a33d096903c7adac` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:49.475233 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21efda6-d443-4315-a6fc-032b7629672b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8363e8fb2a94171a33d096903c7adac)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:49.477331 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21efda6-d443-4315-a6fc-032b7629672b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:49.493258 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e561cf2-6a2f-4f5f-96e6-7a855c490b40 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:49.565032 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e561cf2-6a2f-4f5f-96e6-7a855c490b40 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:49.566163 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a21efda6-d443-4315-a6fc-032b7629672b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8363e8fb2a94171a33d096903c7adac'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:49.569302 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974cca0-4fb8-4914-86c7-46b36dd0376e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:49.569955 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974cca0-4fb8-4914-86c7-46b36dd0376e service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:49.570243 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974cca0-4fb8-4914-86c7-46b36dd0376e service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:49.570559 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974cca0-4fb8-4914-86c7-46b36dd0376e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:49.580057 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a21efda6-d443-4315-a6fc-032b7629672b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8363e8fb2a94171a33d096903c7adac'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:49.581870 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974cca0-4fb8-4914-86c7-46b36dd0376e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:49.584114 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974cca0-4fb8-4914-86c7-46b36dd0376e service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:49.590978 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a21efda6-d443-4315-a6fc-032b7629672b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8363e8fb2a94171a33d096903c7adac'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:49.592013 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a21efda6-d443-4315-a6fc-032b7629672b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8363e8fb2a94171a33d096903c7adac'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:49.597808 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 937/1863] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:49 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:38:49.613774 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a21efda6-d443-4315-a6fc-032b7629672b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8363e8fb2a94171a33d096903c7adac'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:49.622333 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 927/1864] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:38:49 2021] DELETE /identity/v3/users/f8363e8fb2a94171a33d096903c7adac => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:38:49.627436 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ba84c-d887-4934-96d9-e7ac63fdb4eb None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:49.627770 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ba84c-d887-4934-96d9-e7ac63fdb4eb None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:49.628052 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ba84c-d887-4934-96d9-e7ac63fdb4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:49.658758 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-720ba84c-d887-4934-96d9-e7ac63fdb4eb None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:49.660472 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-720ba84c-d887-4934-96d9-e7ac63fdb4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:49.698409 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21efda6-d443-4315-a6fc-032b7629672b admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:49.700085 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-a21efda6-d443-4315-a6fc-032b7629672b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:49.752774 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 938/1865] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:38:49.763060 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ba84c-d887-4934-96d9-e7ac63fdb4eb None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:49.764480 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-720ba84c-d887-4934-96d9-e7ac63fdb4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:49.774163 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21efda6-d443-4315-a6fc-032b7629672b admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:49.778539 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1da56-c8f7-484b-927b-bcfef224077b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:49.779418 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1da56-c8f7-484b-927b-bcfef224077b service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:49.779768 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1da56-c8f7-484b-927b-bcfef224077b service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:49.780043 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1da56-c8f7-484b-927b-bcfef224077b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:49.781864 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7cf1da56-c8f7-484b-927b-bcfef224077b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:49.819729 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ba84c-d887-4934-96d9-e7ac63fdb4eb None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:49.823649 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd0eee-9618-4a02-8a1a-6934aa758440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:49.824286 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd0eee-9618-4a02-8a1a-6934aa758440 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:49.824534 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd0eee-9618-4a02-8a1a-6934aa758440 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:49.824806 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd0eee-9618-4a02-8a1a-6934aa758440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:49.834029 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd0eee-9618-4a02-8a1a-6934aa758440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:49.836061 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd0eee-9618-4a02-8a1a-6934aa758440 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:49.837728 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1da56-c8f7-484b-927b-bcfef224077b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:49.839703 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1da56-c8f7-484b-927b-bcfef224077b service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:49.847027 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 939/1866] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:38:49.849212 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 928/1867] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:49 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:50.116626 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd0eee-9618-4a02-8a1a-6934aa758440 service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:50.118031 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-e0fd0eee-9618-4a02-8a1a-6934aa758440 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:50.135975 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd0eee-9618-4a02-8a1a-6934aa758440 service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:50.141297 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f019d-c4a5-43f2-92dc-270714ca80e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:50.142116 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f019d-c4a5-43f2-92dc-270714ca80e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:50.142397 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f019d-c4a5-43f2-92dc-270714ca80e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:50.142657 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f019d-c4a5-43f2-92dc-270714ca80e8 admin admin] PATH_INFO: `/v3/projects/b27b0e089f8243ca9d70719c9b171e80` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:50.143879 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f019d-c4a5-43f2-92dc-270714ca80e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b27b0e089f8243ca9d70719c9b171e80)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:50.145782 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f019d-c4a5-43f2-92dc-270714ca80e8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:50.190372 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a10f019d-c4a5-43f2-92dc-270714ca80e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b27b0e089f8243ca9d70719c9b171e80', 'request_id': 'req-a10f019d-c4a5-43f2-92dc-270714ca80e8'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:50.196115 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a10f019d-c4a5-43f2-92dc-270714ca80e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b27b0e089f8243ca9d70719c9b171e80', 'request_id': 'req-a10f019d-c4a5-43f2-92dc-270714ca80e8'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:50.201702 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a10f019d-c4a5-43f2-92dc-270714ca80e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b27b0e089f8243ca9d70719c9b171e80', 'request_id': 'req-a10f019d-c4a5-43f2-92dc-270714ca80e8'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:50.213540 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a10f019d-c4a5-43f2-92dc-270714ca80e8 admin admin] The token cache is being invalidate because project b27b0e089f8243ca9d70719c9b171e80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:38:50.213856 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a10f019d-c4a5-43f2-92dc-270714ca80e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:50.215391 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a10f019d-c4a5-43f2-92dc-270714ca80e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:50.217072 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 940/1868] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:38:50 2021] DELETE /identity/v3/projects/b27b0e089f8243ca9d70719c9b171e80 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:50.222853 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e1dc9-f4e0-46bd-bf30-7ab8d8d6670c None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:50.223382 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e1dc9-f4e0-46bd-bf30-7ab8d8d6670c None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:50.223924 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e1dc9-f4e0-46bd-bf30-7ab8d8d6670c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:50.243518 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-e83e1dc9-f4e0-46bd-bf30-7ab8d8d6670c None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:50.244848 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e83e1dc9-f4e0-46bd-bf30-7ab8d8d6670c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:50.300699 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 929/1869] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:50.308979 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5334db-dee2-4d6b-87b5-156249102101 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:50.309267 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5334db-dee2-4d6b-87b5-156249102101 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:50.309541 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5334db-dee2-4d6b-87b5-156249102101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:50.327428 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-6d5334db-dee2-4d6b-87b5-156249102101 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:50.328650 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-6d5334db-dee2-4d6b-87b5-156249102101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:50.336221 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 941/1870] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:50.340406 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e1dc9-f4e0-46bd-bf30-7ab8d8d6670c None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:50.349604 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e1dc9-f4e0-46bd-bf30-7ab8d8d6670c None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:50.353993 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3235be-8288-4782-b455-72dc257493be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:50.354622 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3235be-8288-4782-b455-72dc257493be admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:50.354931 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3235be-8288-4782-b455-72dc257493be admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:50.355204 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3235be-8288-4782-b455-72dc257493be admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:50.355952 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3235be-8288-4782-b455-72dc257493be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:38:50.356253 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3235be-8288-4782-b455-72dc257493be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:50.357836 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3235be-8288-4782-b455-72dc257493be admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:50.368811 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 930/1871] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:38:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:38:50.373431 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5334db-dee2-4d6b-87b5-156249102101 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:50.382374 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5334db-dee2-4d6b-87b5-156249102101 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:50.387613 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db9bd9-f08f-47fd-b14a-3da6142db2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:50.388275 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db9bd9-f08f-47fd-b14a-3da6142db2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:50.388556 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db9bd9-f08f-47fd-b14a-3da6142db2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:50.388829 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db9bd9-f08f-47fd-b14a-3da6142db2f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:50.389556 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db9bd9-f08f-47fd-b14a-3da6142db2f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:50.391437 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db9bd9-f08f-47fd-b14a-3da6142db2f0 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:50.415344 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 942/1872] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:50 2021] POST /identity/v3/projects => generated 375 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:38:50.419161 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3235be-8288-4782-b455-72dc257493be admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:50.428710 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3235be-8288-4782-b455-72dc257493be admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:50.481569 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457d329-7c31-406a-b57c-a2824235a8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:50.482210 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457d329-7c31-406a-b57c-a2824235a8b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:50.482490 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457d329-7c31-406a-b57c-a2824235a8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:50.482760 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457d329-7c31-406a-b57c-a2824235a8b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:50.483455 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457d329-7c31-406a-b57c-a2824235a8b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:50.485670 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457d329-7c31-406a-b57c-a2824235a8b9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:50.509196 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 931/1873] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:50 2021] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:50.511875 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db9bd9-f08f-47fd-b14a-3da6142db2f0 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:50.522123 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db9bd9-f08f-47fd-b14a-3da6142db2f0 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:50.526583 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245068d-3d55-4aef-a4d6-907bfd749784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:50.527594 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245068d-3d55-4aef-a4d6-907bfd749784 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:50.527913 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245068d-3d55-4aef-a4d6-907bfd749784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:50.528188 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245068d-3d55-4aef-a4d6-907bfd749784 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:50.528920 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245068d-3d55-4aef-a4d6-907bfd749784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:50.530493 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245068d-3d55-4aef-a4d6-907bfd749784 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:50.540947 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 943/1874] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:50.544845 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457d329-7c31-406a-b57c-a2824235a8b9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:50.554757 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457d329-7c31-406a-b57c-a2824235a8b9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:50.559941 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4e354-6933-4add-878a-8ae58aa53212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:50.560589 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4e354-6933-4add-878a-8ae58aa53212 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:50.560876 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4e354-6933-4add-878a-8ae58aa53212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:50.561152 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4e354-6933-4add-878a-8ae58aa53212 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:50.561877 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4e354-6933-4add-878a-8ae58aa53212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:50.563477 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4e354-6933-4add-878a-8ae58aa53212 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:50.574526 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 932/1875] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:50.578596 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245068d-3d55-4aef-a4d6-907bfd749784 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:50.588432 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245068d-3d55-4aef-a4d6-907bfd749784 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:50.593188 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776d1ff-f569-4f93-a1ce-d5e81fa70659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:50.594036 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776d1ff-f569-4f93-a1ce-d5e81fa70659 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:50.594315 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776d1ff-f569-4f93-a1ce-d5e81fa70659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:50.594585 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776d1ff-f569-4f93-a1ce-d5e81fa70659 admin admin] PATH_INFO: `/v3/projects/7e624a7bd88a43759855549ce696e6b5/users/5442cd922fbd4408964c325ffd52bac4/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:50.608759 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776d1ff-f569-4f93-a1ce-d5e81fa70659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e624a7bd88a43759855549ce696e6b5, user_id=5442cd922fbd4408964c325ffd52bac4, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:50.611376 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776d1ff-f569-4f93-a1ce-d5e81fa70659 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:50.624357 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 944/1876] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:50 2021] PUT /identity/v3/projects/7e624a7bd88a43759855549ce696e6b5/users/5442cd922fbd4408964c325ffd52bac4/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:50.634940 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d351fe-ec98-4922-a126-ae829ef2fea7 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:50.635253 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d351fe-ec98-4922-a126-ae829ef2fea7 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:50.635529 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d351fe-ec98-4922-a126-ae829ef2fea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:50.661550 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-76d351fe-ec98-4922-a126-ae829ef2fea7 None None] MFA Rules not processed for user `5442cd922fbd4408964c325ffd52bac4`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:50.662794 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-76d351fe-ec98-4922-a126-ae829ef2fea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:50.729050 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 933/1877] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:50 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:50.734036 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776d1ff-f569-4f93-a1ce-d5e81fa70659 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:50.813796 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776d1ff-f569-4f93-a1ce-d5e81fa70659 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:50.818335 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4fde8-e469-4567-b163-5fe9ff3d8289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:50.818982 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4fde8-e469-4567-b163-5fe9ff3d8289 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:50.819262 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4fde8-e469-4567-b163-5fe9ff3d8289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:50.819530 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4fde8-e469-4567-b163-5fe9ff3d8289 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:50.820342 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4fde8-e469-4567-b163-5fe9ff3d8289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:50.822224 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4fde8-e469-4567-b163-5fe9ff3d8289 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:50.846731 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 945/1878] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:50 2021] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:50.850826 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d351fe-ec98-4922-a126-ae829ef2fea7 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:50.862474 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d351fe-ec98-4922-a126-ae829ef2fea7 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:50.916236 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a2852-1a42-45f4-b8d1-77784045ae0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:50.916896 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a2852-1a42-45f4-b8d1-77784045ae0b admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:50.917182 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a2852-1a42-45f4-b8d1-77784045ae0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:50.917959 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a2852-1a42-45f4-b8d1-77784045ae0b admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:50.918663 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a2852-1a42-45f4-b8d1-77784045ae0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:50.920654 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a2852-1a42-45f4-b8d1-77784045ae0b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:50.940850 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 934/1879] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:50 2021] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:50.944865 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4fde8-e469-4567-b163-5fe9ff3d8289 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:50.954935 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4fde8-e469-4567-b163-5fe9ff3d8289 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:50.959789 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3395e-5eb2-40a2-826d-245a439b30b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:50.960477 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3395e-5eb2-40a2-826d-245a439b30b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:50.960763 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3395e-5eb2-40a2-826d-245a439b30b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:50.961038 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3395e-5eb2-40a2-826d-245a439b30b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:50.961782 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3395e-5eb2-40a2-826d-245a439b30b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:50.963408 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3395e-5eb2-40a2-826d-245a439b30b1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:50.974488 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 946/1880] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:50.978390 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a2852-1a42-45f4-b8d1-77784045ae0b admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:50.988187 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a2852-1a42-45f4-b8d1-77784045ae0b admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:50.992845 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b550e4-ec94-4782-afa2-189406745987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:50.993492 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b550e4-ec94-4782-afa2-189406745987 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:50.993774 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b550e4-ec94-4782-afa2-189406745987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:50.994045 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b550e4-ec94-4782-afa2-189406745987 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:50.994765 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b550e4-ec94-4782-afa2-189406745987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:50.996866 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b550e4-ec94-4782-afa2-189406745987 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:51.011851 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 935/1881] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:50 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:51.013268 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3395e-5eb2-40a2-826d-245a439b30b1 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:51.023070 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3395e-5eb2-40a2-826d-245a439b30b1 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:51.027668 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3f1ff-9dd6-4606-8756-15e0e9db55bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:51.028558 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3f1ff-9dd6-4606-8756-15e0e9db55bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:51.028842 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3f1ff-9dd6-4606-8756-15e0e9db55bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:51.029118 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3f1ff-9dd6-4606-8756-15e0e9db55bf admin admin] PATH_INFO: `/v3/projects/bcac30cfea374f9bbde82c60989732f4/users/c882cff5f8634b7282c0a66f9169785d/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:51.043056 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3f1ff-9dd6-4606-8756-15e0e9db55bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcac30cfea374f9bbde82c60989732f4, user_id=c882cff5f8634b7282c0a66f9169785d, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:51.045752 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3f1ff-9dd6-4606-8756-15e0e9db55bf admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:51.058735 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 947/1882] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:51 2021] PUT /identity/v3/projects/bcac30cfea374f9bbde82c60989732f4/users/c882cff5f8634b7282c0a66f9169785d/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:38:51.069142 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7e17f-21dc-410e-ba3c-de6491c1a2b8 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:51.069365 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7e17f-21dc-410e-ba3c-de6491c1a2b8 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:51.069645 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7e17f-21dc-410e-ba3c-de6491c1a2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:51.095839 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-69c7e17f-21dc-410e-ba3c-de6491c1a2b8 None None] MFA Rules not processed for user `c882cff5f8634b7282c0a66f9169785d`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:51.097053 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-69c7e17f-21dc-410e-ba3c-de6491c1a2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:51.156887 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 936/1883] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:51 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:51.161174 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3f1ff-9dd6-4606-8756-15e0e9db55bf admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:51.220636 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3f1ff-9dd6-4606-8756-15e0e9db55bf admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:51.225270 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6123ac-1cb2-4a1d-abb3-06714ce96063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:51.225911 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6123ac-1cb2-4a1d-abb3-06714ce96063 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:51.226190 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6123ac-1cb2-4a1d-abb3-06714ce96063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:51.226463 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6123ac-1cb2-4a1d-abb3-06714ce96063 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:51.227167 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6123ac-1cb2-4a1d-abb3-06714ce96063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:51.229087 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6123ac-1cb2-4a1d-abb3-06714ce96063 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:51.254545 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 948/1884] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:51 2021] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:51.258717 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7e17f-21dc-410e-ba3c-de6491c1a2b8 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:51.269740 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7e17f-21dc-410e-ba3c-de6491c1a2b8 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:51.322149 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ffb8e-893d-4c1c-9f35-e16f96b59217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:51.322734 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ffb8e-893d-4c1c-9f35-e16f96b59217 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:51.323019 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ffb8e-893d-4c1c-9f35-e16f96b59217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:51.323296 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ffb8e-893d-4c1c-9f35-e16f96b59217 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:51.324594 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ffb8e-893d-4c1c-9f35-e16f96b59217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:51.326512 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ffb8e-893d-4c1c-9f35-e16f96b59217 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:51.345347 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 937/1885] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:51 2021] POST /identity/v3/users => generated 294 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:51.349255 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6123ac-1cb2-4a1d-abb3-06714ce96063 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:51.359819 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6123ac-1cb2-4a1d-abb3-06714ce96063 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:51.364391 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762f38e-238b-45c3-bd59-907e4b19f897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:51.365033 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762f38e-238b-45c3-bd59-907e4b19f897 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:51.365313 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762f38e-238b-45c3-bd59-907e4b19f897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:51.365588 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762f38e-238b-45c3-bd59-907e4b19f897 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:51.366311 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762f38e-238b-45c3-bd59-907e4b19f897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:51.367934 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762f38e-238b-45c3-bd59-907e4b19f897 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:51.378511 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 949/1886] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:51 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:51.382567 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ffb8e-893d-4c1c-9f35-e16f96b59217 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:51.392156 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ffb8e-893d-4c1c-9f35-e16f96b59217 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:51.396654 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c330c-bde0-46b8-9d39-bfed92709b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:51.397513 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c330c-bde0-46b8-9d39-bfed92709b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:51.397792 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c330c-bde0-46b8-9d39-bfed92709b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:51.398066 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c330c-bde0-46b8-9d39-bfed92709b60 admin admin] PATH_INFO: `/v3/projects/2d8db9fc8c374e34a9c0ec25b9662cc9/users/213d87be64f340e7a8ae8ba18d49700b/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:51.411930 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c330c-bde0-46b8-9d39-bfed92709b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8db9fc8c374e34a9c0ec25b9662cc9, user_id=213d87be64f340e7a8ae8ba18d49700b, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:51.414554 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c330c-bde0-46b8-9d39-bfed92709b60 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:51.427669 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 938/1887] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:51 2021] PUT /identity/v3/projects/2d8db9fc8c374e34a9c0ec25b9662cc9/users/213d87be64f340e7a8ae8ba18d49700b/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:38:51.431481 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762f38e-238b-45c3-bd59-907e4b19f897 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:51.441460 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762f38e-238b-45c3-bd59-907e4b19f897 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:51.494071 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4b0d2-cc3d-46f4-87f5-8f60c68cdf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:51.494730 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4b0d2-cc3d-46f4-87f5-8f60c68cdf9a admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:51.495045 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4b0d2-cc3d-46f4-87f5-8f60c68cdf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:51.495330 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4b0d2-cc3d-46f4-87f5-8f60c68cdf9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:51.496141 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4b0d2-cc3d-46f4-87f5-8f60c68cdf9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:51.497859 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4b0d2-cc3d-46f4-87f5-8f60c68cdf9a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:51.507417 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 950/1888] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:51 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:51.512167 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c330c-bde0-46b8-9d39-bfed92709b60 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:51.522301 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c330c-bde0-46b8-9d39-bfed92709b60 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:51.527509 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd07ee-4238-40a7-b844-b28bd13055e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:51.528410 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd07ee-4238-40a7-b844-b28bd13055e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:51.528694 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd07ee-4238-40a7-b844-b28bd13055e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:51.528974 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd07ee-4238-40a7-b844-b28bd13055e1 admin admin] PATH_INFO: `/v3/projects/2d8db9fc8c374e34a9c0ec25b9662cc9/users/213d87be64f340e7a8ae8ba18d49700b/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:51.530951 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd07ee-4238-40a7-b844-b28bd13055e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8db9fc8c374e34a9c0ec25b9662cc9, user_id=213d87be64f340e7a8ae8ba18d49700b, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:51.533610 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd07ee-4238-40a7-b844-b28bd13055e1 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:51.543752 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 939/1889] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:51 2021] PUT /identity/v3/projects/2d8db9fc8c374e34a9c0ec25b9662cc9/users/213d87be64f340e7a8ae8ba18d49700b/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:38:51.553680 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f25c81-48ff-4b2c-b376-506c65f051f6 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:51.553965 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f25c81-48ff-4b2c-b376-506c65f051f6 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:51.554236 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f25c81-48ff-4b2c-b376-506c65f051f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:51.580896 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-06f25c81-48ff-4b2c-b376-506c65f051f6 None None] MFA Rules not processed for user `213d87be64f340e7a8ae8ba18d49700b`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:51.582016 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-06f25c81-48ff-4b2c-b376-506c65f051f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:51.644563 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 951/1890] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:51 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:51.655242 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd07ee-4238-40a7-b844-b28bd13055e1 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:51.657034 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-dccd07ee-4238-40a7-b844-b28bd13055e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:51.710665 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd07ee-4238-40a7-b844-b28bd13055e1 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:51.715146 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf3259-4a26-442e-8f2c-d02dcd0cef64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:51.715865 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf3259-4a26-442e-8f2c-d02dcd0cef64 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:51.716155 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf3259-4a26-442e-8f2c-d02dcd0cef64 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:51.716432 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf3259-4a26-442e-8f2c-d02dcd0cef64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:51.770708 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf3259-4a26-442e-8f2c-d02dcd0cef64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:51.772333 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf3259-4a26-442e-8f2c-d02dcd0cef64 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:51.782527 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 940/1891] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:51 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:52.927148 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f25c81-48ff-4b2c-b376-506c65f051f6 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:52.928553 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-06f25c81-48ff-4b2c-b376-506c65f051f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:52.939873 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f25c81-48ff-4b2c-b376-506c65f051f6 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:52.943303 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22966164-6e23-4a5f-9dbf-6521e5357933 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:52.943950 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22966164-6e23-4a5f-9dbf-6521e5357933 service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:52.944229 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22966164-6e23-4a5f-9dbf-6521e5357933 service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:52.944497 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22966164-6e23-4a5f-9dbf-6521e5357933 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:52.946148 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-22966164-6e23-4a5f-9dbf-6521e5357933 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:53.006740 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22966164-6e23-4a5f-9dbf-6521e5357933 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:53.008204 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22966164-6e23-4a5f-9dbf-6521e5357933 service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:53.018340 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 952/1892] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:52 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:55.615247 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf3259-4a26-442e-8f2c-d02dcd0cef64 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:55.616699 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-dcbf3259-4a26-442e-8f2c-d02dcd0cef64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:55.678743 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf3259-4a26-442e-8f2c-d02dcd0cef64 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:55.683220 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d57ad-f54b-4f2c-a58c-908945e92ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:55.684105 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d57ad-f54b-4f2c-a58c-908945e92ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:55.684387 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d57ad-f54b-4f2c-a58c-908945e92ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:55.684660 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d57ad-f54b-4f2c-a58c-908945e92ab6 admin admin] PATH_INFO: `/v3/users/79738c20395a424584f8208463c7effe` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:55.685820 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d57ad-f54b-4f2c-a58c-908945e92ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79738c20395a424584f8208463c7effe)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:55.687755 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d57ad-f54b-4f2c-a58c-908945e92ab6 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:55.729765 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-1a9d57ad-f54b-4f2c-a58c-908945e92ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79738c20395a424584f8208463c7effe'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:55.741359 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-1a9d57ad-f54b-4f2c-a58c-908945e92ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79738c20395a424584f8208463c7effe'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:55.748111 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-1a9d57ad-f54b-4f2c-a58c-908945e92ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79738c20395a424584f8208463c7effe'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:55.748763 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-1a9d57ad-f54b-4f2c-a58c-908945e92ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79738c20395a424584f8208463c7effe'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:55.755286 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-1a9d57ad-f54b-4f2c-a58c-908945e92ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79738c20395a424584f8208463c7effe'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:55.760913 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 941/1893] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:38:55 2021] DELETE /identity/v3/users/79738c20395a424584f8208463c7effe => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:55.765413 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b424fc-4c6b-41ab-b726-2fb1e115fce1 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:55.765858 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b424fc-4c6b-41ab-b726-2fb1e115fce1 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:55.765993 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b424fc-4c6b-41ab-b726-2fb1e115fce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:55.784032 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-c0b424fc-4c6b-41ab-b726-2fb1e115fce1 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:55.785209 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-c0b424fc-4c6b-41ab-b726-2fb1e115fce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:55.837962 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 953/1894] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:55.848333 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d57ad-f54b-4f2c-a58c-908945e92ab6 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:55.849787 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-1a9d57ad-f54b-4f2c-a58c-908945e92ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:55.913754 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d57ad-f54b-4f2c-a58c-908945e92ab6 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:55.917438 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16cbf7-27c1-4782-9d81-1af1ab5a7162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:55.918070 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16cbf7-27c1-4782-9d81-1af1ab5a7162 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:55.918351 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16cbf7-27c1-4782-9d81-1af1ab5a7162 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:55.918624 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16cbf7-27c1-4782-9d81-1af1ab5a7162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:55.927179 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16cbf7-27c1-4782-9d81-1af1ab5a7162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:55.928619 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16cbf7-27c1-4782-9d81-1af1ab5a7162 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:55.937835 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 942/1895] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:56.234455 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b424fc-4c6b-41ab-b726-2fb1e115fce1 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:56.236299 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-c0b424fc-4c6b-41ab-b726-2fb1e115fce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:56.253257 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b424fc-4c6b-41ab-b726-2fb1e115fce1 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:56.258739 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71b8f8-8551-4a36-9042-a789cb49cd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:56.259792 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71b8f8-8551-4a36-9042-a789cb49cd57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:56.261575 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71b8f8-8551-4a36-9042-a789cb49cd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:56.261881 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71b8f8-8551-4a36-9042-a789cb49cd57 admin admin] PATH_INFO: `/v3/projects/8e856dafef48468b8537dea3b590e9f0` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:56.263659 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71b8f8-8551-4a36-9042-a789cb49cd57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e856dafef48468b8537dea3b590e9f0)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:56.265554 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71b8f8-8551-4a36-9042-a789cb49cd57 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:56.310762 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-9f71b8f8-8551-4a36-9042-a789cb49cd57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e856dafef48468b8537dea3b590e9f0', 'request_id': 'req-9f71b8f8-8551-4a36-9042-a789cb49cd57'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:56.316541 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-9f71b8f8-8551-4a36-9042-a789cb49cd57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e856dafef48468b8537dea3b590e9f0', 'request_id': 'req-9f71b8f8-8551-4a36-9042-a789cb49cd57'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:56.321721 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-9f71b8f8-8551-4a36-9042-a789cb49cd57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e856dafef48468b8537dea3b590e9f0', 'request_id': 'req-9f71b8f8-8551-4a36-9042-a789cb49cd57'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:56.333142 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-9f71b8f8-8551-4a36-9042-a789cb49cd57 admin admin] The token cache is being invalidate because project 8e856dafef48468b8537dea3b590e9f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:38:56.333425 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-9f71b8f8-8551-4a36-9042-a789cb49cd57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:56.334032 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-9f71b8f8-8551-4a36-9042-a789cb49cd57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:56.335641 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 954/1896] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:38:56 2021] DELETE /identity/v3/projects/8e856dafef48468b8537dea3b590e9f0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:56.340406 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16cbf7-27c1-4782-9d81-1af1ab5a7162 service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:56.349787 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16cbf7-27c1-4782-9d81-1af1ab5a7162 service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:56.403489 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905cdba-f997-48cf-af6a-c0eee63f3d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:56.404397 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905cdba-f997-48cf-af6a-c0eee63f3d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:56.404679 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905cdba-f997-48cf-af6a-c0eee63f3d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:56.404956 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905cdba-f997-48cf-af6a-c0eee63f3d9e admin admin] PATH_INFO: `/v3/users/1a0fa1e1f50d482f95c4208c763d49b0` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:56.406142 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905cdba-f997-48cf-af6a-c0eee63f3d9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a0fa1e1f50d482f95c4208c763d49b0)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:56.408106 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905cdba-f997-48cf-af6a-c0eee63f3d9e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:56.451325 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-4905cdba-f997-48cf-af6a-c0eee63f3d9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a0fa1e1f50d482f95c4208c763d49b0'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:56.463868 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-4905cdba-f997-48cf-af6a-c0eee63f3d9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a0fa1e1f50d482f95c4208c763d49b0'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:56.474111 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-4905cdba-f997-48cf-af6a-c0eee63f3d9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a0fa1e1f50d482f95c4208c763d49b0'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:56.474764 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-4905cdba-f997-48cf-af6a-c0eee63f3d9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a0fa1e1f50d482f95c4208c763d49b0'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:56.482867 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-4905cdba-f997-48cf-af6a-c0eee63f3d9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a0fa1e1f50d482f95c4208c763d49b0'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:56.492026 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 943/1897] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:38:56 2021] DELETE /identity/v3/users/1a0fa1e1f50d482f95c4208c763d49b0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:56.812490 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71b8f8-8551-4a36-9042-a789cb49cd57 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:56.813949 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-9f71b8f8-8551-4a36-9042-a789cb49cd57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:56.827046 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71b8f8-8551-4a36-9042-a789cb49cd57 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:56.879370 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020131a8-f97c-4667-8735-8188ed62c4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:56.880220 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020131a8-f97c-4667-8735-8188ed62c4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:56.880503 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020131a8-f97c-4667-8735-8188ed62c4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:56.880773 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020131a8-f97c-4667-8735-8188ed62c4bc admin admin] PATH_INFO: `/v3/projects/786909a435934808a5b0ea03eae36ed2` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:56.882143 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020131a8-f97c-4667-8735-8188ed62c4bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=786909a435934808a5b0ea03eae36ed2)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:56.884158 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020131a8-f97c-4667-8735-8188ed62c4bc admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:56.927320 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-020131a8-f97c-4667-8735-8188ed62c4bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '786909a435934808a5b0ea03eae36ed2', 'request_id': 'req-020131a8-f97c-4667-8735-8188ed62c4bc'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:56.933000 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-020131a8-f97c-4667-8735-8188ed62c4bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '786909a435934808a5b0ea03eae36ed2', 'request_id': 'req-020131a8-f97c-4667-8735-8188ed62c4bc'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:56.938100 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-020131a8-f97c-4667-8735-8188ed62c4bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '786909a435934808a5b0ea03eae36ed2', 'request_id': 'req-020131a8-f97c-4667-8735-8188ed62c4bc'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:56.950019 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-020131a8-f97c-4667-8735-8188ed62c4bc admin admin] The token cache is being invalidate because project 786909a435934808a5b0ea03eae36ed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:38:56.950301 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-020131a8-f97c-4667-8735-8188ed62c4bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:56.950905 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-020131a8-f97c-4667-8735-8188ed62c4bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:38:56.952409 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 955/1898] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:38:56 2021] DELETE /identity/v3/projects/786909a435934808a5b0ea03eae36ed2 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:56.958081 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56e31b-398f-4b26-9a27-f273f7635ff4 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:56.958537 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56e31b-398f-4b26-9a27-f273f7635ff4 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:56.958625 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56e31b-398f-4b26-9a27-f273f7635ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:56.979162 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-8d56e31b-398f-4b26-9a27-f273f7635ff4 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:56.980857 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-8d56e31b-398f-4b26-9a27-f273f7635ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:57.040371 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 944/1899] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:57.048169 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d106e-4e95-45f7-a49c-9caa033dba1b None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:57.048456 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d106e-4e95-45f7-a49c-9caa033dba1b None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:57.048733 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d106e-4e95-45f7-a49c-9caa033dba1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:57.066697 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-a27d106e-4e95-45f7-a49c-9caa033dba1b None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:57.067901 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-a27d106e-4e95-45f7-a49c-9caa033dba1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:57.076133 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 956/1900] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:38:57.080149 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56e31b-398f-4b26-9a27-f273f7635ff4 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:57.089462 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56e31b-398f-4b26-9a27-f273f7635ff4 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:57.094194 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb053bd-32a7-4fe5-9bf8-93e077880a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:57.094827 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb053bd-32a7-4fe5-9bf8-93e077880a6c admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:57.095105 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb053bd-32a7-4fe5-9bf8-93e077880a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:57.095377 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb053bd-32a7-4fe5-9bf8-93e077880a6c admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:57.096154 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb053bd-32a7-4fe5-9bf8-93e077880a6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:38:57.096456 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb053bd-32a7-4fe5-9bf8-93e077880a6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:57.098060 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb053bd-32a7-4fe5-9bf8-93e077880a6c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:57.109204 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 945/1901] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:38:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:38:57.113284 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d106e-4e95-45f7-a49c-9caa033dba1b None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:57.122583 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d106e-4e95-45f7-a49c-9caa033dba1b None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:57.127221 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716a1c4-9742-4dcd-9d64-669828685c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:57.127886 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716a1c4-9742-4dcd-9d64-669828685c55 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:57.128174 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716a1c4-9742-4dcd-9d64-669828685c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:57.128453 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716a1c4-9742-4dcd-9d64-669828685c55 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:57.129161 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716a1c4-9742-4dcd-9d64-669828685c55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:57.131067 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716a1c4-9742-4dcd-9d64-669828685c55 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:57.155615 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 957/1902] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:57 2021] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:38:57.159495 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb053bd-32a7-4fe5-9bf8-93e077880a6c admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:57.169061 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb053bd-32a7-4fe5-9bf8-93e077880a6c admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:57.222827 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0fd33-9c63-4e80-b284-c799478c4dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:57.223497 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0fd33-9c63-4e80-b284-c799478c4dbb admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:57.223818 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0fd33-9c63-4e80-b284-c799478c4dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:57.224096 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0fd33-9c63-4e80-b284-c799478c4dbb admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:57.224783 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0fd33-9c63-4e80-b284-c799478c4dbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:57.226736 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0fd33-9c63-4e80-b284-c799478c4dbb admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:57.253871 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 946/1903] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:57 2021] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:57.257839 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716a1c4-9742-4dcd-9d64-669828685c55 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:57.268665 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716a1c4-9742-4dcd-9d64-669828685c55 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:57.273229 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929ad39-22a6-4a45-afc4-a45ab5d5309e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:57.273902 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929ad39-22a6-4a45-afc4-a45ab5d5309e admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:57.274180 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929ad39-22a6-4a45-afc4-a45ab5d5309e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:57.274454 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929ad39-22a6-4a45-afc4-a45ab5d5309e admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:57.275233 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929ad39-22a6-4a45-afc4-a45ab5d5309e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:57.276854 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929ad39-22a6-4a45-afc4-a45ab5d5309e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:57.287156 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 958/1904] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:57 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:57.290757 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0fd33-9c63-4e80-b284-c799478c4dbb admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:57.302616 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0fd33-9c63-4e80-b284-c799478c4dbb admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:57.307418 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119cf0d-53da-4d81-bcc0-d78600ed9c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:57.308603 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119cf0d-53da-4d81-bcc0-d78600ed9c45 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:57.308885 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119cf0d-53da-4d81-bcc0-d78600ed9c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:57.309160 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119cf0d-53da-4d81-bcc0-d78600ed9c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:57.309896 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119cf0d-53da-4d81-bcc0-d78600ed9c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:57.311487 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119cf0d-53da-4d81-bcc0-d78600ed9c45 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:57.321261 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 947/1905] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:57 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:57.328031 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929ad39-22a6-4a45-afc4-a45ab5d5309e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:57.337714 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929ad39-22a6-4a45-afc4-a45ab5d5309e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:57.342487 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc0a2e-612a-48c2-9879-e08ac57013b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:57.343340 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc0a2e-612a-48c2-9879-e08ac57013b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:57.343619 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc0a2e-612a-48c2-9879-e08ac57013b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:57.343925 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc0a2e-612a-48c2-9879-e08ac57013b0 admin admin] PATH_INFO: `/v3/projects/8478383101734fdfb2ddd16de2208519/users/3f370bdf35784aa6a1188d254bcebb52/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:57.358354 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc0a2e-612a-48c2-9879-e08ac57013b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8478383101734fdfb2ddd16de2208519, user_id=3f370bdf35784aa6a1188d254bcebb52, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:57.361076 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc0a2e-612a-48c2-9879-e08ac57013b0 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:57.374191 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 959/1906] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:57 2021] PUT /identity/v3/projects/8478383101734fdfb2ddd16de2208519/users/3f370bdf35784aa6a1188d254bcebb52/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:57.385254 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0e6d8-a59e-49ac-95f7-cda7634bcf4d None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:57.385542 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0e6d8-a59e-49ac-95f7-cda7634bcf4d None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:57.385817 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0e6d8-a59e-49ac-95f7-cda7634bcf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:57.411059 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-afd0e6d8-a59e-49ac-95f7-cda7634bcf4d None None] MFA Rules not processed for user `3f370bdf35784aa6a1188d254bcebb52`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:57.412304 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-afd0e6d8-a59e-49ac-95f7-cda7634bcf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:57.473760 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 948/1907] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:57 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:57.478167 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc0a2e-612a-48c2-9879-e08ac57013b0 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:57.535887 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc0a2e-612a-48c2-9879-e08ac57013b0 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:57.540494 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fc71f-9d84-4944-8d7c-40d7880681e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:57.541196 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fc71f-9d84-4944-8d7c-40d7880681e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:57.541412 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fc71f-9d84-4944-8d7c-40d7880681e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:57.541685 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fc71f-9d84-4944-8d7c-40d7880681e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:57.542889 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fc71f-9d84-4944-8d7c-40d7880681e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:57.544796 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fc71f-9d84-4944-8d7c-40d7880681e5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:57.569691 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 960/1908] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:57 2021] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:57.573700 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0e6d8-a59e-49ac-95f7-cda7634bcf4d None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:57.583951 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0e6d8-a59e-49ac-95f7-cda7634bcf4d None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:57.637848 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb882669-4354-4bd2-9462-3ecc12c4c15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:57.638518 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb882669-4354-4bd2-9462-3ecc12c4c15b admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:57.638803 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb882669-4354-4bd2-9462-3ecc12c4c15b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:57.639080 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb882669-4354-4bd2-9462-3ecc12c4c15b admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:57.639833 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb882669-4354-4bd2-9462-3ecc12c4c15b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:57.641748 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb882669-4354-4bd2-9462-3ecc12c4c15b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:57.661751 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 949/1909] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:57 2021] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:57.665705 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fc71f-9d84-4944-8d7c-40d7880681e5 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:57.677789 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fc71f-9d84-4944-8d7c-40d7880681e5 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:57.684435 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1628b8-9604-4af6-9078-bff719167c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:57.688203 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1628b8-9604-4af6-9078-bff719167c26 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:57.688203 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1628b8-9604-4af6-9078-bff719167c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:57.688203 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1628b8-9604-4af6-9078-bff719167c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:57.688203 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1628b8-9604-4af6-9078-bff719167c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:57.688203 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1628b8-9604-4af6-9078-bff719167c26 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:57.702528 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 961/1910] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:57 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:57.704098 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb882669-4354-4bd2-9462-3ecc12c4c15b admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:57.714566 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb882669-4354-4bd2-9462-3ecc12c4c15b admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:57.719434 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b6803-b715-4041-8a64-4313e140fe09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:57.720128 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b6803-b715-4041-8a64-4313e140fe09 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:57.720415 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b6803-b715-4041-8a64-4313e140fe09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:57.720812 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b6803-b715-4041-8a64-4313e140fe09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:57.721558 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b6803-b715-4041-8a64-4313e140fe09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:57.723152 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b6803-b715-4041-8a64-4313e140fe09 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:57.733646 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 950/1911] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:57 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:57.737777 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1628b8-9604-4af6-9078-bff719167c26 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:57.747515 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1628b8-9604-4af6-9078-bff719167c26 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:57.752177 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8d639-2aed-49b0-bedb-e54287bc8b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:57.753049 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8d639-2aed-49b0-bedb-e54287bc8b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:57.753328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8d639-2aed-49b0-bedb-e54287bc8b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:57.753609 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8d639-2aed-49b0-bedb-e54287bc8b74 admin admin] PATH_INFO: `/v3/projects/097a8f588f2b483d8f10c16a34f20b52/users/5441d748595943e9854e3acc31086fb3/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:57.767854 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba8d639-2aed-49b0-bedb-e54287bc8b74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=097a8f588f2b483d8f10c16a34f20b52, user_id=5441d748595943e9854e3acc31086fb3, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:57.770509 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba8d639-2aed-49b0-bedb-e54287bc8b74 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:57.783999 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 962/1912] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:57 2021] PUT /identity/v3/projects/097a8f588f2b483d8f10c16a34f20b52/users/5441d748595943e9854e3acc31086fb3/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:57.794301 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac98de5-9649-471e-b3e8-22e09f7cde5b None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:57.794590 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac98de5-9649-471e-b3e8-22e09f7cde5b None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:57.794957 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac98de5-9649-471e-b3e8-22e09f7cde5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:57.821138 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-3ac98de5-9649-471e-b3e8-22e09f7cde5b None None] MFA Rules not processed for user `5441d748595943e9854e3acc31086fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:57.822353 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-3ac98de5-9649-471e-b3e8-22e09f7cde5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:57.883438 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 951/1913] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:57 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:38:57.888464 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8d639-2aed-49b0-bedb-e54287bc8b74 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:57.945849 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8d639-2aed-49b0-bedb-e54287bc8b74 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:57.951082 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f86c6c-9a3a-4a2f-8d3c-831817d07ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:57.951745 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f86c6c-9a3a-4a2f-8d3c-831817d07ffe admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:57.952033 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f86c6c-9a3a-4a2f-8d3c-831817d07ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:57.952313 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f86c6c-9a3a-4a2f-8d3c-831817d07ffe admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:57.953005 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f86c6c-9a3a-4a2f-8d3c-831817d07ffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:57.954896 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f86c6c-9a3a-4a2f-8d3c-831817d07ffe admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:57.980777 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 963/1914] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:38:57 2021] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:57.984774 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac98de5-9649-471e-b3e8-22e09f7cde5b None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:57.995154 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac98de5-9649-471e-b3e8-22e09f7cde5b None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:58.048075 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e348728-4bc8-42a5-be61-4122f5cb26d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:58.048696 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e348728-4bc8-42a5-be61-4122f5cb26d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:58.048984 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e348728-4bc8-42a5-be61-4122f5cb26d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:58.049266 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e348728-4bc8-42a5-be61-4122f5cb26d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:58.049956 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e348728-4bc8-42a5-be61-4122f5cb26d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:58.051893 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e348728-4bc8-42a5-be61-4122f5cb26d7 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:58.071788 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 952/1915] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:38:57 2021] POST /identity/v3/users => generated 299 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:38:58.076176 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f86c6c-9a3a-4a2f-8d3c-831817d07ffe admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:58.087315 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f86c6c-9a3a-4a2f-8d3c-831817d07ffe admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:58.092290 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fbd89-ef45-48da-b88a-676b169fbcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:58.092932 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fbd89-ef45-48da-b88a-676b169fbcc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:58.093210 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fbd89-ef45-48da-b88a-676b169fbcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:58.093482 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fbd89-ef45-48da-b88a-676b169fbcc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:58.094205 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fbd89-ef45-48da-b88a-676b169fbcc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:58.095800 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fbd89-ef45-48da-b88a-676b169fbcc0 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:58.106292 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 964/1916] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:58 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:58.110437 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e348728-4bc8-42a5-be61-4122f5cb26d7 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:58.121069 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e348728-4bc8-42a5-be61-4122f5cb26d7 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:58.125697 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497b810-1158-4542-ac30-e76eaa2aad7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:58.126546 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497b810-1158-4542-ac30-e76eaa2aad7d admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:58.126832 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497b810-1158-4542-ac30-e76eaa2aad7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:58.127113 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497b810-1158-4542-ac30-e76eaa2aad7d admin admin] PATH_INFO: `/v3/projects/5f4c83b02d15498b8e3fd385a4550875/users/490aa4ff7a8d48a3ace9fbfcfb9b1263/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:58.141168 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497b810-1158-4542-ac30-e76eaa2aad7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f4c83b02d15498b8e3fd385a4550875, user_id=490aa4ff7a8d48a3ace9fbfcfb9b1263, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:58.143855 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497b810-1158-4542-ac30-e76eaa2aad7d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:58.156630 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 953/1917] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:58 2021] PUT /identity/v3/projects/5f4c83b02d15498b8e3fd385a4550875/users/490aa4ff7a8d48a3ace9fbfcfb9b1263/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:58.160612 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fbd89-ef45-48da-b88a-676b169fbcc0 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:58.170935 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fbd89-ef45-48da-b88a-676b169fbcc0 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:58.223153 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6747d00-bbb7-4f24-821e-c13ae86be058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:58.223835 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6747d00-bbb7-4f24-821e-c13ae86be058 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:58.224160 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6747d00-bbb7-4f24-821e-c13ae86be058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:58.224443 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6747d00-bbb7-4f24-821e-c13ae86be058 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:58.225165 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6747d00-bbb7-4f24-821e-c13ae86be058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:58.226779 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6747d00-bbb7-4f24-821e-c13ae86be058 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:58.236623 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 965/1918] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:38:58 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:38:58.240928 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497b810-1158-4542-ac30-e76eaa2aad7d admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:58.251902 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497b810-1158-4542-ac30-e76eaa2aad7d admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:58.256659 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ddf6b-281e-4e50-b0c8-228e5218dd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:58.258165 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ddf6b-281e-4e50-b0c8-228e5218dd70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:58.258165 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ddf6b-281e-4e50-b0c8-228e5218dd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:58.258165 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ddf6b-281e-4e50-b0c8-228e5218dd70 admin admin] PATH_INFO: `/v3/projects/5f4c83b02d15498b8e3fd385a4550875/users/490aa4ff7a8d48a3ace9fbfcfb9b1263/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:58.260087 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ddf6b-281e-4e50-b0c8-228e5218dd70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f4c83b02d15498b8e3fd385a4550875, user_id=490aa4ff7a8d48a3ace9fbfcfb9b1263, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:58.262764 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ddf6b-281e-4e50-b0c8-228e5218dd70 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:58.273404 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 954/1919] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:38:58 2021] PUT /identity/v3/projects/5f4c83b02d15498b8e3fd385a4550875/users/490aa4ff7a8d48a3ace9fbfcfb9b1263/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:38:58.284016 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042458fe-5879-4e77-8168-d0144bdf4f3b None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:58.284314 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042458fe-5879-4e77-8168-d0144bdf4f3b None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:58.284597 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042458fe-5879-4e77-8168-d0144bdf4f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:58.310774 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-042458fe-5879-4e77-8168-d0144bdf4f3b None None] MFA Rules not processed for user `490aa4ff7a8d48a3ace9fbfcfb9b1263`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:38:58.311951 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-042458fe-5879-4e77-8168-d0144bdf4f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:58.376720 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 966/1920] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:38:58 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:38:58.386708 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ddf6b-281e-4e50-b0c8-228e5218dd70 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:58.388386 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-a56ddf6b-281e-4e50-b0c8-228e5218dd70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:38:58.441726 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ddf6b-281e-4e50-b0c8-228e5218dd70 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:58.445317 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7c6ca-3725-4880-8b04-99d4445f9ba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:58.445943 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7c6ca-3725-4880-8b04-99d4445f9ba9 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:58.446227 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7c6ca-3725-4880-8b04-99d4445f9ba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:58.446501 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7c6ca-3725-4880-8b04-99d4445f9ba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:58.455601 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7c6ca-3725-4880-8b04-99d4445f9ba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:58.457075 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7c6ca-3725-4880-8b04-99d4445f9ba9 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:58.466917 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 955/1921] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:58 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:38:59.114365 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042458fe-5879-4e77-8168-d0144bdf4f3b None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:38:59.123563 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042458fe-5879-4e77-8168-d0144bdf4f3b None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:38:59.127147 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06679790-ca27-4ad1-9b68-7d7909a6daa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:38:59.127808 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06679790-ca27-4ad1-9b68-7d7909a6daa0 service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:38:59.128093 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06679790-ca27-4ad1-9b68-7d7909a6daa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:38:59.128366 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06679790-ca27-4ad1-9b68-7d7909a6daa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:38:59.182562 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06679790-ca27-4ad1-9b68-7d7909a6daa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:38:59.183984 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06679790-ca27-4ad1-9b68-7d7909a6daa0 service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:38:59.192676 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 967/1922] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:38:59 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:02.787993 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7c6ca-3725-4880-8b04-99d4445f9ba9 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:02.796622 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7c6ca-3725-4880-8b04-99d4445f9ba9 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:02.800346 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12d952-024a-46e0-a0fd-18a3a9638a80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:02.801072 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12d952-024a-46e0-a0fd-18a3a9638a80 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:02.801438 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12d952-024a-46e0-a0fd-18a3a9638a80 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:02.801783 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12d952-024a-46e0-a0fd-18a3a9638a80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:02.803641 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-cd12d952-024a-46e0-a0fd-18a3a9638a80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:02.861540 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12d952-024a-46e0-a0fd-18a3a9638a80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:02.862964 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12d952-024a-46e0-a0fd-18a3a9638a80 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:02.871668 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 956/1923] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:02 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:04.030808 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06679790-ca27-4ad1-9b68-7d7909a6daa0 service cinder] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:04.038972 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06679790-ca27-4ad1-9b68-7d7909a6daa0 service cinder] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:04.043058 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70371cfa-56f5-499b-b749-fc9ec26551ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:04.043695 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70371cfa-56f5-499b-b749-fc9ec26551ad service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:04.043985 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70371cfa-56f5-499b-b749-fc9ec26551ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:04.044255 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70371cfa-56f5-499b-b749-fc9ec26551ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:04.045988 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-70371cfa-56f5-499b-b749-fc9ec26551ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:04.105916 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70371cfa-56f5-499b-b749-fc9ec26551ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:04.107339 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70371cfa-56f5-499b-b749-fc9ec26551ad service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:04.116627 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 968/1924] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:04 2021] GET /identity/v3/auth/tokens => generated 3462 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:11.831037 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12d952-024a-46e0-a0fd-18a3a9638a80 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:11.832479 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-cd12d952-024a-46e0-a0fd-18a3a9638a80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:11.894464 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12d952-024a-46e0-a0fd-18a3a9638a80 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:11.898985 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b2f69-6ad1-4ea7-b8e6-49cf178d3591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:11.899875 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b2f69-6ad1-4ea7-b8e6-49cf178d3591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:11.900330 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b2f69-6ad1-4ea7-b8e6-49cf178d3591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:11.900607 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b2f69-6ad1-4ea7-b8e6-49cf178d3591 admin admin] PATH_INFO: `/v3/users/2ec44c6bb252488aaab66bd1db0ebf7e` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:11.902345 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b2f69-6ad1-4ea7-b8e6-49cf178d3591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ec44c6bb252488aaab66bd1db0ebf7e)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:11.904551 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b2f69-6ad1-4ea7-b8e6-49cf178d3591 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:11.947467 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-cc5b2f69-6ad1-4ea7-b8e6-49cf178d3591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ec44c6bb252488aaab66bd1db0ebf7e'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:11.958928 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-cc5b2f69-6ad1-4ea7-b8e6-49cf178d3591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ec44c6bb252488aaab66bd1db0ebf7e'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:11.966896 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-cc5b2f69-6ad1-4ea7-b8e6-49cf178d3591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ec44c6bb252488aaab66bd1db0ebf7e'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:11.967520 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-cc5b2f69-6ad1-4ea7-b8e6-49cf178d3591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ec44c6bb252488aaab66bd1db0ebf7e'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:11.974169 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-cc5b2f69-6ad1-4ea7-b8e6-49cf178d3591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ec44c6bb252488aaab66bd1db0ebf7e'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:11.979909 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 957/1925] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:11 2021] DELETE /identity/v3/users/2ec44c6bb252488aaab66bd1db0ebf7e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:11.984408 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccc9cd-8f26-4ec1-a2e1-efd21fba0b6a None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:11.984867 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccc9cd-8f26-4ec1-a2e1-efd21fba0b6a None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:11.984956 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccc9cd-8f26-4ec1-a2e1-efd21fba0b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:12.002403 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-0fccc9cd-8f26-4ec1-a2e1-efd21fba0b6a None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:12.003587 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-0fccc9cd-8f26-4ec1-a2e1-efd21fba0b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:12.059735 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 969/1926] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:12.070994 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b2f69-6ad1-4ea7-b8e6-49cf178d3591 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:12.072543 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-cc5b2f69-6ad1-4ea7-b8e6-49cf178d3591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:12.137566 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b2f69-6ad1-4ea7-b8e6-49cf178d3591 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:12.141608 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe84e1-b972-442c-ac33-62972f5ecc05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:12.142122 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe84e1-b972-442c-ac33-62972f5ecc05 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:12.142287 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe84e1-b972-442c-ac33-62972f5ecc05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:12.142567 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe84e1-b972-442c-ac33-62972f5ecc05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:12.153037 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe84e1-b972-442c-ac33-62972f5ecc05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:12.155300 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe84e1-b972-442c-ac33-62972f5ecc05 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:12.167897 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 958/1927] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:12.223415 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccc9cd-8f26-4ec1-a2e1-efd21fba0b6a None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:12.224971 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-0fccc9cd-8f26-4ec1-a2e1-efd21fba0b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:12.246426 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccc9cd-8f26-4ec1-a2e1-efd21fba0b6a None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:12.254745 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca2afe-da48-43d8-b812-b82927caa1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:12.256618 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca2afe-da48-43d8-b812-b82927caa1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:12.257219 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca2afe-da48-43d8-b812-b82927caa1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:12.257673 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca2afe-da48-43d8-b812-b82927caa1a1 admin admin] PATH_INFO: `/v3/users/5442cd922fbd4408964c325ffd52bac4` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:12.259843 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca2afe-da48-43d8-b812-b82927caa1a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5442cd922fbd4408964c325ffd52bac4)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:12.263633 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca2afe-da48-43d8-b812-b82927caa1a1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:12.327563 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-65ca2afe-da48-43d8-b812-b82927caa1a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5442cd922fbd4408964c325ffd52bac4'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:12.356835 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-65ca2afe-da48-43d8-b812-b82927caa1a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5442cd922fbd4408964c325ffd52bac4'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:12.365314 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-65ca2afe-da48-43d8-b812-b82927caa1a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5442cd922fbd4408964c325ffd52bac4'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:12.366076 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-65ca2afe-da48-43d8-b812-b82927caa1a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5442cd922fbd4408964c325ffd52bac4'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:12.373911 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-65ca2afe-da48-43d8-b812-b82927caa1a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5442cd922fbd4408964c325ffd52bac4'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:12.380534 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 970/1928] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:12 2021] DELETE /identity/v3/users/5442cd922fbd4408964c325ffd52bac4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:12.385957 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5403a-6faa-4e7d-83d4-1cf43b31f3f7 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:12.386268 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5403a-6faa-4e7d-83d4-1cf43b31f3f7 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:12.386553 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5403a-6faa-4e7d-83d4-1cf43b31f3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:12.416111 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-9bc5403a-6faa-4e7d-83d4-1cf43b31f3f7 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:12.418129 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-9bc5403a-6faa-4e7d-83d4-1cf43b31f3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:12.495780 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca2afe-da48-43d8-b812-b82927caa1a1 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:12.497174 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-65ca2afe-da48-43d8-b812-b82927caa1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:12.500728 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 959/1929] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:12.512810 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5403a-6faa-4e7d-83d4-1cf43b31f3f7 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:12.514404 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-9bc5403a-6faa-4e7d-83d4-1cf43b31f3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:12.520126 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca2afe-da48-43d8-b812-b82927caa1a1 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:12.529658 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270ccde-318f-45f6-8a1a-e345d1629e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:12.530514 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270ccde-318f-45f6-8a1a-e345d1629e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:12.530807 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270ccde-318f-45f6-8a1a-e345d1629e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:12.531064 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270ccde-318f-45f6-8a1a-e345d1629e97 admin admin] PATH_INFO: `/v3/projects/2402a857bcd04d459005c63b57caa964` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:12.532330 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270ccde-318f-45f6-8a1a-e345d1629e97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2402a857bcd04d459005c63b57caa964)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:12.534378 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270ccde-318f-45f6-8a1a-e345d1629e97 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:12.575137 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5403a-6faa-4e7d-83d4-1cf43b31f3f7 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:12.584833 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-c270ccde-318f-45f6-8a1a-e345d1629e97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2402a857bcd04d459005c63b57caa964', 'request_id': 'req-c270ccde-318f-45f6-8a1a-e345d1629e97'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:12.591570 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-c270ccde-318f-45f6-8a1a-e345d1629e97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2402a857bcd04d459005c63b57caa964', 'request_id': 'req-c270ccde-318f-45f6-8a1a-e345d1629e97'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:12.597165 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-c270ccde-318f-45f6-8a1a-e345d1629e97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2402a857bcd04d459005c63b57caa964', 'request_id': 'req-c270ccde-318f-45f6-8a1a-e345d1629e97'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:12.612396 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-c270ccde-318f-45f6-8a1a-e345d1629e97 admin admin] The token cache is being invalidate because project 2402a857bcd04d459005c63b57caa964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:12.612670 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-c270ccde-318f-45f6-8a1a-e345d1629e97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:12.614077 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-c270ccde-318f-45f6-8a1a-e345d1629e97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:12.619839 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 971/1930] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:12 2021] DELETE /identity/v3/projects/2402a857bcd04d459005c63b57caa964 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:12.622347 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270ccde-318f-45f6-8a1a-e345d1629e97 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:12.624591 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-c270ccde-318f-45f6-8a1a-e345d1629e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:12.630821 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0f829-09f1-412a-b72d-dcf75d9c72fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:12.630979 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0f829-09f1-412a-b72d-dcf75d9c72fa service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:12.635320 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0f829-09f1-412a-b72d-dcf75d9c72fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:12.635707 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0f829-09f1-412a-b72d-dcf75d9c72fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:12.641670 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-85b0f829-09f1-412a-b72d-dcf75d9c72fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:12.705081 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270ccde-318f-45f6-8a1a-e345d1629e97 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:12.710486 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280fc03-4e7e-4510-bf6d-f4be5f3fd44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:12.711399 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280fc03-4e7e-4510-bf6d-f4be5f3fd44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:12.711790 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280fc03-4e7e-4510-bf6d-f4be5f3fd44c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:12.712131 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280fc03-4e7e-4510-bf6d-f4be5f3fd44c admin admin] PATH_INFO: `/v3/users/d5c3310e410142c893df38042732fdda` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:12.713401 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280fc03-4e7e-4510-bf6d-f4be5f3fd44c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5c3310e410142c893df38042732fdda)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:12.716367 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280fc03-4e7e-4510-bf6d-f4be5f3fd44c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:12.724391 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0f829-09f1-412a-b72d-dcf75d9c72fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:12.726017 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0f829-09f1-412a-b72d-dcf75d9c72fa service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:12.738716 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 960/1931] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:12.763820 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-3280fc03-4e7e-4510-bf6d-f4be5f3fd44c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5c3310e410142c893df38042732fdda'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:12.778228 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-3280fc03-4e7e-4510-bf6d-f4be5f3fd44c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5c3310e410142c893df38042732fdda'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:12.786614 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-3280fc03-4e7e-4510-bf6d-f4be5f3fd44c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5c3310e410142c893df38042732fdda'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:12.787375 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-3280fc03-4e7e-4510-bf6d-f4be5f3fd44c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5c3310e410142c893df38042732fdda'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:12.795802 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-3280fc03-4e7e-4510-bf6d-f4be5f3fd44c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5c3310e410142c893df38042732fdda'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:12.803268 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 972/1932] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:12 2021] DELETE /identity/v3/users/d5c3310e410142c893df38042732fdda => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:39:12.857069 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0f829-09f1-412a-b72d-dcf75d9c72fa service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:12.859179 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-85b0f829-09f1-412a-b72d-dcf75d9c72fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:12.937235 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0f829-09f1-412a-b72d-dcf75d9c72fa service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:13.000873 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2308fbd-5d1d-4787-b935-9b5002eb98c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:13.001528 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2308fbd-5d1d-4787-b935-9b5002eb98c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:13.001813 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2308fbd-5d1d-4787-b935-9b5002eb98c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:13.002486 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2308fbd-5d1d-4787-b935-9b5002eb98c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:13.004589 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d2308fbd-5d1d-4787-b935-9b5002eb98c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:13.028424 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280fc03-4e7e-4510-bf6d-f4be5f3fd44c admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:13.030415 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-3280fc03-4e7e-4510-bf6d-f4be5f3fd44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:13.069227 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2308fbd-5d1d-4787-b935-9b5002eb98c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:13.070821 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2308fbd-5d1d-4787-b935-9b5002eb98c9 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:13.081022 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 961/1933] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:12 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:13.107588 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2308fbd-5d1d-4787-b935-9b5002eb98c9 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:13.109345 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d2308fbd-5d1d-4787-b935-9b5002eb98c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:13.115180 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280fc03-4e7e-4510-bf6d-f4be5f3fd44c admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:13.120476 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f033e-c5c3-4a1c-b76b-9267bdccd57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:13.121658 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f033e-c5c3-4a1c-b76b-9267bdccd57a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:13.122013 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f033e-c5c3-4a1c-b76b-9267bdccd57a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:13.122358 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f033e-c5c3-4a1c-b76b-9267bdccd57a admin admin] PATH_INFO: `/v3/projects/7e624a7bd88a43759855549ce696e6b5` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:13.123670 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f033e-c5c3-4a1c-b76b-9267bdccd57a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e624a7bd88a43759855549ce696e6b5)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:13.125612 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2308fbd-5d1d-4787-b935-9b5002eb98c9 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:13.125853 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f033e-c5c3-4a1c-b76b-9267bdccd57a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:13.130659 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324ca1a-40db-4121-bfbc-050a5104eac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:13.131863 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324ca1a-40db-4121-bfbc-050a5104eac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:13.132148 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324ca1a-40db-4121-bfbc-050a5104eac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:13.132423 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324ca1a-40db-4121-bfbc-050a5104eac0 admin admin] PATH_INFO: `/v3/projects/57dfcb9e384c4fa7b7417284da7f6a8b` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:13.133635 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324ca1a-40db-4121-bfbc-050a5104eac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57dfcb9e384c4fa7b7417284da7f6a8b)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:13.136397 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324ca1a-40db-4121-bfbc-050a5104eac0 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:13.176284 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f46f033e-c5c3-4a1c-b76b-9267bdccd57a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e624a7bd88a43759855549ce696e6b5', 'request_id': 'req-f46f033e-c5c3-4a1c-b76b-9267bdccd57a'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:13.182710 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f46f033e-c5c3-4a1c-b76b-9267bdccd57a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e624a7bd88a43759855549ce696e6b5', 'request_id': 'req-f46f033e-c5c3-4a1c-b76b-9267bdccd57a'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:13.185556 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-c324ca1a-40db-4121-bfbc-050a5104eac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57dfcb9e384c4fa7b7417284da7f6a8b', 'request_id': 'req-c324ca1a-40db-4121-bfbc-050a5104eac0'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:13.188410 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f46f033e-c5c3-4a1c-b76b-9267bdccd57a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e624a7bd88a43759855549ce696e6b5', 'request_id': 'req-f46f033e-c5c3-4a1c-b76b-9267bdccd57a'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:13.192952 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-c324ca1a-40db-4121-bfbc-050a5104eac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57dfcb9e384c4fa7b7417284da7f6a8b', 'request_id': 'req-c324ca1a-40db-4121-bfbc-050a5104eac0'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:13.201207 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f46f033e-c5c3-4a1c-b76b-9267bdccd57a admin admin] The token cache is being invalidate because project 7e624a7bd88a43759855549ce696e6b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:13.201386 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-c324ca1a-40db-4121-bfbc-050a5104eac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57dfcb9e384c4fa7b7417284da7f6a8b', 'request_id': 'req-c324ca1a-40db-4121-bfbc-050a5104eac0'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:13.201698 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f46f033e-c5c3-4a1c-b76b-9267bdccd57a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:13.202420 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f46f033e-c5c3-4a1c-b76b-9267bdccd57a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:13.204216 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 973/1934] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:13 2021] DELETE /identity/v3/projects/7e624a7bd88a43759855549ce696e6b5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:13.209493 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f033e-c5c3-4a1c-b76b-9267bdccd57a admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:13.210114 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-f46f033e-c5c3-4a1c-b76b-9267bdccd57a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:13.224333 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-c324ca1a-40db-4121-bfbc-050a5104eac0 admin admin] The token cache is being invalidate because project 57dfcb9e384c4fa7b7417284da7f6a8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:13.224624 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-c324ca1a-40db-4121-bfbc-050a5104eac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:13.225299 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-c324ca1a-40db-4121-bfbc-050a5104eac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:13.226879 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 962/1935] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:13 2021] DELETE /identity/v3/projects/57dfcb9e384c4fa7b7417284da7f6a8b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:39:13.234176 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e489b9c-b2ec-4766-8d71-f04e0fc776ad None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:13.234554 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e489b9c-b2ec-4766-8d71-f04e0fc776ad None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:13.234904 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e489b9c-b2ec-4766-8d71-f04e0fc776ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:13.256345 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-4e489b9c-b2ec-4766-8d71-f04e0fc776ad None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:13.257694 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-4e489b9c-b2ec-4766-8d71-f04e0fc776ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:13.293556 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f033e-c5c3-4a1c-b76b-9267bdccd57a admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:13.327468 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 963/1936] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:39:13.335259 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dad97-0b11-4f39-a113-8dbb2212d13a None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:13.335512 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dad97-0b11-4f39-a113-8dbb2212d13a None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:13.335836 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dad97-0b11-4f39-a113-8dbb2212d13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:13.357466 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa72e6-6335-40a8-9ad5-0baa808bd456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:13.358353 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa72e6-6335-40a8-9ad5-0baa808bd456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:13.358633 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa72e6-6335-40a8-9ad5-0baa808bd456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:13.359011 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa72e6-6335-40a8-9ad5-0baa808bd456 admin admin] PATH_INFO: `/v3/users/c882cff5f8634b7282c0a66f9169785d` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:13.360153 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa72e6-6335-40a8-9ad5-0baa808bd456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c882cff5f8634b7282c0a66f9169785d)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:13.362152 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa72e6-6335-40a8-9ad5-0baa808bd456 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:13.364166 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-733dad97-0b11-4f39-a113-8dbb2212d13a None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:13.365579 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-733dad97-0b11-4f39-a113-8dbb2212d13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:13.374598 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 964/1937] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:39:13.379208 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dad97-0b11-4f39-a113-8dbb2212d13a None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:13.389971 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dad97-0b11-4f39-a113-8dbb2212d13a None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:13.403640 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea672dc-ca3a-4f00-9025-76bdc11e6a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:13.404351 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea672dc-ca3a-4f00-9025-76bdc11e6a11 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:13.404638 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea672dc-ca3a-4f00-9025-76bdc11e6a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:13.404921 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea672dc-ca3a-4f00-9025-76bdc11e6a11 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:13.405666 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea672dc-ca3a-4f00-9025-76bdc11e6a11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:39:13.405993 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea672dc-ca3a-4f00-9025-76bdc11e6a11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:13.407952 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea672dc-ca3a-4f00-9025-76bdc11e6a11 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:13.423618 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 965/1938] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:39:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:39:13.424845 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea672dc-ca3a-4f00-9025-76bdc11e6a11 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:13.432213 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f2fa72e6-6335-40a8-9ad5-0baa808bd456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c882cff5f8634b7282c0a66f9169785d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:13.435806 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea672dc-ca3a-4f00-9025-76bdc11e6a11 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:13.441181 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62066c9b-ef8d-435b-9e0b-ed600ad5c22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:13.441868 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62066c9b-ef8d-435b-9e0b-ed600ad5c22c admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:13.442153 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62066c9b-ef8d-435b-9e0b-ed600ad5c22c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:13.442431 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62066c9b-ef8d-435b-9e0b-ed600ad5c22c admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:13.443133 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62066c9b-ef8d-435b-9e0b-ed600ad5c22c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:13.444354 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f2fa72e6-6335-40a8-9ad5-0baa808bd456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c882cff5f8634b7282c0a66f9169785d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:13.445074 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62066c9b-ef8d-435b-9e0b-ed600ad5c22c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:13.453625 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f2fa72e6-6335-40a8-9ad5-0baa808bd456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c882cff5f8634b7282c0a66f9169785d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:13.454385 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f2fa72e6-6335-40a8-9ad5-0baa808bd456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c882cff5f8634b7282c0a66f9169785d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:13.461970 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f2fa72e6-6335-40a8-9ad5-0baa808bd456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c882cff5f8634b7282c0a66f9169785d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:13.470557 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 974/1939] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:13 2021] DELETE /identity/v3/users/c882cff5f8634b7282c0a66f9169785d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:39:13.479253 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 966/1940] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:39:13 2021] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:39:13.483323 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa72e6-6335-40a8-9ad5-0baa808bd456 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:13.484781 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-f2fa72e6-6335-40a8-9ad5-0baa808bd456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:13.550850 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa72e6-6335-40a8-9ad5-0baa808bd456 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:13.612408 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c31763-b0ee-4a57-a67d-71766b81441c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:13.616165 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c31763-b0ee-4a57-a67d-71766b81441c admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:13.616459 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c31763-b0ee-4a57-a67d-71766b81441c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:13.616741 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c31763-b0ee-4a57-a67d-71766b81441c admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:13.617471 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c31763-b0ee-4a57-a67d-71766b81441c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:13.619397 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c31763-b0ee-4a57-a67d-71766b81441c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:13.647196 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62066c9b-ef8d-435b-9e0b-ed600ad5c22c admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:13.647614 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 975/1941] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:39:13 2021] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:13.657662 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62066c9b-ef8d-435b-9e0b-ed600ad5c22c admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:13.662294 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc98b6-a91d-4650-83c3-fe6e061c6f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:13.662944 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc98b6-a91d-4650-83c3-fe6e061c6f1f admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:13.663223 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc98b6-a91d-4650-83c3-fe6e061c6f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:13.663498 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc98b6-a91d-4650-83c3-fe6e061c6f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:13.664356 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc98b6-a91d-4650-83c3-fe6e061c6f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:13.666261 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc98b6-a91d-4650-83c3-fe6e061c6f1f admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:13.676888 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 967/1942] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:13 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:39:13.680965 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c31763-b0ee-4a57-a67d-71766b81441c admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:13.693094 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c31763-b0ee-4a57-a67d-71766b81441c admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:13.697992 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d454b-40ba-4e86-83f4-c330a15590fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:13.698850 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d454b-40ba-4e86-83f4-c330a15590fd admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:13.699841 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d454b-40ba-4e86-83f4-c330a15590fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:13.700042 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d454b-40ba-4e86-83f4-c330a15590fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:13.700860 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d454b-40ba-4e86-83f4-c330a15590fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:13.711953 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d454b-40ba-4e86-83f4-c330a15590fd admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:13.717124 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 976/1943] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:13 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:13.722030 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc98b6-a91d-4650-83c3-fe6e061c6f1f admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:13.733711 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc98b6-a91d-4650-83c3-fe6e061c6f1f admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:13.739125 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e95847-f75d-4c07-a627-6e9eeb28e53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:13.741738 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e95847-f75d-4c07-a627-6e9eeb28e53a admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:13.741738 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e95847-f75d-4c07-a627-6e9eeb28e53a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:13.741738 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e95847-f75d-4c07-a627-6e9eeb28e53a admin admin] PATH_INFO: `/v3/projects/752566614b4e4c1091719abe4bcc37c8/users/8cb193c90c19452e827a30917592e7ce/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:13.759089 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e95847-f75d-4c07-a627-6e9eeb28e53a admin admin] RBAC: Authorizing `identity:create_grant(project_id=752566614b4e4c1091719abe4bcc37c8, user_id=8cb193c90c19452e827a30917592e7ce, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:13.762441 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e95847-f75d-4c07-a627-6e9eeb28e53a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:13.794390 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 968/1944] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:13 2021] PUT /identity/v3/projects/752566614b4e4c1091719abe4bcc37c8/users/8cb193c90c19452e827a30917592e7ce/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:13.799082 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d454b-40ba-4e86-83f4-c330a15590fd admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:13.801216 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-943d454b-40ba-4e86-83f4-c330a15590fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:13.804046 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f8757-7bec-47d6-92dc-6ee763209430 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:13.804330 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f8757-7bec-47d6-92dc-6ee763209430 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:13.804603 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f8757-7bec-47d6-92dc-6ee763209430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:13.816785 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d454b-40ba-4e86-83f4-c330a15590fd admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:13.845568 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-708f8757-7bec-47d6-92dc-6ee763209430 None None] MFA Rules not processed for user `8cb193c90c19452e827a30917592e7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:13.846754 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-708f8757-7bec-47d6-92dc-6ee763209430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:13.873020 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445cc1d-59a6-430f-bd28-248aab0b84a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:13.873865 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445cc1d-59a6-430f-bd28-248aab0b84a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:13.874152 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445cc1d-59a6-430f-bd28-248aab0b84a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:13.874426 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445cc1d-59a6-430f-bd28-248aab0b84a7 admin admin] PATH_INFO: `/v3/projects/bcac30cfea374f9bbde82c60989732f4` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:13.875611 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445cc1d-59a6-430f-bd28-248aab0b84a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcac30cfea374f9bbde82c60989732f4)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:13.877524 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445cc1d-59a6-430f-bd28-248aab0b84a7 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:13.909936 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 969/1945] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:13 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:13.914306 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f8757-7bec-47d6-92dc-6ee763209430 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:13.922803 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-5445cc1d-59a6-430f-bd28-248aab0b84a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcac30cfea374f9bbde82c60989732f4', 'request_id': 'req-5445cc1d-59a6-430f-bd28-248aab0b84a7'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:13.924379 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f8757-7bec-47d6-92dc-6ee763209430 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:13.929140 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-5445cc1d-59a6-430f-bd28-248aab0b84a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcac30cfea374f9bbde82c60989732f4', 'request_id': 'req-5445cc1d-59a6-430f-bd28-248aab0b84a7'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:13.934692 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-5445cc1d-59a6-430f-bd28-248aab0b84a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcac30cfea374f9bbde82c60989732f4', 'request_id': 'req-5445cc1d-59a6-430f-bd28-248aab0b84a7'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:13.946961 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-5445cc1d-59a6-430f-bd28-248aab0b84a7 admin admin] The token cache is being invalidate because project bcac30cfea374f9bbde82c60989732f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:13.947249 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-5445cc1d-59a6-430f-bd28-248aab0b84a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:13.948425 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-5445cc1d-59a6-430f-bd28-248aab0b84a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:13.949977 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 977/1946] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:13 2021] DELETE /identity/v3/projects/bcac30cfea374f9bbde82c60989732f4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:13.953783 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445cc1d-59a6-430f-bd28-248aab0b84a7 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:13.955204 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-5445cc1d-59a6-430f-bd28-248aab0b84a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:13.979692 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be12b72-d7c8-4892-9c92-2047434513f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:13.980285 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be12b72-d7c8-4892-9c92-2047434513f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:13.980571 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be12b72-d7c8-4892-9c92-2047434513f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:13.980851 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be12b72-d7c8-4892-9c92-2047434513f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:13.981552 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be12b72-d7c8-4892-9c92-2047434513f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:13.983458 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be12b72-d7c8-4892-9c92-2047434513f5 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:14.011479 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 970/1947] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:39:13 2021] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:39:14.012489 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be12b72-d7c8-4892-9c92-2047434513f5 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:14.014152 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-5be12b72-d7c8-4892-9c92-2047434513f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:14.018136 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445cc1d-59a6-430f-bd28-248aab0b84a7 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:14.076035 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00410714-0d5f-4ba7-a2d9-d3bfccd0da2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:14.077161 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00410714-0d5f-4ba7-a2d9-d3bfccd0da2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:14.077257 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00410714-0d5f-4ba7-a2d9-d3bfccd0da2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:14.077515 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00410714-0d5f-4ba7-a2d9-d3bfccd0da2e admin admin] PATH_INFO: `/v3/users/213d87be64f340e7a8ae8ba18d49700b` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:14.078749 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00410714-0d5f-4ba7-a2d9-d3bfccd0da2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=213d87be64f340e7a8ae8ba18d49700b)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:14.079535 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be12b72-d7c8-4892-9c92-2047434513f5 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:14.080754 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00410714-0d5f-4ba7-a2d9-d3bfccd0da2e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:14.084604 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573df6e-48f3-4277-bd74-349c5def3237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:14.085549 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573df6e-48f3-4277-bd74-349c5def3237 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:14.085837 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573df6e-48f3-4277-bd74-349c5def3237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:14.086117 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573df6e-48f3-4277-bd74-349c5def3237 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:14.086836 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573df6e-48f3-4277-bd74-349c5def3237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:14.089434 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573df6e-48f3-4277-bd74-349c5def3237 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:14.109203 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 971/1948] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:39:14 2021] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:14.113000 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573df6e-48f3-4277-bd74-349c5def3237 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:14.122972 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573df6e-48f3-4277-bd74-349c5def3237 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:14.129277 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b6295-03e9-4a4f-9430-4685b6035b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:14.129947 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b6295-03e9-4a4f-9430-4685b6035b02 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:14.130230 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b6295-03e9-4a4f-9430-4685b6035b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:14.130516 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b6295-03e9-4a4f-9430-4685b6035b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:14.131251 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b6295-03e9-4a4f-9430-4685b6035b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:14.132882 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b6295-03e9-4a4f-9430-4685b6035b02 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:14.136945 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-00410714-0d5f-4ba7-a2d9-d3bfccd0da2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '213d87be64f340e7a8ae8ba18d49700b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:14.144581 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 972/1949] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:14 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:14.149258 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b6295-03e9-4a4f-9430-4685b6035b02 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:14.149537 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-00410714-0d5f-4ba7-a2d9-d3bfccd0da2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '213d87be64f340e7a8ae8ba18d49700b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:14.158083 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-00410714-0d5f-4ba7-a2d9-d3bfccd0da2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '213d87be64f340e7a8ae8ba18d49700b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:14.159153 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-00410714-0d5f-4ba7-a2d9-d3bfccd0da2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '213d87be64f340e7a8ae8ba18d49700b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:14.162462 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b6295-03e9-4a4f-9430-4685b6035b02 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:14.165928 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-00410714-0d5f-4ba7-a2d9-d3bfccd0da2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '213d87be64f340e7a8ae8ba18d49700b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:14.168462 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cb309-9f68-4815-b012-9a674d55f8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:14.169887 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cb309-9f68-4815-b012-9a674d55f8d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:14.170322 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cb309-9f68-4815-b012-9a674d55f8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:14.170603 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cb309-9f68-4815-b012-9a674d55f8d5 admin admin] PATH_INFO: `/v3/projects/4f8cd2cfb8474b44848919b7557d33a7/users/fd94e2218e3f4e9182c82451b198062f/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:14.171987 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 978/1950] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:13 2021] DELETE /identity/v3/users/213d87be64f340e7a8ae8ba18d49700b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:39:14.185954 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cb309-9f68-4815-b012-9a674d55f8d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f8cd2cfb8474b44848919b7557d33a7, user_id=fd94e2218e3f4e9182c82451b198062f, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:14.190097 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cb309-9f68-4815-b012-9a674d55f8d5 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:14.207923 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 973/1951] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:14 2021] PUT /identity/v3/projects/4f8cd2cfb8474b44848919b7557d33a7/users/fd94e2218e3f4e9182c82451b198062f/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:39:14.211857 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00410714-0d5f-4ba7-a2d9-d3bfccd0da2e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:14.214374 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-00410714-0d5f-4ba7-a2d9-d3bfccd0da2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:14.309482 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00410714-0d5f-4ba7-a2d9-d3bfccd0da2e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:14.392780 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9ddc0-e414-4652-9b51-0e8df5bdef01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:14.393533 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9ddc0-e414-4652-9b51-0e8df5bdef01 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:14.393811 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9ddc0-e414-4652-9b51-0e8df5bdef01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:14.394084 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9ddc0-e414-4652-9b51-0e8df5bdef01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:14.394826 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9ddc0-e414-4652-9b51-0e8df5bdef01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:14.396446 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9ddc0-e414-4652-9b51-0e8df5bdef01 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:14.406557 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 979/1952] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:14 2021] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:14.410750 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cb309-9f68-4815-b012-9a674d55f8d5 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:14.421419 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cb309-9f68-4815-b012-9a674d55f8d5 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:14.427793 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a56b05-7768-4560-9eb5-b1df0450cfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:14.429076 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a56b05-7768-4560-9eb5-b1df0450cfde admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:14.429485 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a56b05-7768-4560-9eb5-b1df0450cfde admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:14.429877 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a56b05-7768-4560-9eb5-b1df0450cfde admin admin] PATH_INFO: `/v3/projects/4f8cd2cfb8474b44848919b7557d33a7/users/fd94e2218e3f4e9182c82451b198062f/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:14.432966 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a56b05-7768-4560-9eb5-b1df0450cfde admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f8cd2cfb8474b44848919b7557d33a7, user_id=fd94e2218e3f4e9182c82451b198062f, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:14.436476 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a56b05-7768-4560-9eb5-b1df0450cfde admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:14.452698 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 974/1953] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:14 2021] PUT /identity/v3/projects/4f8cd2cfb8474b44848919b7557d33a7/users/fd94e2218e3f4e9182c82451b198062f/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:14.463506 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2cf1e-c888-489d-9a29-611e86ebca0c None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:14.463827 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2cf1e-c888-489d-9a29-611e86ebca0c None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:14.464107 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2cf1e-c888-489d-9a29-611e86ebca0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:14.489589 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a56b05-7768-4560-9eb5-b1df0450cfde admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:14.491602 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-24a56b05-7768-4560-9eb5-b1df0450cfde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:14.493774 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-7df2cf1e-c888-489d-9a29-611e86ebca0c None None] MFA Rules not processed for user `fd94e2218e3f4e9182c82451b198062f`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:14.495645 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-7df2cf1e-c888-489d-9a29-611e86ebca0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:14.561908 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a56b05-7768-4560-9eb5-b1df0450cfde admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:14.566593 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3170c-a407-4e4a-8694-54023ba4bf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:14.567438 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3170c-a407-4e4a-8694-54023ba4bf58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:14.567750 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3170c-a407-4e4a-8694-54023ba4bf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:14.568032 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3170c-a407-4e4a-8694-54023ba4bf58 admin admin] PATH_INFO: `/v3/projects/2d8db9fc8c374e34a9c0ec25b9662cc9` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:14.569217 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3170c-a407-4e4a-8694-54023ba4bf58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d8db9fc8c374e34a9c0ec25b9662cc9)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:14.571408 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3170c-a407-4e4a-8694-54023ba4bf58 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:14.574471 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 980/1954] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:14 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:14.583981 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2cf1e-c888-489d-9a29-611e86ebca0c None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:14.585283 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-7df2cf1e-c888-489d-9a29-611e86ebca0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:14.617613 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-caf3170c-a407-4e4a-8694-54023ba4bf58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d8db9fc8c374e34a9c0ec25b9662cc9', 'request_id': 'req-caf3170c-a407-4e4a-8694-54023ba4bf58'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:14.624060 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-caf3170c-a407-4e4a-8694-54023ba4bf58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d8db9fc8c374e34a9c0ec25b9662cc9', 'request_id': 'req-caf3170c-a407-4e4a-8694-54023ba4bf58'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:14.629275 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-caf3170c-a407-4e4a-8694-54023ba4bf58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d8db9fc8c374e34a9c0ec25b9662cc9', 'request_id': 'req-caf3170c-a407-4e4a-8694-54023ba4bf58'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:14.640001 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2cf1e-c888-489d-9a29-611e86ebca0c None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:14.644248 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-caf3170c-a407-4e4a-8694-54023ba4bf58 admin admin] The token cache is being invalidate because project 2d8db9fc8c374e34a9c0ec25b9662cc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:14.644545 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-caf3170c-a407-4e4a-8694-54023ba4bf58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:14.645223 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-caf3170c-a407-4e4a-8694-54023ba4bf58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:14.646871 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 975/1955] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:14 2021] DELETE /identity/v3/projects/2d8db9fc8c374e34a9c0ec25b9662cc9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:39:14.692314 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50c021-568b-46fb-9875-88d31a1f8a48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:14.692969 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50c021-568b-46fb-9875-88d31a1f8a48 service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:14.693254 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50c021-568b-46fb-9875-88d31a1f8a48 service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:14.693533 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50c021-568b-46fb-9875-88d31a1f8a48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:14.695399 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-8b50c021-568b-46fb-9875-88d31a1f8a48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:14.762350 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50c021-568b-46fb-9875-88d31a1f8a48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:14.763845 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50c021-568b-46fb-9875-88d31a1f8a48 service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:14.774197 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 981/1956] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:14 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:39:16.659621 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89b8c5-fb5d-44fd-90bd-65f0cd78e8f7 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:16.660191 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89b8c5-fb5d-44fd-90bd-65f0cd78e8f7 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:16.660191 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89b8c5-fb5d-44fd-90bd-65f0cd78e8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:16.679021 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-1c89b8c5-fb5d-44fd-90bd-65f0cd78e8f7 None None] MFA Rules not processed for user `f1f3db9250cc4edbacb392d5d0d18e08`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:16.680199 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-1c89b8c5-fb5d-44fd-90bd-65f0cd78e8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:16.732970 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 976/1957] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:16 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:17.997219 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50c021-568b-46fb-9875-88d31a1f8a48 service cinder] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:17.998668 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-8b50c021-568b-46fb-9875-88d31a1f8a48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:18.062385 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50c021-568b-46fb-9875-88d31a1f8a48 service cinder] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:18.067048 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f11e69-2510-4dc6-bad7-f317168bd547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:18.067954 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f11e69-2510-4dc6-bad7-f317168bd547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:18.068246 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f11e69-2510-4dc6-bad7-f317168bd547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:18.068524 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f11e69-2510-4dc6-bad7-f317168bd547 admin admin] PATH_INFO: `/v3/users/3f370bdf35784aa6a1188d254bcebb52` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:18.069731 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f11e69-2510-4dc6-bad7-f317168bd547 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f370bdf35784aa6a1188d254bcebb52)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:18.071630 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f11e69-2510-4dc6-bad7-f317168bd547 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:18.123896 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-73f11e69-2510-4dc6-bad7-f317168bd547 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f370bdf35784aa6a1188d254bcebb52'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:18.138887 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-73f11e69-2510-4dc6-bad7-f317168bd547 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f370bdf35784aa6a1188d254bcebb52'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:18.146034 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-73f11e69-2510-4dc6-bad7-f317168bd547 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f370bdf35784aa6a1188d254bcebb52'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:18.146727 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-73f11e69-2510-4dc6-bad7-f317168bd547 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f370bdf35784aa6a1188d254bcebb52'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:18.153999 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-73f11e69-2510-4dc6-bad7-f317168bd547 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f370bdf35784aa6a1188d254bcebb52'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:18.159860 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 982/1958] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:17 2021] DELETE /identity/v3/users/3f370bdf35784aa6a1188d254bcebb52 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:18.164482 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8eb964-f0e8-4c6c-b824-1646d2eeb253 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:18.164951 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8eb964-f0e8-4c6c-b824-1646d2eeb253 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:18.165048 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8eb964-f0e8-4c6c-b824-1646d2eeb253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:18.185100 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-4a8eb964-f0e8-4c6c-b824-1646d2eeb253 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:18.187336 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-4a8eb964-f0e8-4c6c-b824-1646d2eeb253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:18.255428 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 977/1959] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:18.265851 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f11e69-2510-4dc6-bad7-f317168bd547 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:18.267223 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-73f11e69-2510-4dc6-bad7-f317168bd547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:18.322392 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f11e69-2510-4dc6-bad7-f317168bd547 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:18.326643 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9922b-5b12-462c-996d-c4007e8537a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:18.327282 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9922b-5b12-462c-996d-c4007e8537a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:18.327568 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9922b-5b12-462c-996d-c4007e8537a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:18.327875 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9922b-5b12-462c-996d-c4007e8537a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:18.336563 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9922b-5b12-462c-996d-c4007e8537a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:18.337991 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9922b-5b12-462c-996d-c4007e8537a2 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:18.347523 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 983/1960] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:18.630951 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8eb964-f0e8-4c6c-b824-1646d2eeb253 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:18.632363 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-4a8eb964-f0e8-4c6c-b824-1646d2eeb253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:18.644073 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8eb964-f0e8-4c6c-b824-1646d2eeb253 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:18.648567 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b346c-8035-4d25-ac9b-677282b04562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:18.649419 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b346c-8035-4d25-ac9b-677282b04562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:18.649711 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b346c-8035-4d25-ac9b-677282b04562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:18.649967 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b346c-8035-4d25-ac9b-677282b04562 admin admin] PATH_INFO: `/v3/projects/8478383101734fdfb2ddd16de2208519` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:18.651206 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b346c-8035-4d25-ac9b-677282b04562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8478383101734fdfb2ddd16de2208519)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:18.653154 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b346c-8035-4d25-ac9b-677282b04562 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:18.698078 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a82b346c-8035-4d25-ac9b-677282b04562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8478383101734fdfb2ddd16de2208519', 'request_id': 'req-a82b346c-8035-4d25-ac9b-677282b04562'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:18.704526 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a82b346c-8035-4d25-ac9b-677282b04562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8478383101734fdfb2ddd16de2208519', 'request_id': 'req-a82b346c-8035-4d25-ac9b-677282b04562'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:18.709802 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a82b346c-8035-4d25-ac9b-677282b04562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8478383101734fdfb2ddd16de2208519', 'request_id': 'req-a82b346c-8035-4d25-ac9b-677282b04562'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:18.722079 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a82b346c-8035-4d25-ac9b-677282b04562 admin admin] The token cache is being invalidate because project 8478383101734fdfb2ddd16de2208519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:18.722365 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a82b346c-8035-4d25-ac9b-677282b04562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:18.722982 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a82b346c-8035-4d25-ac9b-677282b04562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:18.724539 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 978/1961] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:18 2021] DELETE /identity/v3/projects/8478383101734fdfb2ddd16de2208519 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:18.728454 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9922b-5b12-462c-996d-c4007e8537a2 service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:18.738333 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9922b-5b12-462c-996d-c4007e8537a2 service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:18.790403 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dafb87-ddc0-41b5-be57-0fca3e209296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:18.791245 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dafb87-ddc0-41b5-be57-0fca3e209296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:18.791520 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dafb87-ddc0-41b5-be57-0fca3e209296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:18.792399 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dafb87-ddc0-41b5-be57-0fca3e209296 admin admin] PATH_INFO: `/v3/users/5441d748595943e9854e3acc31086fb3` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:18.793577 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dafb87-ddc0-41b5-be57-0fca3e209296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5441d748595943e9854e3acc31086fb3)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:18.795485 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dafb87-ddc0-41b5-be57-0fca3e209296 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:18.837355 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f6dafb87-ddc0-41b5-be57-0fca3e209296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5441d748595943e9854e3acc31086fb3'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:18.849237 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f6dafb87-ddc0-41b5-be57-0fca3e209296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5441d748595943e9854e3acc31086fb3'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:18.856197 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f6dafb87-ddc0-41b5-be57-0fca3e209296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5441d748595943e9854e3acc31086fb3'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:18.856782 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f6dafb87-ddc0-41b5-be57-0fca3e209296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5441d748595943e9854e3acc31086fb3'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:18.863264 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f6dafb87-ddc0-41b5-be57-0fca3e209296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5441d748595943e9854e3acc31086fb3'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:18.868821 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 984/1962] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:18 2021] DELETE /identity/v3/users/5441d748595943e9854e3acc31086fb3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:19.129191 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b346c-8035-4d25-ac9b-677282b04562 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:19.130753 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-a82b346c-8035-4d25-ac9b-677282b04562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:19.145795 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b346c-8035-4d25-ac9b-677282b04562 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:19.201816 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5958a2-bade-4725-8e8c-185ce7fc0378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:19.202669 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5958a2-bade-4725-8e8c-185ce7fc0378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:19.202949 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5958a2-bade-4725-8e8c-185ce7fc0378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:19.203223 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5958a2-bade-4725-8e8c-185ce7fc0378 admin admin] PATH_INFO: `/v3/projects/097a8f588f2b483d8f10c16a34f20b52` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:19.204436 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5958a2-bade-4725-8e8c-185ce7fc0378 admin admin] RBAC: Authorizing `identity:delete_project(project_id=097a8f588f2b483d8f10c16a34f20b52)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:19.206327 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5958a2-bade-4725-8e8c-185ce7fc0378 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:19.256835 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7f5958a2-bade-4725-8e8c-185ce7fc0378 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '097a8f588f2b483d8f10c16a34f20b52', 'request_id': 'req-7f5958a2-bade-4725-8e8c-185ce7fc0378'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:19.263280 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7f5958a2-bade-4725-8e8c-185ce7fc0378 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '097a8f588f2b483d8f10c16a34f20b52', 'request_id': 'req-7f5958a2-bade-4725-8e8c-185ce7fc0378'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:19.268527 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7f5958a2-bade-4725-8e8c-185ce7fc0378 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '097a8f588f2b483d8f10c16a34f20b52', 'request_id': 'req-7f5958a2-bade-4725-8e8c-185ce7fc0378'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:19.280860 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7f5958a2-bade-4725-8e8c-185ce7fc0378 admin admin] The token cache is being invalidate because project 097a8f588f2b483d8f10c16a34f20b52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:19.281145 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7f5958a2-bade-4725-8e8c-185ce7fc0378 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:19.281774 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7f5958a2-bade-4725-8e8c-185ce7fc0378 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:19.283307 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 979/1963] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:19 2021] DELETE /identity/v3/projects/097a8f588f2b483d8f10c16a34f20b52 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:19.287201 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dafb87-ddc0-41b5-be57-0fca3e209296 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:19.288662 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-f6dafb87-ddc0-41b5-be57-0fca3e209296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:19.301503 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dafb87-ddc0-41b5-be57-0fca3e209296 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:19.354332 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35391c13-51f4-4969-84e3-bb3ba6280fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:19.355179 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35391c13-51f4-4969-84e3-bb3ba6280fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:19.355457 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35391c13-51f4-4969-84e3-bb3ba6280fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:19.355756 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35391c13-51f4-4969-84e3-bb3ba6280fe9 admin admin] PATH_INFO: `/v3/users/490aa4ff7a8d48a3ace9fbfcfb9b1263` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:19.356948 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35391c13-51f4-4969-84e3-bb3ba6280fe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=490aa4ff7a8d48a3ace9fbfcfb9b1263)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:19.358850 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35391c13-51f4-4969-84e3-bb3ba6280fe9 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:19.401628 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-35391c13-51f4-4969-84e3-bb3ba6280fe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490aa4ff7a8d48a3ace9fbfcfb9b1263'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:19.412737 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-35391c13-51f4-4969-84e3-bb3ba6280fe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490aa4ff7a8d48a3ace9fbfcfb9b1263'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:19.419633 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-35391c13-51f4-4969-84e3-bb3ba6280fe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490aa4ff7a8d48a3ace9fbfcfb9b1263'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:19.420260 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-35391c13-51f4-4969-84e3-bb3ba6280fe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490aa4ff7a8d48a3ace9fbfcfb9b1263'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:19.427364 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-35391c13-51f4-4969-84e3-bb3ba6280fe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490aa4ff7a8d48a3ace9fbfcfb9b1263'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:19.433117 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 985/1964] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:19 2021] DELETE /identity/v3/users/490aa4ff7a8d48a3ace9fbfcfb9b1263 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:19.720344 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5958a2-bade-4725-8e8c-185ce7fc0378 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:19.721845 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7f5958a2-bade-4725-8e8c-185ce7fc0378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:19.734725 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5958a2-bade-4725-8e8c-185ce7fc0378 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:19.788952 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf0727-22d0-4b1f-a3ff-404b13943e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:19.789801 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf0727-22d0-4b1f-a3ff-404b13943e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:19.790081 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf0727-22d0-4b1f-a3ff-404b13943e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:19.790382 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf0727-22d0-4b1f-a3ff-404b13943e61 admin admin] PATH_INFO: `/v3/projects/5f4c83b02d15498b8e3fd385a4550875` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:19.792142 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf0727-22d0-4b1f-a3ff-404b13943e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f4c83b02d15498b8e3fd385a4550875)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:19.794039 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf0727-22d0-4b1f-a3ff-404b13943e61 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:19.836957 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-feaf0727-22d0-4b1f-a3ff-404b13943e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f4c83b02d15498b8e3fd385a4550875', 'request_id': 'req-feaf0727-22d0-4b1f-a3ff-404b13943e61'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:19.843491 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-feaf0727-22d0-4b1f-a3ff-404b13943e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f4c83b02d15498b8e3fd385a4550875', 'request_id': 'req-feaf0727-22d0-4b1f-a3ff-404b13943e61'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:19.848777 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-feaf0727-22d0-4b1f-a3ff-404b13943e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f4c83b02d15498b8e3fd385a4550875', 'request_id': 'req-feaf0727-22d0-4b1f-a3ff-404b13943e61'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:19.860707 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-feaf0727-22d0-4b1f-a3ff-404b13943e61 admin admin] The token cache is being invalidate because project 5f4c83b02d15498b8e3fd385a4550875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:19.860989 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-feaf0727-22d0-4b1f-a3ff-404b13943e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:19.861635 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-feaf0727-22d0-4b1f-a3ff-404b13943e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:19.863134 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 980/1965] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:19 2021] DELETE /identity/v3/projects/5f4c83b02d15498b8e3fd385a4550875 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:19.871353 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b1ef0-ed4e-4918-9a41-7a3bc7a9df40 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:19.871641 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b1ef0-ed4e-4918-9a41-7a3bc7a9df40 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:19.871949 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b1ef0-ed4e-4918-9a41-7a3bc7a9df40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:19.889948 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-b69b1ef0-ed4e-4918-9a41-7a3bc7a9df40 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:19.891170 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-b69b1ef0-ed4e-4918-9a41-7a3bc7a9df40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:19.946369 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 986/1966] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:19.955709 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb6e09-737c-4f9e-a692-0659ad38bfe9 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:19.956015 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb6e09-737c-4f9e-a692-0659ad38bfe9 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:19.956299 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb6e09-737c-4f9e-a692-0659ad38bfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:19.974735 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-c6fb6e09-737c-4f9e-a692-0659ad38bfe9 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:19.975974 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c6fb6e09-737c-4f9e-a692-0659ad38bfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:19.983995 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 981/1967] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:19.988359 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b1ef0-ed4e-4918-9a41-7a3bc7a9df40 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:19.997656 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b1ef0-ed4e-4918-9a41-7a3bc7a9df40 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:20.002135 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd612d-b5e9-4738-8e8a-19c22f3dcee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:20.002769 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd612d-b5e9-4738-8e8a-19c22f3dcee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:20.003076 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd612d-b5e9-4738-8e8a-19c22f3dcee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:20.003348 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd612d-b5e9-4738-8e8a-19c22f3dcee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:20.004171 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd612d-b5e9-4738-8e8a-19c22f3dcee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:39:20.004473 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd612d-b5e9-4738-8e8a-19c22f3dcee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:20.006033 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd612d-b5e9-4738-8e8a-19c22f3dcee5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:20.017555 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 987/1968] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:39:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:39:20.021677 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb6e09-737c-4f9e-a692-0659ad38bfe9 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:20.031129 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb6e09-737c-4f9e-a692-0659ad38bfe9 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:20.035765 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2e2b1-cfb6-40f4-acd5-8440dfb9ec86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:20.036399 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2e2b1-cfb6-40f4-acd5-8440dfb9ec86 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:20.036682 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2e2b1-cfb6-40f4-acd5-8440dfb9ec86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:20.036956 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2e2b1-cfb6-40f4-acd5-8440dfb9ec86 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:20.037643 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2e2b1-cfb6-40f4-acd5-8440dfb9ec86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:20.039537 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2e2b1-cfb6-40f4-acd5-8440dfb9ec86 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:20.063528 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 982/1969] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:39:20 2021] POST /identity/v3/projects => generated 383 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:20.067283 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd612d-b5e9-4738-8e8a-19c22f3dcee5 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:20.077360 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd612d-b5e9-4738-8e8a-19c22f3dcee5 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:20.129431 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bf3a1-edac-46bb-836e-b4f202161160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:20.130110 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bf3a1-edac-46bb-836e-b4f202161160 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:20.130346 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bf3a1-edac-46bb-836e-b4f202161160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:20.130616 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bf3a1-edac-46bb-836e-b4f202161160 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:20.131302 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bf3a1-edac-46bb-836e-b4f202161160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:20.134276 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bf3a1-edac-46bb-836e-b4f202161160 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:20.154866 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 988/1970] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:39:20 2021] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:20.158961 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2e2b1-cfb6-40f4-acd5-8440dfb9ec86 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:20.168859 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2e2b1-cfb6-40f4-acd5-8440dfb9ec86 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:20.173424 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3091e0b-5d1f-4fd2-99c2-d9226bf4c664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:20.174071 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3091e0b-5d1f-4fd2-99c2-d9226bf4c664 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:20.174354 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3091e0b-5d1f-4fd2-99c2-d9226bf4c664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:20.174628 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3091e0b-5d1f-4fd2-99c2-d9226bf4c664 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:20.175356 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3091e0b-5d1f-4fd2-99c2-d9226bf4c664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:20.176985 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3091e0b-5d1f-4fd2-99c2-d9226bf4c664 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:20.186913 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 983/1971] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:20 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:39:20.190638 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bf3a1-edac-46bb-836e-b4f202161160 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:20.200945 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bf3a1-edac-46bb-836e-b4f202161160 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:20.205520 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feffa65-2dfe-4343-b8db-963742ab4804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:20.206158 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feffa65-2dfe-4343-b8db-963742ab4804 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:20.206441 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feffa65-2dfe-4343-b8db-963742ab4804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:20.206717 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feffa65-2dfe-4343-b8db-963742ab4804 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:20.207447 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feffa65-2dfe-4343-b8db-963742ab4804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:20.209054 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feffa65-2dfe-4343-b8db-963742ab4804 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:20.219322 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 989/1972] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:20 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:20.223200 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3091e0b-5d1f-4fd2-99c2-d9226bf4c664 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:20.232976 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3091e0b-5d1f-4fd2-99c2-d9226bf4c664 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:20.237611 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960e6e8-4df6-418a-b37d-6770e4ff6e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:20.238533 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960e6e8-4df6-418a-b37d-6770e4ff6e9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:20.238772 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960e6e8-4df6-418a-b37d-6770e4ff6e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:20.239026 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960e6e8-4df6-418a-b37d-6770e4ff6e9b admin admin] PATH_INFO: `/v3/projects/6fb2d1c50f634622a80cef8bfd9e2589/users/178fd2bbb4c84fcfa7e1af03bc797f94/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:20.254643 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960e6e8-4df6-418a-b37d-6770e4ff6e9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb2d1c50f634622a80cef8bfd9e2589, user_id=178fd2bbb4c84fcfa7e1af03bc797f94, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:20.257759 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960e6e8-4df6-418a-b37d-6770e4ff6e9b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:20.272824 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 984/1973] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:20 2021] PUT /identity/v3/projects/6fb2d1c50f634622a80cef8bfd9e2589/users/178fd2bbb4c84fcfa7e1af03bc797f94/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:39:20.284045 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b1ea2-d2a5-4df0-978b-54f926771e45 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:20.284336 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b1ea2-d2a5-4df0-978b-54f926771e45 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:20.284615 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b1ea2-d2a5-4df0-978b-54f926771e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:20.310364 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-d95b1ea2-d2a5-4df0-978b-54f926771e45 None None] MFA Rules not processed for user `178fd2bbb4c84fcfa7e1af03bc797f94`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:20.311576 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-d95b1ea2-d2a5-4df0-978b-54f926771e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:20.376503 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 990/1974] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:20 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:20.388422 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960e6e8-4df6-418a-b37d-6770e4ff6e9b admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:20.390116 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-9960e6e8-4df6-418a-b37d-6770e4ff6e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:20.446355 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960e6e8-4df6-418a-b37d-6770e4ff6e9b admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:20.450658 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029df38-f8f9-40ce-9e2a-ec87bc4b950c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:20.451315 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029df38-f8f9-40ce-9e2a-ec87bc4b950c service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:20.451623 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029df38-f8f9-40ce-9e2a-ec87bc4b950c service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:20.452019 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029df38-f8f9-40ce-9e2a-ec87bc4b950c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:20.460219 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029df38-f8f9-40ce-9e2a-ec87bc4b950c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:20.461731 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029df38-f8f9-40ce-9e2a-ec87bc4b950c service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:20.470747 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 985/1975] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:20 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:26.515032 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b1ea2-d2a5-4df0-978b-54f926771e45 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:26.526760 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b1ea2-d2a5-4df0-978b-54f926771e45 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:26.529906 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976637fe-43b8-402d-a7ea-267cd198feff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:26.530577 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976637fe-43b8-402d-a7ea-267cd198feff service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:26.530854 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976637fe-43b8-402d-a7ea-267cd198feff service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:26.531152 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976637fe-43b8-402d-a7ea-267cd198feff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:26.532970 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-976637fe-43b8-402d-a7ea-267cd198feff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:26.556680 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029df38-f8f9-40ce-9e2a-ec87bc4b950c service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:26.558154 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e029df38-f8f9-40ce-9e2a-ec87bc4b950c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:26.596721 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976637fe-43b8-402d-a7ea-267cd198feff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:26.598226 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976637fe-43b8-402d-a7ea-267cd198feff service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:26.607592 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 991/1976] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:26 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:26.621608 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029df38-f8f9-40ce-9e2a-ec87bc4b950c service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:26.627868 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603d605-a5f6-4669-8185-7916cbdd122c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:26.628846 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603d605-a5f6-4669-8185-7916cbdd122c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:26.629137 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603d605-a5f6-4669-8185-7916cbdd122c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:26.629676 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603d605-a5f6-4669-8185-7916cbdd122c admin admin] PATH_INFO: `/v3/users/00669c5844834cbba4ffce6926ebef32` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:26.630932 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603d605-a5f6-4669-8185-7916cbdd122c admin admin] RBAC: Authorizing `identity:delete_user(user_id=00669c5844834cbba4ffce6926ebef32)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:26.632888 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603d605-a5f6-4669-8185-7916cbdd122c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:26.684996 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-4603d605-a5f6-4669-8185-7916cbdd122c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00669c5844834cbba4ffce6926ebef32'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:26.696866 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-4603d605-a5f6-4669-8185-7916cbdd122c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00669c5844834cbba4ffce6926ebef32'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:26.705507 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-4603d605-a5f6-4669-8185-7916cbdd122c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00669c5844834cbba4ffce6926ebef32'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:26.706243 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-4603d605-a5f6-4669-8185-7916cbdd122c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00669c5844834cbba4ffce6926ebef32'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:26.713910 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-4603d605-a5f6-4669-8185-7916cbdd122c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00669c5844834cbba4ffce6926ebef32'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:26.720360 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 986/1977] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:26 2021] DELETE /identity/v3/users/00669c5844834cbba4ffce6926ebef32 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:39:26.725202 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dfc20-1a5a-4afd-a229-a2c974ebf5e7 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:26.725635 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dfc20-1a5a-4afd-a229-a2c974ebf5e7 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:26.726256 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dfc20-1a5a-4afd-a229-a2c974ebf5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:26.746161 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-856dfc20-1a5a-4afd-a229-a2c974ebf5e7 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:26.747470 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-856dfc20-1a5a-4afd-a229-a2c974ebf5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:26.825174 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 992/1978] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:26.836345 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603d605-a5f6-4669-8185-7916cbdd122c admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:26.837834 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-4603d605-a5f6-4669-8185-7916cbdd122c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:26.899436 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603d605-a5f6-4669-8185-7916cbdd122c admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:26.904143 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e1677-bd1a-4f1d-8ee5-45df0b3d5fd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:26.904783 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e1677-bd1a-4f1d-8ee5-45df0b3d5fd0 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:26.905069 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e1677-bd1a-4f1d-8ee5-45df0b3d5fd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:26.905345 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e1677-bd1a-4f1d-8ee5-45df0b3d5fd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:26.914404 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e1677-bd1a-4f1d-8ee5-45df0b3d5fd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:26.916221 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e1677-bd1a-4f1d-8ee5-45df0b3d5fd0 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:26.925540 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 987/1979] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:27.175334 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856dfc20-1a5a-4afd-a229-a2c974ebf5e7 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:27.176962 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-856dfc20-1a5a-4afd-a229-a2c974ebf5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:27.189283 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856dfc20-1a5a-4afd-a229-a2c974ebf5e7 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:27.193865 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cecda-fadf-4355-9825-170d36909879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:27.194712 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cecda-fadf-4355-9825-170d36909879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:27.194992 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cecda-fadf-4355-9825-170d36909879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:27.195273 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cecda-fadf-4355-9825-170d36909879 admin admin] PATH_INFO: `/v3/projects/68d1b0ef7df5434bbbbfc7acc5453114` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:27.196511 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cecda-fadf-4355-9825-170d36909879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68d1b0ef7df5434bbbbfc7acc5453114)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:27.199011 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cecda-fadf-4355-9825-170d36909879 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:27.362951 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-0b8cecda-fadf-4355-9825-170d36909879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68d1b0ef7df5434bbbbfc7acc5453114', 'request_id': 'req-0b8cecda-fadf-4355-9825-170d36909879'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:27.368902 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-0b8cecda-fadf-4355-9825-170d36909879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68d1b0ef7df5434bbbbfc7acc5453114', 'request_id': 'req-0b8cecda-fadf-4355-9825-170d36909879'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:27.374571 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-0b8cecda-fadf-4355-9825-170d36909879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68d1b0ef7df5434bbbbfc7acc5453114', 'request_id': 'req-0b8cecda-fadf-4355-9825-170d36909879'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:27.386157 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-0b8cecda-fadf-4355-9825-170d36909879 admin admin] The token cache is being invalidate because project 68d1b0ef7df5434bbbbfc7acc5453114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:27.386440 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-0b8cecda-fadf-4355-9825-170d36909879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:27.387047 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-0b8cecda-fadf-4355-9825-170d36909879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:27.388579 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 993/1980] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:27 2021] DELETE /identity/v3/projects/68d1b0ef7df5434bbbbfc7acc5453114 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:27.392644 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e1677-bd1a-4f1d-8ee5-45df0b3d5fd0 service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:27.402142 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e1677-bd1a-4f1d-8ee5-45df0b3d5fd0 service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:27.456957 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93b7c2-a1c0-44ad-acba-2df844a822bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:27.457814 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93b7c2-a1c0-44ad-acba-2df844a822bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:27.458096 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93b7c2-a1c0-44ad-acba-2df844a822bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:27.458370 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93b7c2-a1c0-44ad-acba-2df844a822bf admin admin] PATH_INFO: `/v3/users/a94b66cb08f54c7084c322b57698d96c` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:27.459556 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93b7c2-a1c0-44ad-acba-2df844a822bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a94b66cb08f54c7084c322b57698d96c)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:27.461506 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93b7c2-a1c0-44ad-acba-2df844a822bf admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:27.506962 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-da93b7c2-a1c0-44ad-acba-2df844a822bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a94b66cb08f54c7084c322b57698d96c'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:27.518682 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-da93b7c2-a1c0-44ad-acba-2df844a822bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a94b66cb08f54c7084c322b57698d96c'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:27.525957 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-da93b7c2-a1c0-44ad-acba-2df844a822bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a94b66cb08f54c7084c322b57698d96c'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:27.526577 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-da93b7c2-a1c0-44ad-acba-2df844a822bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a94b66cb08f54c7084c322b57698d96c'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:27.533188 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-da93b7c2-a1c0-44ad-acba-2df844a822bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a94b66cb08f54c7084c322b57698d96c'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:27.539063 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 988/1981] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:27 2021] DELETE /identity/v3/users/a94b66cb08f54c7084c322b57698d96c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:27.808613 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cecda-fadf-4355-9825-170d36909879 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:27.810193 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-0b8cecda-fadf-4355-9825-170d36909879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:27.831222 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cecda-fadf-4355-9825-170d36909879 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:27.888336 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d2aca-6e11-4807-a123-51a31551a82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:27.889109 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d2aca-6e11-4807-a123-51a31551a82f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:27.889386 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d2aca-6e11-4807-a123-51a31551a82f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:27.889652 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d2aca-6e11-4807-a123-51a31551a82f admin admin] PATH_INFO: `/v3/projects/247cb17503294fb2b7567b7bcf079f63` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:27.890830 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d2aca-6e11-4807-a123-51a31551a82f admin admin] RBAC: Authorizing `identity:delete_project(project_id=247cb17503294fb2b7567b7bcf079f63)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:27.892776 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d2aca-6e11-4807-a123-51a31551a82f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:27.957550 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-939d2aca-6e11-4807-a123-51a31551a82f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '247cb17503294fb2b7567b7bcf079f63', 'request_id': 'req-939d2aca-6e11-4807-a123-51a31551a82f'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:27.963967 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-939d2aca-6e11-4807-a123-51a31551a82f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '247cb17503294fb2b7567b7bcf079f63', 'request_id': 'req-939d2aca-6e11-4807-a123-51a31551a82f'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:27.969351 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-939d2aca-6e11-4807-a123-51a31551a82f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '247cb17503294fb2b7567b7bcf079f63', 'request_id': 'req-939d2aca-6e11-4807-a123-51a31551a82f'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:27.981684 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-939d2aca-6e11-4807-a123-51a31551a82f admin admin] The token cache is being invalidate because project 247cb17503294fb2b7567b7bcf079f63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:27.981969 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-939d2aca-6e11-4807-a123-51a31551a82f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:27.982586 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-939d2aca-6e11-4807-a123-51a31551a82f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:27.984120 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 994/1982] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:27 2021] DELETE /identity/v3/projects/247cb17503294fb2b7567b7bcf079f63 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:27.990332 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aec222-43d5-4818-8c8b-2452065bce1a None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:27.990817 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aec222-43d5-4818-8c8b-2452065bce1a None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:27.990908 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aec222-43d5-4818-8c8b-2452065bce1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:28.008149 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-54aec222-43d5-4818-8c8b-2452065bce1a None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:28.009319 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-54aec222-43d5-4818-8c8b-2452065bce1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:28.065402 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 989/1983] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:28.073552 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84381079-a408-45e5-88ea-04992ae2b16f None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:28.073841 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84381079-a408-45e5-88ea-04992ae2b16f None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:28.074127 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84381079-a408-45e5-88ea-04992ae2b16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:28.092846 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-84381079-a408-45e5-88ea-04992ae2b16f None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:28.094021 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-84381079-a408-45e5-88ea-04992ae2b16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:28.101674 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 995/1984] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:28.107065 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aec222-43d5-4818-8c8b-2452065bce1a None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:28.116401 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aec222-43d5-4818-8c8b-2452065bce1a None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:28.120817 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a8a61-beae-4b7e-90e2-2efe9a72d80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:28.121455 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a8a61-beae-4b7e-90e2-2efe9a72d80c admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:28.121734 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a8a61-beae-4b7e-90e2-2efe9a72d80c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:28.122007 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a8a61-beae-4b7e-90e2-2efe9a72d80c admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:28.122730 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a8a61-beae-4b7e-90e2-2efe9a72d80c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:39:28.123030 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a8a61-beae-4b7e-90e2-2efe9a72d80c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:28.124646 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a8a61-beae-4b7e-90e2-2efe9a72d80c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:28.136229 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 990/1985] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:39:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:39:28.140450 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84381079-a408-45e5-88ea-04992ae2b16f None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:28.149265 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84381079-a408-45e5-88ea-04992ae2b16f None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:28.154875 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd09435-2461-4a64-bdcf-a1576a0c73f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:28.155502 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd09435-2461-4a64-bdcf-a1576a0c73f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:28.155807 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd09435-2461-4a64-bdcf-a1576a0c73f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:28.156102 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd09435-2461-4a64-bdcf-a1576a0c73f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:28.156798 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd09435-2461-4a64-bdcf-a1576a0c73f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:28.158662 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd09435-2461-4a64-bdcf-a1576a0c73f1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:28.182371 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 996/1986] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:39:28 2021] POST /identity/v3/projects => generated 373 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:28.186425 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a8a61-beae-4b7e-90e2-2efe9a72d80c admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:28.196031 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a8a61-beae-4b7e-90e2-2efe9a72d80c admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:28.249951 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d55835-bddc-447a-8f20-ae22f22d1c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:28.250632 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d55835-bddc-447a-8f20-ae22f22d1c68 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:28.250953 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d55835-bddc-447a-8f20-ae22f22d1c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:28.251260 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d55835-bddc-447a-8f20-ae22f22d1c68 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:28.252017 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d55835-bddc-447a-8f20-ae22f22d1c68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:28.253975 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d55835-bddc-447a-8f20-ae22f22d1c68 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:28.273724 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 991/1987] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:39:28 2021] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:28.278351 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd09435-2461-4a64-bdcf-a1576a0c73f1 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:28.288464 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd09435-2461-4a64-bdcf-a1576a0c73f1 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:28.292997 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7502c-2cc1-42d3-930e-34dfc3552c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:28.293636 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7502c-2cc1-42d3-930e-34dfc3552c40 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:28.293912 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7502c-2cc1-42d3-930e-34dfc3552c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:28.294180 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7502c-2cc1-42d3-930e-34dfc3552c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:28.294904 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7502c-2cc1-42d3-930e-34dfc3552c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:28.296501 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7502c-2cc1-42d3-930e-34dfc3552c40 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:28.306304 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 997/1988] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:28 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:28.309911 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d55835-bddc-447a-8f20-ae22f22d1c68 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:28.319540 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d55835-bddc-447a-8f20-ae22f22d1c68 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:28.324868 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bc4f9-a39b-4a36-a889-501fb1edd557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:28.325508 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bc4f9-a39b-4a36-a889-501fb1edd557 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:28.325787 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bc4f9-a39b-4a36-a889-501fb1edd557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:28.326083 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bc4f9-a39b-4a36-a889-501fb1edd557 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:28.326802 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325bc4f9-a39b-4a36-a889-501fb1edd557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:28.328428 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325bc4f9-a39b-4a36-a889-501fb1edd557 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:28.341245 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 992/1989] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:28 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:28.345045 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7502c-2cc1-42d3-930e-34dfc3552c40 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:28.354361 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7502c-2cc1-42d3-930e-34dfc3552c40 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:28.359340 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002c4b7-d09b-4b7d-8bff-4f9688e686fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:28.360209 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002c4b7-d09b-4b7d-8bff-4f9688e686fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:28.360487 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002c4b7-d09b-4b7d-8bff-4f9688e686fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:28.361070 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002c4b7-d09b-4b7d-8bff-4f9688e686fe admin admin] PATH_INFO: `/v3/projects/1a1b022679574b448e407235935e4166/users/392459751eb34990914532f82e98d0bd/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:28.374559 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002c4b7-d09b-4b7d-8bff-4f9688e686fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1b022679574b448e407235935e4166, user_id=392459751eb34990914532f82e98d0bd, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:28.377203 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002c4b7-d09b-4b7d-8bff-4f9688e686fe admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:28.390420 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 998/1990] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:28 2021] PUT /identity/v3/projects/1a1b022679574b448e407235935e4166/users/392459751eb34990914532f82e98d0bd/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:28.400476 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92ca39-8a14-447f-9da1-06ddf69ca9f2 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:28.400742 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92ca39-8a14-447f-9da1-06ddf69ca9f2 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:28.401564 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92ca39-8a14-447f-9da1-06ddf69ca9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:28.426607 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-0f92ca39-8a14-447f-9da1-06ddf69ca9f2 None None] MFA Rules not processed for user `392459751eb34990914532f82e98d0bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:28.427846 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-0f92ca39-8a14-447f-9da1-06ddf69ca9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:28.488015 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 993/1991] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:28 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:39:28.492313 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002c4b7-d09b-4b7d-8bff-4f9688e686fe admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:28.550198 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002c4b7-d09b-4b7d-8bff-4f9688e686fe admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:28.554763 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576e819-d14e-491a-a59e-87adce8ac833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:28.555402 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576e819-d14e-491a-a59e-87adce8ac833 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:28.555707 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576e819-d14e-491a-a59e-87adce8ac833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:28.555978 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576e819-d14e-491a-a59e-87adce8ac833 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:28.556672 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576e819-d14e-491a-a59e-87adce8ac833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:28.559117 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576e819-d14e-491a-a59e-87adce8ac833 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:28.585175 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 999/1992] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:39:28 2021] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:28.588800 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92ca39-8a14-447f-9da1-06ddf69ca9f2 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:28.600807 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92ca39-8a14-447f-9da1-06ddf69ca9f2 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:28.656391 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11691b30-7af7-49fa-93e3-9abbbb984aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:28.657117 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11691b30-7af7-49fa-93e3-9abbbb984aab admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:28.657402 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11691b30-7af7-49fa-93e3-9abbbb984aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:28.657690 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11691b30-7af7-49fa-93e3-9abbbb984aab admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:28.658401 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11691b30-7af7-49fa-93e3-9abbbb984aab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:28.660367 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11691b30-7af7-49fa-93e3-9abbbb984aab admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:28.680711 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 994/1993] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:39:28 2021] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:28.685276 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576e819-d14e-491a-a59e-87adce8ac833 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:28.695369 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576e819-d14e-491a-a59e-87adce8ac833 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:28.701219 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df532c-de6d-4e17-b3df-3b15ef2dd97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:28.701888 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df532c-de6d-4e17-b3df-3b15ef2dd97f admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:28.702172 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df532c-de6d-4e17-b3df-3b15ef2dd97f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:28.702451 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df532c-de6d-4e17-b3df-3b15ef2dd97f admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:28.703187 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df532c-de6d-4e17-b3df-3b15ef2dd97f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:28.704800 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df532c-de6d-4e17-b3df-3b15ef2dd97f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:28.715546 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1000/1994] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:28 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:28.719980 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11691b30-7af7-49fa-93e3-9abbbb984aab admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:28.729716 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11691b30-7af7-49fa-93e3-9abbbb984aab admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:28.734350 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29c0ec-c3a7-461f-a590-a7c750787721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:28.735220 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29c0ec-c3a7-461f-a590-a7c750787721 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:28.735504 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29c0ec-c3a7-461f-a590-a7c750787721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:28.735810 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29c0ec-c3a7-461f-a590-a7c750787721 admin admin] PATH_INFO: `/v3/projects/778f53e03b684e81a761ee08c0c5ff4c/users/1a5a7e2c31b04ad3935b1a44766590e2/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:28.751430 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29c0ec-c3a7-461f-a590-a7c750787721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=778f53e03b684e81a761ee08c0c5ff4c, user_id=1a5a7e2c31b04ad3935b1a44766590e2, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:28.754112 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29c0ec-c3a7-461f-a590-a7c750787721 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:28.767232 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 995/1995] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:28 2021] PUT /identity/v3/projects/778f53e03b684e81a761ee08c0c5ff4c/users/1a5a7e2c31b04ad3935b1a44766590e2/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:28.771225 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df532c-de6d-4e17-b3df-3b15ef2dd97f admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:28.782303 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df532c-de6d-4e17-b3df-3b15ef2dd97f admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:28.836186 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2c302-ea0c-4395-b334-698241c61a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:28.836901 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2c302-ea0c-4395-b334-698241c61a95 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:28.837118 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2c302-ea0c-4395-b334-698241c61a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:28.837392 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2c302-ea0c-4395-b334-698241c61a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:28.838152 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2c302-ea0c-4395-b334-698241c61a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:28.840027 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2c302-ea0c-4395-b334-698241c61a95 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:28.849781 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1001/1996] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:28 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:28.854320 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29c0ec-c3a7-461f-a590-a7c750787721 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:28.864454 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29c0ec-c3a7-461f-a590-a7c750787721 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:28.869224 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc761d37-8e8d-4182-826a-ffbb66b055e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:28.870656 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc761d37-8e8d-4182-826a-ffbb66b055e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:28.870934 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc761d37-8e8d-4182-826a-ffbb66b055e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:28.871206 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc761d37-8e8d-4182-826a-ffbb66b055e9 admin admin] PATH_INFO: `/v3/projects/778f53e03b684e81a761ee08c0c5ff4c/users/1a5a7e2c31b04ad3935b1a44766590e2/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:28.873287 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc761d37-8e8d-4182-826a-ffbb66b055e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=778f53e03b684e81a761ee08c0c5ff4c, user_id=1a5a7e2c31b04ad3935b1a44766590e2, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:28.875943 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc761d37-8e8d-4182-826a-ffbb66b055e9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:28.886208 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 996/1997] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:28 2021] PUT /identity/v3/projects/778f53e03b684e81a761ee08c0c5ff4c/users/1a5a7e2c31b04ad3935b1a44766590e2/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:28.896076 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d1fb6-aa73-4781-bebd-c167a21063da None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:28.896461 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d1fb6-aa73-4781-bebd-c167a21063da None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:28.896809 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d1fb6-aa73-4781-bebd-c167a21063da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:28.923409 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-710d1fb6-aa73-4781-bebd-c167a21063da None None] MFA Rules not processed for user `1a5a7e2c31b04ad3935b1a44766590e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:28.924551 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-710d1fb6-aa73-4781-bebd-c167a21063da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:28.997135 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1002/1998] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:28 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:29.011085 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc761d37-8e8d-4182-826a-ffbb66b055e9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:29.012933 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-bc761d37-8e8d-4182-826a-ffbb66b055e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:29.071783 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc761d37-8e8d-4182-826a-ffbb66b055e9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:29.075924 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f2bfb-f06e-4e0e-9a81-d2257e295400 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:29.076661 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f2bfb-f06e-4e0e-9a81-d2257e295400 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:29.077035 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f2bfb-f06e-4e0e-9a81-d2257e295400 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:29.077419 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f2bfb-f06e-4e0e-9a81-d2257e295400 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:29.087483 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f2bfb-f06e-4e0e-9a81-d2257e295400 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:29.088836 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f2bfb-f06e-4e0e-9a81-d2257e295400 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:29.098960 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 997/1999] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:29 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:29.388531 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d1fb6-aa73-4781-bebd-c167a21063da None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:29.449314 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d1fb6-aa73-4781-bebd-c167a21063da None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:29.453737 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bb25e-b399-4cb9-839f-d9d54bea7b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:29.454587 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bb25e-b399-4cb9-839f-d9d54bea7b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:29.455144 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bb25e-b399-4cb9-839f-d9d54bea7b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:29.455423 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bb25e-b399-4cb9-839f-d9d54bea7b50 admin admin] PATH_INFO: `/v3/users/392459751eb34990914532f82e98d0bd` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:29.456642 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bb25e-b399-4cb9-839f-d9d54bea7b50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=392459751eb34990914532f82e98d0bd)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:29.458544 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bb25e-b399-4cb9-839f-d9d54bea7b50 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:29.501922 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2c0bb25e-b399-4cb9-839f-d9d54bea7b50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '392459751eb34990914532f82e98d0bd'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:29.512933 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2c0bb25e-b399-4cb9-839f-d9d54bea7b50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '392459751eb34990914532f82e98d0bd'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:29.520337 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2c0bb25e-b399-4cb9-839f-d9d54bea7b50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '392459751eb34990914532f82e98d0bd'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:29.521103 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2c0bb25e-b399-4cb9-839f-d9d54bea7b50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '392459751eb34990914532f82e98d0bd'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:29.528243 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2c0bb25e-b399-4cb9-839f-d9d54bea7b50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '392459751eb34990914532f82e98d0bd'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:29.534018 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1003/2000] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:29 2021] DELETE /identity/v3/users/392459751eb34990914532f82e98d0bd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:29.538477 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df70446-17fa-4af8-82fd-52d054b77d69 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:29.538765 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df70446-17fa-4af8-82fd-52d054b77d69 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:29.539041 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df70446-17fa-4af8-82fd-52d054b77d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:29.556661 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-5df70446-17fa-4af8-82fd-52d054b77d69 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:29.557960 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-5df70446-17fa-4af8-82fd-52d054b77d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:29.614157 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 998/2001] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:29.624471 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bb25e-b399-4cb9-839f-d9d54bea7b50 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:29.625910 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-2c0bb25e-b399-4cb9-839f-d9d54bea7b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:29.684620 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bb25e-b399-4cb9-839f-d9d54bea7b50 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:29.688710 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa7198-6a50-45a8-9dad-3f3a312152bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:29.689385 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa7198-6a50-45a8-9dad-3f3a312152bc service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:29.689671 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa7198-6a50-45a8-9dad-3f3a312152bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:29.689944 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa7198-6a50-45a8-9dad-3f3a312152bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:29.700133 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa7198-6a50-45a8-9dad-3f3a312152bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:29.701490 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa7198-6a50-45a8-9dad-3f3a312152bc service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:29.711099 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1004/2002] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:30.064904 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df70446-17fa-4af8-82fd-52d054b77d69 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:30.068181 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-5df70446-17fa-4af8-82fd-52d054b77d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:30.081587 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df70446-17fa-4af8-82fd-52d054b77d69 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:30.102227 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3ef23-3a64-47ae-9d5f-07d52e806bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:30.103093 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3ef23-3a64-47ae-9d5f-07d52e806bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:30.103374 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3ef23-3a64-47ae-9d5f-07d52e806bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:30.103645 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3ef23-3a64-47ae-9d5f-07d52e806bc2 admin admin] PATH_INFO: `/v3/projects/1a1b022679574b448e407235935e4166` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:30.105577 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3ef23-3a64-47ae-9d5f-07d52e806bc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a1b022679574b448e407235935e4166)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:30.107522 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3ef23-3a64-47ae-9d5f-07d52e806bc2 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:30.174091 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-d1f3ef23-3a64-47ae-9d5f-07d52e806bc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a1b022679574b448e407235935e4166', 'request_id': 'req-d1f3ef23-3a64-47ae-9d5f-07d52e806bc2'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:30.180682 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-d1f3ef23-3a64-47ae-9d5f-07d52e806bc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a1b022679574b448e407235935e4166', 'request_id': 'req-d1f3ef23-3a64-47ae-9d5f-07d52e806bc2'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:30.188124 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-d1f3ef23-3a64-47ae-9d5f-07d52e806bc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a1b022679574b448e407235935e4166', 'request_id': 'req-d1f3ef23-3a64-47ae-9d5f-07d52e806bc2'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:30.207173 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-d1f3ef23-3a64-47ae-9d5f-07d52e806bc2 admin admin] The token cache is being invalidate because project 1a1b022679574b448e407235935e4166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:30.207534 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-d1f3ef23-3a64-47ae-9d5f-07d52e806bc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:30.208258 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-d1f3ef23-3a64-47ae-9d5f-07d52e806bc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:30.210199 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 999/2003] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:30 2021] DELETE /identity/v3/projects/1a1b022679574b448e407235935e4166 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:30.213855 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa7198-6a50-45a8-9dad-3f3a312152bc service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:30.227165 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa7198-6a50-45a8-9dad-3f3a312152bc service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:30.302297 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b070a-736c-4021-b762-e0eb3475e2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:30.303266 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b070a-736c-4021-b762-e0eb3475e2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:30.303569 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b070a-736c-4021-b762-e0eb3475e2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:30.304039 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b070a-736c-4021-b762-e0eb3475e2b2 admin admin] PATH_INFO: `/v3/users/1a5a7e2c31b04ad3935b1a44766590e2` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:30.305344 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b070a-736c-4021-b762-e0eb3475e2b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a5a7e2c31b04ad3935b1a44766590e2)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:30.308231 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b070a-736c-4021-b762-e0eb3475e2b2 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:30.357807 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-453b070a-736c-4021-b762-e0eb3475e2b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a5a7e2c31b04ad3935b1a44766590e2'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:30.371471 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-453b070a-736c-4021-b762-e0eb3475e2b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a5a7e2c31b04ad3935b1a44766590e2'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:30.378539 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-453b070a-736c-4021-b762-e0eb3475e2b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a5a7e2c31b04ad3935b1a44766590e2'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:30.379227 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-453b070a-736c-4021-b762-e0eb3475e2b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a5a7e2c31b04ad3935b1a44766590e2'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:30.386195 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-453b070a-736c-4021-b762-e0eb3475e2b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a5a7e2c31b04ad3935b1a44766590e2'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:30.392019 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1005/2004] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:30 2021] DELETE /identity/v3/users/1a5a7e2c31b04ad3935b1a44766590e2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:30.678455 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3ef23-3a64-47ae-9d5f-07d52e806bc2 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:30.680184 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d1f3ef23-3a64-47ae-9d5f-07d52e806bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:30.698575 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3ef23-3a64-47ae-9d5f-07d52e806bc2 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:30.763078 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d027a9-2c5d-46c5-9e3b-b6319f9e3b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:30.764059 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d027a9-2c5d-46c5-9e3b-b6319f9e3b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:30.764469 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d027a9-2c5d-46c5-9e3b-b6319f9e3b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:30.764759 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d027a9-2c5d-46c5-9e3b-b6319f9e3b1c admin admin] PATH_INFO: `/v3/projects/778f53e03b684e81a761ee08c0c5ff4c` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:30.766097 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d027a9-2c5d-46c5-9e3b-b6319f9e3b1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=778f53e03b684e81a761ee08c0c5ff4c)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:30.768012 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d027a9-2c5d-46c5-9e3b-b6319f9e3b1c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:30.824447 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-07d027a9-2c5d-46c5-9e3b-b6319f9e3b1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '778f53e03b684e81a761ee08c0c5ff4c', 'request_id': 'req-07d027a9-2c5d-46c5-9e3b-b6319f9e3b1c'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:30.830457 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-07d027a9-2c5d-46c5-9e3b-b6319f9e3b1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '778f53e03b684e81a761ee08c0c5ff4c', 'request_id': 'req-07d027a9-2c5d-46c5-9e3b-b6319f9e3b1c'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:30.835775 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-07d027a9-2c5d-46c5-9e3b-b6319f9e3b1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '778f53e03b684e81a761ee08c0c5ff4c', 'request_id': 'req-07d027a9-2c5d-46c5-9e3b-b6319f9e3b1c'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:30.848794 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-07d027a9-2c5d-46c5-9e3b-b6319f9e3b1c admin admin] The token cache is being invalidate because project 778f53e03b684e81a761ee08c0c5ff4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:30.849082 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-07d027a9-2c5d-46c5-9e3b-b6319f9e3b1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:30.849711 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-07d027a9-2c5d-46c5-9e3b-b6319f9e3b1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:30.851259 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1000/2005] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:30 2021] DELETE /identity/v3/projects/778f53e03b684e81a761ee08c0c5ff4c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:30.857561 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce42f1-5461-4adf-b240-7360f9c9aa83 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:30.857923 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce42f1-5461-4adf-b240-7360f9c9aa83 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:30.858269 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce42f1-5461-4adf-b240-7360f9c9aa83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:30.875919 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-7fce42f1-5461-4adf-b240-7360f9c9aa83 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:30.877213 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-7fce42f1-5461-4adf-b240-7360f9c9aa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:30.939245 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1006/2006] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:30.947105 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85798f-9364-492a-9013-36d56c504bb2 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:30.947405 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85798f-9364-492a-9013-36d56c504bb2 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:30.947726 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85798f-9364-492a-9013-36d56c504bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:30.967089 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-0d85798f-9364-492a-9013-36d56c504bb2 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:30.968337 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-0d85798f-9364-492a-9013-36d56c504bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:30.976140 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1001/2007] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:30.981013 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce42f1-5461-4adf-b240-7360f9c9aa83 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:30.992675 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce42f1-5461-4adf-b240-7360f9c9aa83 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:31.003235 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bd4ee-f8cb-48c0-b01b-d1d62a735bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:31.004016 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bd4ee-f8cb-48c0-b01b-d1d62a735bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:31.004433 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bd4ee-f8cb-48c0-b01b-d1d62a735bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:31.005753 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bd4ee-f8cb-48c0-b01b-d1d62a735bd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:31.006580 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002bd4ee-f8cb-48c0-b01b-d1d62a735bd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:39:31.006895 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002bd4ee-f8cb-48c0-b01b-d1d62a735bd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:31.009104 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002bd4ee-f8cb-48c0-b01b-d1d62a735bd8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:31.024213 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1007/2008] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:39:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:39:31.028836 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85798f-9364-492a-9013-36d56c504bb2 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:31.050534 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85798f-9364-492a-9013-36d56c504bb2 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:31.067994 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cfcb2-1c01-47fa-a7d4-502e0c4abfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:31.068649 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cfcb2-1c01-47fa-a7d4-502e0c4abfbe admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:31.068975 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cfcb2-1c01-47fa-a7d4-502e0c4abfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:31.069248 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cfcb2-1c01-47fa-a7d4-502e0c4abfbe admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:31.069957 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430cfcb2-1c01-47fa-a7d4-502e0c4abfbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:31.071915 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430cfcb2-1c01-47fa-a7d4-502e0c4abfbe admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:31.099258 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1002/2009] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:39:31 2021] POST /identity/v3/projects => generated 363 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:31.103518 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bd4ee-f8cb-48c0-b01b-d1d62a735bd8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:31.114007 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bd4ee-f8cb-48c0-b01b-d1d62a735bd8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:31.176453 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a961c9-83ab-4538-a7a9-6fb0affef1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:31.177909 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a961c9-83ab-4538-a7a9-6fb0affef1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:31.178127 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a961c9-83ab-4538-a7a9-6fb0affef1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:31.178422 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a961c9-83ab-4538-a7a9-6fb0affef1c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:31.179296 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a961c9-83ab-4538-a7a9-6fb0affef1c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:31.181392 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a961c9-83ab-4538-a7a9-6fb0affef1c0 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:31.204742 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1008/2010] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:39:31 2021] POST /identity/v3/users => generated 282 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:39:31.208903 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cfcb2-1c01-47fa-a7d4-502e0c4abfbe admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:31.220166 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cfcb2-1c01-47fa-a7d4-502e0c4abfbe admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:31.226104 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaad491-8dc3-421c-a52f-10803837732b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:31.226791 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaad491-8dc3-421c-a52f-10803837732b admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:31.227077 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaad491-8dc3-421c-a52f-10803837732b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:31.227353 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaad491-8dc3-421c-a52f-10803837732b admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:31.228142 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaad491-8dc3-421c-a52f-10803837732b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:31.230260 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaad491-8dc3-421c-a52f-10803837732b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:31.241147 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1003/2011] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:31 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:39:31.246104 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a961c9-83ab-4538-a7a9-6fb0affef1c0 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:31.256251 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a961c9-83ab-4538-a7a9-6fb0affef1c0 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:31.261039 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076eb2b-2022-4235-b22b-b73fe05a05d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:31.262000 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076eb2b-2022-4235-b22b-b73fe05a05d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:31.262000 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076eb2b-2022-4235-b22b-b73fe05a05d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:31.262416 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076eb2b-2022-4235-b22b-b73fe05a05d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:31.262958 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076eb2b-2022-4235-b22b-b73fe05a05d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:31.264588 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076eb2b-2022-4235-b22b-b73fe05a05d7 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:31.274722 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1009/2012] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:31 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:39:31.278427 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaad491-8dc3-421c-a52f-10803837732b admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:31.278830 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076eb2b-2022-4235-b22b-b73fe05a05d7 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:31.280237 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-beaad491-8dc3-421c-a52f-10803837732b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:31.288348 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076eb2b-2022-4235-b22b-b73fe05a05d7 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:31.293103 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaad491-8dc3-421c-a52f-10803837732b admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:31.293409 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb54212-10e7-4ba9-bd54-8891143d7b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:31.294266 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb54212-10e7-4ba9-bd54-8891143d7b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:31.294543 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb54212-10e7-4ba9-bd54-8891143d7b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:31.294823 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb54212-10e7-4ba9-bd54-8891143d7b6c admin admin] PATH_INFO: `/v3/projects/10df03d0aabc4782b5f21c67e86f3df7/users/3ddb4abfe8054d209f90b3c1a963883b/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:31.297805 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8952d-4942-4004-abc4-138e8fdebc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:31.298653 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8952d-4942-4004-abc4-138e8fdebc47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:31.298935 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8952d-4942-4004-abc4-138e8fdebc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:31.299241 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8952d-4942-4004-abc4-138e8fdebc47 admin admin] PATH_INFO: `/v3/users/78654eee91594d7d896671ad3f9e9b58` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:31.300472 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8952d-4942-4004-abc4-138e8fdebc47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78654eee91594d7d896671ad3f9e9b58)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:31.302397 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8952d-4942-4004-abc4-138e8fdebc47 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:31.309848 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb54212-10e7-4ba9-bd54-8891143d7b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=10df03d0aabc4782b5f21c67e86f3df7, user_id=3ddb4abfe8054d209f90b3c1a963883b, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:31.312555 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb54212-10e7-4ba9-bd54-8891143d7b6c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:31.326217 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1010/2013] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:31 2021] PUT /identity/v3/projects/10df03d0aabc4782b5f21c67e86f3df7/users/3ddb4abfe8054d209f90b3c1a963883b/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:39:31.336652 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35f1cf-35f8-457e-a5f5-f529e06f0f29 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:31.336933 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35f1cf-35f8-457e-a5f5-f529e06f0f29 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:31.337230 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35f1cf-35f8-457e-a5f5-f529e06f0f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:31.355005 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-c2c8952d-4942-4004-abc4-138e8fdebc47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78654eee91594d7d896671ad3f9e9b58'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:31.366758 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-c2c8952d-4942-4004-abc4-138e8fdebc47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78654eee91594d7d896671ad3f9e9b58'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:31.367612 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-ee35f1cf-35f8-457e-a5f5-f529e06f0f29 None None] MFA Rules not processed for user `3ddb4abfe8054d209f90b3c1a963883b`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:31.368849 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-ee35f1cf-35f8-457e-a5f5-f529e06f0f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:31.374460 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-c2c8952d-4942-4004-abc4-138e8fdebc47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78654eee91594d7d896671ad3f9e9b58'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:31.375184 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-c2c8952d-4942-4004-abc4-138e8fdebc47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78654eee91594d7d896671ad3f9e9b58'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:31.385247 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-c2c8952d-4942-4004-abc4-138e8fdebc47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78654eee91594d7d896671ad3f9e9b58'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:31.393351 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1004/2014] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:31 2021] DELETE /identity/v3/users/78654eee91594d7d896671ad3f9e9b58 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:39:31.401350 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604aff8b-c2f7-49ec-b2fa-eced48a704ad None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:31.401677 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604aff8b-c2f7-49ec-b2fa-eced48a704ad None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:31.401946 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604aff8b-c2f7-49ec-b2fa-eced48a704ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:31.424712 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-604aff8b-c2f7-49ec-b2fa-eced48a704ad None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:31.426438 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-604aff8b-c2f7-49ec-b2fa-eced48a704ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:31.445290 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1011/2015] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:31 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:39:31.449929 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35f1cf-35f8-457e-a5f5-f529e06f0f29 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:31.451582 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-ee35f1cf-35f8-457e-a5f5-f529e06f0f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:31.546184 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35f1cf-35f8-457e-a5f5-f529e06f0f29 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:31.549167 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1005/2016] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:31.556826 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f9ab0-4752-497a-a7b8-45c0829aa5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:31.557512 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f9ab0-4752-497a-a7b8-45c0829aa5eb admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:31.557798 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f9ab0-4752-497a-a7b8-45c0829aa5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:31.558079 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f9ab0-4752-497a-a7b8-45c0829aa5eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:31.558809 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f9ab0-4752-497a-a7b8-45c0829aa5eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:31.561821 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604aff8b-c2f7-49ec-b2fa-eced48a704ad None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:31.564753 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-604aff8b-c2f7-49ec-b2fa-eced48a704ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:31.569677 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f9ab0-4752-497a-a7b8-45c0829aa5eb admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:31.619646 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1012/2017] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:39:31 2021] POST /identity/v3/projects => generated 365 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:39:31.623492 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f9ab0-4752-497a-a7b8-45c0829aa5eb admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:31.665994 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604aff8b-c2f7-49ec-b2fa-eced48a704ad None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:31.752026 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f9ab0-4752-497a-a7b8-45c0829aa5eb admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:31.758598 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960765f4-401e-48bf-9177-d185e587e74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:31.759277 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960765f4-401e-48bf-9177-d185e587e74d admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:31.759584 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960765f4-401e-48bf-9177-d185e587e74d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:31.759911 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960765f4-401e-48bf-9177-d185e587e74d admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:31.760596 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960765f4-401e-48bf-9177-d185e587e74d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:31.762541 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960765f4-401e-48bf-9177-d185e587e74d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:31.776382 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb1461-62fa-4b4c-902c-a2e29bcd4188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:31.777482 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb1461-62fa-4b4c-902c-a2e29bcd4188 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:31.777814 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb1461-62fa-4b4c-902c-a2e29bcd4188 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:31.778095 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb1461-62fa-4b4c-902c-a2e29bcd4188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:31.789507 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1013/2018] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:39:31 2021] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:31.793908 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960765f4-401e-48bf-9177-d185e587e74d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:31.800436 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb1461-62fa-4b4c-902c-a2e29bcd4188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:31.801898 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb1461-62fa-4b4c-902c-a2e29bcd4188 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:31.803555 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960765f4-401e-48bf-9177-d185e587e74d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:31.808632 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d39911-9459-4080-b7d5-60913aca8988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:31.809081 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d39911-9459-4080-b7d5-60913aca8988 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:31.809366 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d39911-9459-4080-b7d5-60913aca8988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:31.809646 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d39911-9459-4080-b7d5-60913aca8988 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:31.810434 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d39911-9459-4080-b7d5-60913aca8988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:31.812053 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d39911-9459-4080-b7d5-60913aca8988 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:31.812790 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1006/2019] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:31.822427 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1014/2020] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:31 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:39:31.826588 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb1461-62fa-4b4c-902c-a2e29bcd4188 service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:31.836077 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb1461-62fa-4b4c-902c-a2e29bcd4188 service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:31.841753 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11959825-6d5e-44e5-8711-a41a1458a685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:31.842665 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11959825-6d5e-44e5-8711-a41a1458a685 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:31.842949 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11959825-6d5e-44e5-8711-a41a1458a685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:31.843236 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11959825-6d5e-44e5-8711-a41a1458a685 admin admin] PATH_INFO: `/v3/projects/f03154ea90424e0fa6f5c9276a55433a/users/159b5e9e92214dde8b40c672e314e252/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:31.861422 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11959825-6d5e-44e5-8711-a41a1458a685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f03154ea90424e0fa6f5c9276a55433a, user_id=159b5e9e92214dde8b40c672e314e252, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:31.864215 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11959825-6d5e-44e5-8711-a41a1458a685 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:31.884757 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1007/2021] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:31 2021] PUT /identity/v3/projects/f03154ea90424e0fa6f5c9276a55433a/users/159b5e9e92214dde8b40c672e314e252/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:31.889292 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d39911-9459-4080-b7d5-60913aca8988 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:31.900966 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d39911-9459-4080-b7d5-60913aca8988 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:31.966158 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f7efd-b176-440c-bad0-aaf376b20e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:31.967012 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f7efd-b176-440c-bad0-aaf376b20e18 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:31.967268 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f7efd-b176-440c-bad0-aaf376b20e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:31.967814 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f7efd-b176-440c-bad0-aaf376b20e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:31.968769 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f7efd-b176-440c-bad0-aaf376b20e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:31.970718 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f7efd-b176-440c-bad0-aaf376b20e18 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:31.981774 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1015/2022] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:31 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:31.985789 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11959825-6d5e-44e5-8711-a41a1458a685 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:31.996769 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11959825-6d5e-44e5-8711-a41a1458a685 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:32.001742 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe66f7-b021-4264-9f5b-fea5e31c34d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:32.002760 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe66f7-b021-4264-9f5b-fea5e31c34d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:32.003044 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe66f7-b021-4264-9f5b-fea5e31c34d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:32.003382 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe66f7-b021-4264-9f5b-fea5e31c34d2 admin admin] PATH_INFO: `/v3/projects/f03154ea90424e0fa6f5c9276a55433a/users/159b5e9e92214dde8b40c672e314e252/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:32.005512 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe66f7-b021-4264-9f5b-fea5e31c34d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f03154ea90424e0fa6f5c9276a55433a, user_id=159b5e9e92214dde8b40c672e314e252, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:32.008351 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe66f7-b021-4264-9f5b-fea5e31c34d2 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:32.019113 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1008/2023] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:31 2021] PUT /identity/v3/projects/f03154ea90424e0fa6f5c9276a55433a/users/159b5e9e92214dde8b40c672e314e252/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:39:32.030611 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6d2dc-a394-4e55-b2e2-e73f55d4bbc9 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:32.030906 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6d2dc-a394-4e55-b2e2-e73f55d4bbc9 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:32.031186 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6d2dc-a394-4e55-b2e2-e73f55d4bbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:32.059917 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-25d6d2dc-a394-4e55-b2e2-e73f55d4bbc9 None None] MFA Rules not processed for user `159b5e9e92214dde8b40c672e314e252`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:32.061110 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-25d6d2dc-a394-4e55-b2e2-e73f55d4bbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:32.104481 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe66f7-b021-4264-9f5b-fea5e31c34d2 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:32.108513 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-dcbe66f7-b021-4264-9f5b-fea5e31c34d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:32.162731 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1016/2024] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:32 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:39:32.174128 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6d2dc-a394-4e55-b2e2-e73f55d4bbc9 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:32.175652 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-25d6d2dc-a394-4e55-b2e2-e73f55d4bbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:32.239840 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6d2dc-a394-4e55-b2e2-e73f55d4bbc9 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:32.243147 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11168bb-697c-4d0d-9ff1-f282bb342bd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:32.243805 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11168bb-697c-4d0d-9ff1-f282bb342bd9 service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:32.244088 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11168bb-697c-4d0d-9ff1-f282bb342bd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:32.244911 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11168bb-697c-4d0d-9ff1-f282bb342bd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:32.254282 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe66f7-b021-4264-9f5b-fea5e31c34d2 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:32.254946 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11168bb-697c-4d0d-9ff1-f282bb342bd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:32.257592 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11168bb-697c-4d0d-9ff1-f282bb342bd9 service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:32.262462 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4059884-91a0-465f-9cd2-d7bf3f41afbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:32.263410 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4059884-91a0-465f-9cd2-d7bf3f41afbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:32.263935 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4059884-91a0-465f-9cd2-d7bf3f41afbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:32.264277 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4059884-91a0-465f-9cd2-d7bf3f41afbe admin admin] PATH_INFO: `/v3/projects/99eb2a7c6737459180ce1d6a49a28ae2` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:32.266651 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4059884-91a0-465f-9cd2-d7bf3f41afbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=99eb2a7c6737459180ce1d6a49a28ae2)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:32.269063 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4059884-91a0-465f-9cd2-d7bf3f41afbe admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:32.271711 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1017/2025] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:32 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:39:32.330706 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-d4059884-91a0-465f-9cd2-d7bf3f41afbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99eb2a7c6737459180ce1d6a49a28ae2', 'request_id': 'req-d4059884-91a0-465f-9cd2-d7bf3f41afbe'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:32.337408 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-d4059884-91a0-465f-9cd2-d7bf3f41afbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99eb2a7c6737459180ce1d6a49a28ae2', 'request_id': 'req-d4059884-91a0-465f-9cd2-d7bf3f41afbe'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:32.343063 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-d4059884-91a0-465f-9cd2-d7bf3f41afbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99eb2a7c6737459180ce1d6a49a28ae2', 'request_id': 'req-d4059884-91a0-465f-9cd2-d7bf3f41afbe'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:32.357370 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-d4059884-91a0-465f-9cd2-d7bf3f41afbe admin admin] The token cache is being invalidate because project 99eb2a7c6737459180ce1d6a49a28ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:32.357779 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-d4059884-91a0-465f-9cd2-d7bf3f41afbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:32.358457 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-d4059884-91a0-465f-9cd2-d7bf3f41afbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:32.360234 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1009/2026] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:32 2021] DELETE /identity/v3/projects/99eb2a7c6737459180ce1d6a49a28ae2 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:39:32.364786 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11168bb-697c-4d0d-9ff1-f282bb342bd9 service cinder] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:32.376399 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11168bb-697c-4d0d-9ff1-f282bb342bd9 service cinder] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:32.448781 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abc808-683b-4bbd-a8b9-56e2717410b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:32.449318 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4059884-91a0-465f-9cd2-d7bf3f41afbe admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:32.449654 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abc808-683b-4bbd-a8b9-56e2717410b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:32.449935 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abc808-683b-4bbd-a8b9-56e2717410b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:32.450205 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abc808-683b-4bbd-a8b9-56e2717410b1 admin admin] PATH_INFO: `/v3/users/a8801bc96dad414bbd4a5b92cc281f47` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:32.450794 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d4059884-91a0-465f-9cd2-d7bf3f41afbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:32.451429 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abc808-683b-4bbd-a8b9-56e2717410b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8801bc96dad414bbd4a5b92cc281f47)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:32.453376 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abc808-683b-4bbd-a8b9-56e2717410b1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:32.463776 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4059884-91a0-465f-9cd2-d7bf3f41afbe admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:32.468870 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c7c4a-990c-48ee-99ec-02bd01d3be12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:32.469721 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c7c4a-990c-48ee-99ec-02bd01d3be12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:32.470000 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c7c4a-990c-48ee-99ec-02bd01d3be12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:32.470272 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c7c4a-990c-48ee-99ec-02bd01d3be12 admin admin] PATH_INFO: `/v3/users/3ddb4abfe8054d209f90b3c1a963883b` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:32.471464 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c7c4a-990c-48ee-99ec-02bd01d3be12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ddb4abfe8054d209f90b3c1a963883b)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:32.473414 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c7c4a-990c-48ee-99ec-02bd01d3be12 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:32.499542 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-62abc808-683b-4bbd-a8b9-56e2717410b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8801bc96dad414bbd4a5b92cc281f47'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:32.511625 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-62abc808-683b-4bbd-a8b9-56e2717410b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8801bc96dad414bbd4a5b92cc281f47'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:32.519054 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-aa5c7c4a-990c-48ee-99ec-02bd01d3be12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ddb4abfe8054d209f90b3c1a963883b'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:32.519230 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-62abc808-683b-4bbd-a8b9-56e2717410b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8801bc96dad414bbd4a5b92cc281f47'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:32.519893 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-62abc808-683b-4bbd-a8b9-56e2717410b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8801bc96dad414bbd4a5b92cc281f47'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:32.527412 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-62abc808-683b-4bbd-a8b9-56e2717410b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8801bc96dad414bbd4a5b92cc281f47'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:32.531768 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-aa5c7c4a-990c-48ee-99ec-02bd01d3be12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ddb4abfe8054d209f90b3c1a963883b'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:32.533215 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1018/2027] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:32 2021] DELETE /identity/v3/users/a8801bc96dad414bbd4a5b92cc281f47 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:32.538951 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-aa5c7c4a-990c-48ee-99ec-02bd01d3be12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ddb4abfe8054d209f90b3c1a963883b'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:32.539639 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-aa5c7c4a-990c-48ee-99ec-02bd01d3be12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ddb4abfe8054d209f90b3c1a963883b'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:32.546364 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-aa5c7c4a-990c-48ee-99ec-02bd01d3be12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ddb4abfe8054d209f90b3c1a963883b'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:32.552784 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1010/2028] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:32 2021] DELETE /identity/v3/users/3ddb4abfe8054d209f90b3c1a963883b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:39:32.557820 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123fb6f-403d-42b4-a653-71de80608b1f None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:32.558194 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123fb6f-403d-42b4-a653-71de80608b1f None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:32.558499 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123fb6f-403d-42b4-a653-71de80608b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:32.577321 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-f123fb6f-403d-42b4-a653-71de80608b1f None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:32.578895 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-f123fb6f-403d-42b4-a653-71de80608b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:32.593520 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c7c4a-990c-48ee-99ec-02bd01d3be12 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:32.595134 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-aa5c7c4a-990c-48ee-99ec-02bd01d3be12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:32.645218 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1019/2029] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:39:32.655337 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123fb6f-403d-42b4-a653-71de80608b1f None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:32.656919 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-f123fb6f-403d-42b4-a653-71de80608b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:32.664830 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c7c4a-990c-48ee-99ec-02bd01d3be12 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:32.670137 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99725c7e-47ae-44d6-ab85-25fe8378ed5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:32.671015 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99725c7e-47ae-44d6-ab85-25fe8378ed5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:32.671286 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99725c7e-47ae-44d6-ab85-25fe8378ed5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:32.671566 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99725c7e-47ae-44d6-ab85-25fe8378ed5b admin admin] PATH_INFO: `/v3/users/178fd2bbb4c84fcfa7e1af03bc797f94` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:32.672817 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99725c7e-47ae-44d6-ab85-25fe8378ed5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=178fd2bbb4c84fcfa7e1af03bc797f94)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:32.674748 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99725c7e-47ae-44d6-ab85-25fe8378ed5b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:32.718740 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123fb6f-403d-42b4-a653-71de80608b1f None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:32.723086 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ccfe1-5b88-4912-b3fb-17d9a0652798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:32.723965 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ccfe1-5b88-4912-b3fb-17d9a0652798 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:32.724415 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-99725c7e-47ae-44d6-ab85-25fe8378ed5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '178fd2bbb4c84fcfa7e1af03bc797f94'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:32.724600 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ccfe1-5b88-4912-b3fb-17d9a0652798 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:32.724896 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ccfe1-5b88-4912-b3fb-17d9a0652798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:32.734806 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ccfe1-5b88-4912-b3fb-17d9a0652798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:32.736287 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ccfe1-5b88-4912-b3fb-17d9a0652798 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:32.737666 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-99725c7e-47ae-44d6-ab85-25fe8378ed5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '178fd2bbb4c84fcfa7e1af03bc797f94'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:32.746479 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-99725c7e-47ae-44d6-ab85-25fe8378ed5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '178fd2bbb4c84fcfa7e1af03bc797f94'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:32.747154 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-99725c7e-47ae-44d6-ab85-25fe8378ed5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '178fd2bbb4c84fcfa7e1af03bc797f94'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:32.747597 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1020/2030] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:39:32.754485 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-99725c7e-47ae-44d6-ab85-25fe8378ed5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '178fd2bbb4c84fcfa7e1af03bc797f94'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:32.760537 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1011/2031] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:32 2021] DELETE /identity/v3/users/178fd2bbb4c84fcfa7e1af03bc797f94 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:32.764879 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db8762-a0d7-473c-9efe-fe6bc54ff604 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:32.765169 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db8762-a0d7-473c-9efe-fe6bc54ff604 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:32.765447 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db8762-a0d7-473c-9efe-fe6bc54ff604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:32.785473 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-74db8762-a0d7-473c-9efe-fe6bc54ff604 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:32.786940 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-74db8762-a0d7-473c-9efe-fe6bc54ff604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:32.852328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1021/2032] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:39:32.869037 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99725c7e-47ae-44d6-ab85-25fe8378ed5b admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:32.871293 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-99725c7e-47ae-44d6-ab85-25fe8378ed5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:32.875417 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db8762-a0d7-473c-9efe-fe6bc54ff604 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:32.877323 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-74db8762-a0d7-473c-9efe-fe6bc54ff604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:32.893797 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db8762-a0d7-473c-9efe-fe6bc54ff604 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:32.907530 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cf215-988e-416d-9a2d-654639825619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:32.909411 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cf215-988e-416d-9a2d-654639825619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:32.909694 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cf215-988e-416d-9a2d-654639825619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:32.910675 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cf215-988e-416d-9a2d-654639825619 admin admin] PATH_INFO: `/v3/projects/39aa653296d8428e9e90c1287f58ceca` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:32.912356 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cf215-988e-416d-9a2d-654639825619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39aa653296d8428e9e90c1287f58ceca)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:32.928665 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cf215-988e-416d-9a2d-654639825619 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:32.990896 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99725c7e-47ae-44d6-ab85-25fe8378ed5b admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:32.996657 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f627bb8-a679-4982-99da-4b5931a3fe0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:32.998220 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f627bb8-a679-4982-99da-4b5931a3fe0d service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:32.998730 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f627bb8-a679-4982-99da-4b5931a3fe0d service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:32.999294 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f627bb8-a679-4982-99da-4b5931a3fe0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:33.014635 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f627bb8-a679-4982-99da-4b5931a3fe0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:33.018390 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a97cf215-988e-416d-9a2d-654639825619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39aa653296d8428e9e90c1287f58ceca', 'request_id': 'req-a97cf215-988e-416d-9a2d-654639825619'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:33.026660 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f627bb8-a679-4982-99da-4b5931a3fe0d service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:33.034403 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a97cf215-988e-416d-9a2d-654639825619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39aa653296d8428e9e90c1287f58ceca', 'request_id': 'req-a97cf215-988e-416d-9a2d-654639825619'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:33.042108 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a97cf215-988e-416d-9a2d-654639825619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39aa653296d8428e9e90c1287f58ceca', 'request_id': 'req-a97cf215-988e-416d-9a2d-654639825619'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:33.047372 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1012/2033] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:39:33.059180 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a97cf215-988e-416d-9a2d-654639825619 admin admin] The token cache is being invalidate because project 39aa653296d8428e9e90c1287f58ceca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:33.059503 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a97cf215-988e-416d-9a2d-654639825619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:33.060614 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a97cf215-988e-416d-9a2d-654639825619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:33.062964 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1022/2034] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:32 2021] DELETE /identity/v3/projects/39aa653296d8428e9e90c1287f58ceca => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:33.069911 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6386b9-38a4-448f-b528-4ccda601d660 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:33.070450 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6386b9-38a4-448f-b528-4ccda601d660 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:33.070880 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6386b9-38a4-448f-b528-4ccda601d660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:33.093343 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-4e6386b9-38a4-448f-b528-4ccda601d660 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:33.095118 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-4e6386b9-38a4-448f-b528-4ccda601d660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:33.181704 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1013/2035] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:33.190361 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf14240-2f56-407b-853e-b9287d340919 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:33.190710 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf14240-2f56-407b-853e-b9287d340919 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:33.190990 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf14240-2f56-407b-853e-b9287d340919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:33.209560 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-fcf14240-2f56-407b-853e-b9287d340919 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:33.210774 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-fcf14240-2f56-407b-853e-b9287d340919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:33.224660 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1023/2036] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:39:33.225838 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6386b9-38a4-448f-b528-4ccda601d660 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:33.241747 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6386b9-38a4-448f-b528-4ccda601d660 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:33.249866 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdb35e-eb85-4061-b04e-fea0a8ac0c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:33.250526 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdb35e-eb85-4061-b04e-fea0a8ac0c44 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:33.250837 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdb35e-eb85-4061-b04e-fea0a8ac0c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:33.251267 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdb35e-eb85-4061-b04e-fea0a8ac0c44 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:33.252047 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbdb35e-eb85-4061-b04e-fea0a8ac0c44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:39:33.252526 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbdb35e-eb85-4061-b04e-fea0a8ac0c44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:33.254158 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbdb35e-eb85-4061-b04e-fea0a8ac0c44 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:33.264142 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf14240-2f56-407b-853e-b9287d340919 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:33.265662 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-fcf14240-2f56-407b-853e-b9287d340919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:33.286102 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1014/2037] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:39:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:39:33.286985 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf14240-2f56-407b-853e-b9287d340919 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:33.287814 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdb35e-eb85-4061-b04e-fea0a8ac0c44 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:33.297736 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6550b3-ab32-4af0-b161-0e28e66bec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:33.298609 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6550b3-ab32-4af0-b161-0e28e66bec38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:33.298900 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6550b3-ab32-4af0-b161-0e28e66bec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:33.304021 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6550b3-ab32-4af0-b161-0e28e66bec38 admin admin] PATH_INFO: `/v3/projects/10df03d0aabc4782b5f21c67e86f3df7` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:33.305596 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6550b3-ab32-4af0-b161-0e28e66bec38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10df03d0aabc4782b5f21c67e86f3df7)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:33.311923 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdb35e-eb85-4061-b04e-fea0a8ac0c44 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:33.316125 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6550b3-ab32-4af0-b161-0e28e66bec38 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:33.319471 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c04fb-55b6-4d78-b86a-587d9049652e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:33.320192 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c04fb-55b6-4d78-b86a-587d9049652e admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:33.320484 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c04fb-55b6-4d78-b86a-587d9049652e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:33.320762 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c04fb-55b6-4d78-b86a-587d9049652e admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:33.321470 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c04fb-55b6-4d78-b86a-587d9049652e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:33.324175 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c04fb-55b6-4d78-b86a-587d9049652e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:33.355345 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1015/2038] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:39:33 2021] POST /identity/v3/projects => generated 367 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:33.359639 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c04fb-55b6-4d78-b86a-587d9049652e admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:33.377909 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-ba6550b3-ab32-4af0-b161-0e28e66bec38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10df03d0aabc4782b5f21c67e86f3df7', 'request_id': 'req-ba6550b3-ab32-4af0-b161-0e28e66bec38'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:33.384380 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-ba6550b3-ab32-4af0-b161-0e28e66bec38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10df03d0aabc4782b5f21c67e86f3df7', 'request_id': 'req-ba6550b3-ab32-4af0-b161-0e28e66bec38'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:33.390052 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-ba6550b3-ab32-4af0-b161-0e28e66bec38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10df03d0aabc4782b5f21c67e86f3df7', 'request_id': 'req-ba6550b3-ab32-4af0-b161-0e28e66bec38'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:33.404773 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-ba6550b3-ab32-4af0-b161-0e28e66bec38 admin admin] The token cache is being invalidate because project 10df03d0aabc4782b5f21c67e86f3df7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:33.405354 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-ba6550b3-ab32-4af0-b161-0e28e66bec38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:33.406204 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-ba6550b3-ab32-4af0-b161-0e28e66bec38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:33.407991 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1024/2039] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:33 2021] DELETE /identity/v3/projects/10df03d0aabc4782b5f21c67e86f3df7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:39:33.412088 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6550b3-ab32-4af0-b161-0e28e66bec38 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:33.413413 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-ba6550b3-ab32-4af0-b161-0e28e66bec38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:33.433858 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c04fb-55b6-4d78-b86a-587d9049652e admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:33.505820 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6550b3-ab32-4af0-b161-0e28e66bec38 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:33.513367 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4ab0a-0396-48f4-becb-558ea795da52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:33.514391 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4ab0a-0396-48f4-becb-558ea795da52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:33.514676 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4ab0a-0396-48f4-becb-558ea795da52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:33.514952 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4ab0a-0396-48f4-becb-558ea795da52 admin admin] PATH_INFO: `/v3/users/159b5e9e92214dde8b40c672e314e252` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:33.517198 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4ab0a-0396-48f4-becb-558ea795da52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=159b5e9e92214dde8b40c672e314e252)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:33.520570 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4ab0a-0396-48f4-becb-558ea795da52 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:33.609543 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-0cf4ab0a-0396-48f4-becb-558ea795da52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '159b5e9e92214dde8b40c672e314e252'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:33.624106 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-0cf4ab0a-0396-48f4-becb-558ea795da52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '159b5e9e92214dde8b40c672e314e252'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:33.633798 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-0cf4ab0a-0396-48f4-becb-558ea795da52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '159b5e9e92214dde8b40c672e314e252'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:33.634670 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-0cf4ab0a-0396-48f4-becb-558ea795da52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '159b5e9e92214dde8b40c672e314e252'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:33.644569 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-0cf4ab0a-0396-48f4-becb-558ea795da52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '159b5e9e92214dde8b40c672e314e252'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:33.661339 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1025/2040] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:33 2021] DELETE /identity/v3/users/159b5e9e92214dde8b40c672e314e252 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:39:33.661339 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4ab0a-0396-48f4-becb-558ea795da52 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:33.661339 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-0cf4ab0a-0396-48f4-becb-558ea795da52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:33.663493 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9d7d7-fb2c-42b2-91b6-4243c47a8ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:33.664335 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9d7d7-fb2c-42b2-91b6-4243c47a8ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:33.664717 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9d7d7-fb2c-42b2-91b6-4243c47a8ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:33.665094 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9d7d7-fb2c-42b2-91b6-4243c47a8ad4 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:33.665963 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9d7d7-fb2c-42b2-91b6-4243c47a8ad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:33.668933 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9d7d7-fb2c-42b2-91b6-4243c47a8ad4 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:33.707647 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1016/2041] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:39:33 2021] POST /identity/v3/users => generated 284 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:33.708599 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9d7d7-fb2c-42b2-91b6-4243c47a8ad4 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:33.710501 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-33f9d7d7-fb2c-42b2-91b6-4243c47a8ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:33.724257 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9d7d7-fb2c-42b2-91b6-4243c47a8ad4 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:33.762251 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4ab0a-0396-48f4-becb-558ea795da52 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:33.769813 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526da88-ef4f-4fdf-85c5-1bcb0a42df7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:33.772893 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526da88-ef4f-4fdf-85c5-1bcb0a42df7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:33.773377 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526da88-ef4f-4fdf-85c5-1bcb0a42df7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:33.774434 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526da88-ef4f-4fdf-85c5-1bcb0a42df7d admin admin] PATH_INFO: `/v3/projects/6fb2d1c50f634622a80cef8bfd9e2589` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:33.777087 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526da88-ef4f-4fdf-85c5-1bcb0a42df7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fb2d1c50f634622a80cef8bfd9e2589)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:33.780187 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526da88-ef4f-4fdf-85c5-1bcb0a42df7d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:33.815878 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03555642-2a98-4cbc-92c9-c200feb07379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:33.816516 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03555642-2a98-4cbc-92c9-c200feb07379 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:33.816802 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03555642-2a98-4cbc-92c9-c200feb07379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:33.817233 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03555642-2a98-4cbc-92c9-c200feb07379 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:33.817966 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03555642-2a98-4cbc-92c9-c200feb07379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:33.819840 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03555642-2a98-4cbc-92c9-c200feb07379 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:33.831475 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1017/2042] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:33 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:33.836043 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03555642-2a98-4cbc-92c9-c200feb07379 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:33.843497 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-c526da88-ef4f-4fdf-85c5-1bcb0a42df7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fb2d1c50f634622a80cef8bfd9e2589', 'request_id': 'req-c526da88-ef4f-4fdf-85c5-1bcb0a42df7d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:33.848343 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03555642-2a98-4cbc-92c9-c200feb07379 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:33.851635 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-c526da88-ef4f-4fdf-85c5-1bcb0a42df7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fb2d1c50f634622a80cef8bfd9e2589', 'request_id': 'req-c526da88-ef4f-4fdf-85c5-1bcb0a42df7d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:33.860196 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-c526da88-ef4f-4fdf-85c5-1bcb0a42df7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fb2d1c50f634622a80cef8bfd9e2589', 'request_id': 'req-c526da88-ef4f-4fdf-85c5-1bcb0a42df7d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:33.885689 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-c526da88-ef4f-4fdf-85c5-1bcb0a42df7d admin admin] The token cache is being invalidate because project 6fb2d1c50f634622a80cef8bfd9e2589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:33.886310 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-c526da88-ef4f-4fdf-85c5-1bcb0a42df7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:33.887093 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-c526da88-ef4f-4fdf-85c5-1bcb0a42df7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:33.890055 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1026/2043] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:33 2021] DELETE /identity/v3/projects/6fb2d1c50f634622a80cef8bfd9e2589 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:33.900779 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21f929-f567-4cd4-b106-7506a130ad1d None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:33.901096 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21f929-f567-4cd4-b106-7506a130ad1d None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:33.901371 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21f929-f567-4cd4-b106-7506a130ad1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:33.923464 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-0f21f929-f567-4cd4-b106-7506a130ad1d None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:33.924896 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-0f21f929-f567-4cd4-b106-7506a130ad1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:33.943669 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd96d8-e178-4f10-a49c-5b672d866f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:33.944494 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd96d8-e178-4f10-a49c-5b672d866f65 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:33.944778 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd96d8-e178-4f10-a49c-5b672d866f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:33.945050 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd96d8-e178-4f10-a49c-5b672d866f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:33.945776 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd96d8-e178-4f10-a49c-5b672d866f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:33.947458 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd96d8-e178-4f10-a49c-5b672d866f65 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:33.958904 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1018/2044] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:33 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:39:33.963475 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd96d8-e178-4f10-a49c-5b672d866f65 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:33.965725 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-36dd96d8-e178-4f10-a49c-5b672d866f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:33.980982 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd96d8-e178-4f10-a49c-5b672d866f65 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:33.987573 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012f77c-d54a-4d3c-866f-ef6bf58d4453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:33.989420 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012f77c-d54a-4d3c-866f-ef6bf58d4453 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:33.989617 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012f77c-d54a-4d3c-866f-ef6bf58d4453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:33.989887 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012f77c-d54a-4d3c-866f-ef6bf58d4453 admin admin] PATH_INFO: `/v3/projects/dff99176871c4ff3b7835d6c0c8c6044/users/492897b4e91f41179c30e9fc1324fbe1/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:33.997624 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1027/2045] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:34.001000 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21f929-f567-4cd4-b106-7506a130ad1d None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:34.005755 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-0f21f929-f567-4cd4-b106-7506a130ad1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:34.013128 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012f77c-d54a-4d3c-866f-ef6bf58d4453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dff99176871c4ff3b7835d6c0c8c6044, user_id=492897b4e91f41179c30e9fc1324fbe1, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:34.015862 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012f77c-d54a-4d3c-866f-ef6bf58d4453 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:34.018882 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21f929-f567-4cd4-b106-7506a130ad1d None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:34.026276 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d4b9f-18cf-40b0-a17a-c60bf5e4f751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:34.027423 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d4b9f-18cf-40b0-a17a-c60bf5e4f751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:34.027804 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d4b9f-18cf-40b0-a17a-c60bf5e4f751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:34.028088 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d4b9f-18cf-40b0-a17a-c60bf5e4f751 admin admin] PATH_INFO: `/v3/users/8cb193c90c19452e827a30917592e7ce` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:34.029371 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d4b9f-18cf-40b0-a17a-c60bf5e4f751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cb193c90c19452e827a30917592e7ce)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:34.031198 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1019/2046] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:33 2021] PUT /identity/v3/projects/dff99176871c4ff3b7835d6c0c8c6044/users/492897b4e91f41179c30e9fc1324fbe1/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:39:34.033029 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fd5f9-b539-4f6a-9a1b-957e069b91fc None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:34.033469 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fd5f9-b539-4f6a-9a1b-957e069b91fc None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:34.033951 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fd5f9-b539-4f6a-9a1b-957e069b91fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:34.035786 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d4b9f-18cf-40b0-a17a-c60bf5e4f751 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:34.054387 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-427fd5f9-b539-4f6a-9a1b-957e069b91fc None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:34.055609 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-427fd5f9-b539-4f6a-9a1b-957e069b91fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:34.100918 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-102d4b9f-18cf-40b0-a17a-c60bf5e4f751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cb193c90c19452e827a30917592e7ce'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:34.113610 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-102d4b9f-18cf-40b0-a17a-c60bf5e4f751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cb193c90c19452e827a30917592e7ce'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:34.122555 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-102d4b9f-18cf-40b0-a17a-c60bf5e4f751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cb193c90c19452e827a30917592e7ce'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:34.123861 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-102d4b9f-18cf-40b0-a17a-c60bf5e4f751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cb193c90c19452e827a30917592e7ce'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:34.124978 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1020/2047] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:34.126774 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf70246-d640-4e59-81c8-91634963d79b None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:34.127059 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf70246-d640-4e59-81c8-91634963d79b None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:34.127332 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf70246-d640-4e59-81c8-91634963d79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:34.134470 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-102d4b9f-18cf-40b0-a17a-c60bf5e4f751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cb193c90c19452e827a30917592e7ce'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:34.140551 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1028/2048] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:34 2021] DELETE /identity/v3/users/8cb193c90c19452e827a30917592e7ce => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:34.141332 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d4b9f-18cf-40b0-a17a-c60bf5e4f751 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:34.142654 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-102d4b9f-18cf-40b0-a17a-c60bf5e4f751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:34.156158 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-acf70246-d640-4e59-81c8-91634963d79b None None] MFA Rules not processed for user `492897b4e91f41179c30e9fc1324fbe1`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:34.157473 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-acf70246-d640-4e59-81c8-91634963d79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:34.210535 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d4b9f-18cf-40b0-a17a-c60bf5e4f751 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:34.216659 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91a352-8015-4ffb-a4b6-5e199240979d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:34.217591 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91a352-8015-4ffb-a4b6-5e199240979d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:34.218019 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91a352-8015-4ffb-a4b6-5e199240979d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:34.218371 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91a352-8015-4ffb-a4b6-5e199240979d admin admin] PATH_INFO: `/v3/projects/f03154ea90424e0fa6f5c9276a55433a` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:34.219736 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91a352-8015-4ffb-a4b6-5e199240979d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f03154ea90424e0fa6f5c9276a55433a)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:34.221928 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91a352-8015-4ffb-a4b6-5e199240979d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:34.231652 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1021/2049] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:34 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:34.232051 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf70246-d640-4e59-81c8-91634963d79b None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:34.236482 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-acf70246-d640-4e59-81c8-91634963d79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:34.249312 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf70246-d640-4e59-81c8-91634963d79b None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:34.254181 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460eb7e-86f0-430f-aea4-95e6fca86fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:34.254843 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460eb7e-86f0-430f-aea4-95e6fca86fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:34.255129 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460eb7e-86f0-430f-aea4-95e6fca86fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:34.255398 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460eb7e-86f0-430f-aea4-95e6fca86fa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:34.256178 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460eb7e-86f0-430f-aea4-95e6fca86fa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:39:34.256490 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460eb7e-86f0-430f-aea4-95e6fca86fa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:34.258094 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460eb7e-86f0-430f-aea4-95e6fca86fa8 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:34.271758 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1022/2050] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:39:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:39:34.271758 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cc678-67a6-457a-8350-c1ceddf242a7 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:34.272104 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cc678-67a6-457a-8350-c1ceddf242a7 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:34.272451 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cc678-67a6-457a-8350-c1ceddf242a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:34.291980 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-3a9cc678-67a6-457a-8350-c1ceddf242a7 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:34.293195 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-3a9cc678-67a6-457a-8350-c1ceddf242a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:34.295129 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8e91a352-8015-4ffb-a4b6-5e199240979d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f03154ea90424e0fa6f5c9276a55433a', 'request_id': 'req-8e91a352-8015-4ffb-a4b6-5e199240979d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:34.302423 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8e91a352-8015-4ffb-a4b6-5e199240979d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f03154ea90424e0fa6f5c9276a55433a', 'request_id': 'req-8e91a352-8015-4ffb-a4b6-5e199240979d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:34.310957 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8e91a352-8015-4ffb-a4b6-5e199240979d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f03154ea90424e0fa6f5c9276a55433a', 'request_id': 'req-8e91a352-8015-4ffb-a4b6-5e199240979d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:34.326829 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8e91a352-8015-4ffb-a4b6-5e199240979d admin admin] The token cache is being invalidate because project f03154ea90424e0fa6f5c9276a55433a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:34.327114 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8e91a352-8015-4ffb-a4b6-5e199240979d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:34.327839 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8e91a352-8015-4ffb-a4b6-5e199240979d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:34.329458 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1029/2051] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:34 2021] DELETE /identity/v3/projects/f03154ea90424e0fa6f5c9276a55433a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:34.330566 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91a352-8015-4ffb-a4b6-5e199240979d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:34.336407 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-8e91a352-8015-4ffb-a4b6-5e199240979d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:34.367179 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1023/2052] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:34.368147 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cc678-67a6-457a-8350-c1ceddf242a7 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:34.370908 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-3a9cc678-67a6-457a-8350-c1ceddf242a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:34.384044 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cc678-67a6-457a-8350-c1ceddf242a7 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:34.389129 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8ee45-daf2-439b-b627-d1c65bd45430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:34.389869 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8ee45-daf2-439b-b627-d1c65bd45430 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:34.390224 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8ee45-daf2-439b-b627-d1c65bd45430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:34.390566 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8ee45-daf2-439b-b627-d1c65bd45430 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:34.391333 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8ee45-daf2-439b-b627-d1c65bd45430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:34.393377 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8ee45-daf2-439b-b627-d1c65bd45430 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:34.410143 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91a352-8015-4ffb-a4b6-5e199240979d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:34.415608 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b35f7-9269-4fa1-a881-7734e9e4fab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:34.417550 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b35f7-9269-4fa1-a881-7734e9e4fab3 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:34.417550 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b35f7-9269-4fa1-a881-7734e9e4fab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:34.417550 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b35f7-9269-4fa1-a881-7734e9e4fab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:34.418081 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b35f7-9269-4fa1-a881-7734e9e4fab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:34.420011 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b35f7-9269-4fa1-a881-7734e9e4fab3 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:34.426988 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1024/2053] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:39:34 2021] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:34.428865 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427b2d4-a4ab-4061-9ab5-74e614952a86 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:34.429309 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427b2d4-a4ab-4061-9ab5-74e614952a86 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:34.429421 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427b2d4-a4ab-4061-9ab5-74e614952a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:34.448697 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1030/2054] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:39:34 2021] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:34.449907 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b35f7-9269-4fa1-a881-7734e9e4fab3 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:34.451196 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-d427b2d4-a4ab-4061-9ab5-74e614952a86 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:34.452116 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-a72b35f7-9269-4fa1-a881-7734e9e4fab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:34.452758 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d427b2d4-a4ab-4061-9ab5-74e614952a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:34.514637 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b35f7-9269-4fa1-a881-7734e9e4fab3 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:34.517521 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1025/2055] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:34.518314 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9128ef-34bf-4784-b8e2-37b94214c56b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:34.518960 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9128ef-34bf-4784-b8e2-37b94214c56b service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:34.519240 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9128ef-34bf-4784-b8e2-37b94214c56b service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:34.519524 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9128ef-34bf-4784-b8e2-37b94214c56b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:34.524353 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427b2d4-a4ab-4061-9ab5-74e614952a86 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:34.529841 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9128ef-34bf-4784-b8e2-37b94214c56b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:34.531278 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9128ef-34bf-4784-b8e2-37b94214c56b service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:34.534070 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427b2d4-a4ab-4061-9ab5-74e614952a86 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:34.539410 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145450e-d854-4074-b300-3489398273e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:34.540097 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145450e-d854-4074-b300-3489398273e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:34.540374 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145450e-d854-4074-b300-3489398273e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:34.540646 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145450e-d854-4074-b300-3489398273e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:34.541408 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145450e-d854-4074-b300-3489398273e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:34.541976 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1031/2056] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:34.542727 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9128ef-34bf-4784-b8e2-37b94214c56b service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:34.543320 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145450e-d854-4074-b300-3489398273e9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:34.553762 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9128ef-34bf-4784-b8e2-37b94214c56b service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:34.565833 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1281dd-10ee-4844-9bfd-9264247cdb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:34.566280 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1281dd-10ee-4844-9bfd-9264247cdb9d admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:34.566564 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1281dd-10ee-4844-9bfd-9264247cdb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:34.566841 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1281dd-10ee-4844-9bfd-9264247cdb9d admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:34.567538 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1281dd-10ee-4844-9bfd-9264247cdb9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:34.569818 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1281dd-10ee-4844-9bfd-9264247cdb9d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:34.574804 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1026/2057] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:39:34 2021] POST /identity/v3/users => generated 288 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:34.576853 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f96f9-2326-4e54-8042-d7fdabb84e7a None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:34.577302 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f96f9-2326-4e54-8042-d7fdabb84e7a None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:34.578196 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f96f9-2326-4e54-8042-d7fdabb84e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:34.600273 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1032/2058] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:39:34 2021] POST /identity/v3/users => generated 290 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:34.603320 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1281dd-10ee-4844-9bfd-9264247cdb9d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:34.616639 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1281dd-10ee-4844-9bfd-9264247cdb9d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:34.617543 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-d98f96f9-2326-4e54-8042-d7fdabb84e7a None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:34.620019 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d98f96f9-2326-4e54-8042-d7fdabb84e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:34.622815 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b281bc-7032-495d-906c-e2fa90b07953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:34.623603 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b281bc-7032-495d-906c-e2fa90b07953 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:34.623918 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b281bc-7032-495d-906c-e2fa90b07953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:34.624244 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b281bc-7032-495d-906c-e2fa90b07953 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:34.625204 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b281bc-7032-495d-906c-e2fa90b07953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:34.626967 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b281bc-7032-495d-906c-e2fa90b07953 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:34.628905 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1027/2059] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:34.629744 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f96f9-2326-4e54-8042-d7fdabb84e7a None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:34.640799 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f96f9-2326-4e54-8042-d7fdabb84e7a None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:34.644820 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1033/2060] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:34 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:34.645675 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b281bc-7032-495d-906c-e2fa90b07953 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:34.651007 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3644e4-38d4-4f80-921f-fff3cb7babce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:34.652480 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3644e4-38d4-4f80-921f-fff3cb7babce admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:34.652933 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3644e4-38d4-4f80-921f-fff3cb7babce admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:34.653303 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3644e4-38d4-4f80-921f-fff3cb7babce admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:34.654150 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3644e4-38d4-4f80-921f-fff3cb7babce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:34.656240 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3644e4-38d4-4f80-921f-fff3cb7babce admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:34.670130 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b281bc-7032-495d-906c-e2fa90b07953 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:34.670935 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1028/2061] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:34 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:34.671890 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3644e4-38d4-4f80-921f-fff3cb7babce admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:34.680996 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c8f99-56b7-4445-9f4a-e68f5b191718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:34.681474 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c8f99-56b7-4445-9f4a-e68f5b191718 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:34.682294 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c8f99-56b7-4445-9f4a-e68f5b191718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:34.682589 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c8f99-56b7-4445-9f4a-e68f5b191718 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:34.683301 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c8f99-56b7-4445-9f4a-e68f5b191718 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:39:34.683520 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3644e4-38d4-4f80-921f-fff3cb7babce admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:34.684271 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c8f99-56b7-4445-9f4a-e68f5b191718 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:34.685874 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c8f99-56b7-4445-9f4a-e68f5b191718 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:34.689313 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d6847-f325-4f39-8b19-1eab2b013ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:34.690240 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d6847-f325-4f39-8b19-1eab2b013ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:34.690377 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d6847-f325-4f39-8b19-1eab2b013ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:34.690703 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d6847-f325-4f39-8b19-1eab2b013ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:34.692151 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d6847-f325-4f39-8b19-1eab2b013ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:34.693869 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d6847-f325-4f39-8b19-1eab2b013ef8 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:34.706013 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1029/2062] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:34 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:34.706013 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d6847-f325-4f39-8b19-1eab2b013ef8 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:34.711598 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1034/2063] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:39:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:39:34.721294 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c8f99-56b7-4445-9f4a-e68f5b191718 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:34.722777 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d6847-f325-4f39-8b19-1eab2b013ef8 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:34.728776 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37cc29-94b6-4573-bcd9-dfdc0a74c044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:34.729641 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37cc29-94b6-4573-bcd9-dfdc0a74c044 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:34.729949 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37cc29-94b6-4573-bcd9-dfdc0a74c044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:34.730218 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37cc29-94b6-4573-bcd9-dfdc0a74c044 admin admin] PATH_INFO: `/v3/projects/4894ed4be5c543749b908a61c31561e9/users/1f13a848db1e4864a8832478fa8219f3/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:34.733034 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c8f99-56b7-4445-9f4a-e68f5b191718 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:34.743469 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bafddf-c0cd-4266-8d2a-357703e9479f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:34.746170 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37cc29-94b6-4573-bcd9-dfdc0a74c044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4894ed4be5c543749b908a61c31561e9, user_id=1f13a848db1e4864a8832478fa8219f3, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:34.746854 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bafddf-c0cd-4266-8d2a-357703e9479f admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:34.747628 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bafddf-c0cd-4266-8d2a-357703e9479f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:34.748027 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bafddf-c0cd-4266-8d2a-357703e9479f admin admin] PATH_INFO: `/v3/projects/ad8a39e369044619b6586289e3f7e477/users/de5af1fd00e44cac8cc30236ba302b57/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:34.748958 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37cc29-94b6-4573-bcd9-dfdc0a74c044 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:34.764459 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1030/2064] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:34 2021] PUT /identity/v3/projects/4894ed4be5c543749b908a61c31561e9/users/1f13a848db1e4864a8832478fa8219f3/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:34.765532 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37cc29-94b6-4573-bcd9-dfdc0a74c044 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:34.770781 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bafddf-c0cd-4266-8d2a-357703e9479f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad8a39e369044619b6586289e3f7e477, user_id=de5af1fd00e44cac8cc30236ba302b57, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:34.775577 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bafddf-c0cd-4266-8d2a-357703e9479f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:34.797111 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1035/2065] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:34 2021] PUT /identity/v3/projects/ad8a39e369044619b6586289e3f7e477/users/de5af1fd00e44cac8cc30236ba302b57/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:34.798240 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bafddf-c0cd-4266-8d2a-357703e9479f admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:34.848437 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37cc29-94b6-4573-bcd9-dfdc0a74c044 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:34.887994 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bafddf-c0cd-4266-8d2a-357703e9479f admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:34.894270 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5fb99-3099-48eb-9387-0cbfeec1cd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:34.894968 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5fb99-3099-48eb-9387-0cbfeec1cd8f admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:34.895252 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5fb99-3099-48eb-9387-0cbfeec1cd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:34.895530 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5fb99-3099-48eb-9387-0cbfeec1cd8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:34.896308 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5fb99-3099-48eb-9387-0cbfeec1cd8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:34.897909 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5fb99-3099-48eb-9387-0cbfeec1cd8f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:34.911438 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1036/2066] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:34 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:34.917170 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15f2b7-0380-44fd-9e9a-d0fc9cd83118 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:34.917458 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15f2b7-0380-44fd-9e9a-d0fc9cd83118 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:34.917734 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15f2b7-0380-44fd-9e9a-d0fc9cd83118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:34.921674 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec71bb-cdc6-46fd-b2d6-3bb42327abf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:34.922335 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec71bb-cdc6-46fd-b2d6-3bb42327abf5 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:34.922620 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec71bb-cdc6-46fd-b2d6-3bb42327abf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:34.922893 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec71bb-cdc6-46fd-b2d6-3bb42327abf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:34.923641 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec71bb-cdc6-46fd-b2d6-3bb42327abf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:34.925531 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec71bb-cdc6-46fd-b2d6-3bb42327abf5 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:34.959542 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1031/2067] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:39:34 2021] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:34.959542 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec71bb-cdc6-46fd-b2d6-3bb42327abf5 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:34.967001 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-9c15f2b7-0380-44fd-9e9a-d0fc9cd83118 None None] MFA Rules not processed for user `de5af1fd00e44cac8cc30236ba302b57`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:34.968908 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-9c15f2b7-0380-44fd-9e9a-d0fc9cd83118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:35.050822 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec71bb-cdc6-46fd-b2d6-3bb42327abf5 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:35.056263 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253313e-6a21-42e7-95de-9781447b5654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:35.057872 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253313e-6a21-42e7-95de-9781447b5654 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:35.058315 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253313e-6a21-42e7-95de-9781447b5654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:35.058750 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253313e-6a21-42e7-95de-9781447b5654 admin admin] PATH_INFO: `/v3/projects/4894ed4be5c543749b908a61c31561e9/users/1f13a848db1e4864a8832478fa8219f3/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:35.061305 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253313e-6a21-42e7-95de-9781447b5654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4894ed4be5c543749b908a61c31561e9, user_id=1f13a848db1e4864a8832478fa8219f3, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:35.064266 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253313e-6a21-42e7-95de-9781447b5654 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:35.068753 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1037/2068] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:34 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:35.069569 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15f2b7-0380-44fd-9e9a-d0fc9cd83118 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:35.075579 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1032/2069] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:34 2021] PUT /identity/v3/projects/4894ed4be5c543749b908a61c31561e9/users/1f13a848db1e4864a8832478fa8219f3/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:35.080555 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253313e-6a21-42e7-95de-9781447b5654 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:35.087020 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-9253313e-6a21-42e7-95de-9781447b5654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:35.088661 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15f2b7-0380-44fd-9e9a-d0fc9cd83118 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:35.152514 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358802f-257e-4a3f-9d67-8778ce228172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:35.153184 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358802f-257e-4a3f-9d67-8778ce228172 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:35.153466 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358802f-257e-4a3f-9d67-8778ce228172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:35.153740 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358802f-257e-4a3f-9d67-8778ce228172 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:35.154434 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358802f-257e-4a3f-9d67-8778ce228172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:35.156393 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358802f-257e-4a3f-9d67-8778ce228172 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:35.160896 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253313e-6a21-42e7-95de-9781447b5654 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:35.165566 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698944b2-370b-4679-b964-ad4090c95743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:35.166930 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698944b2-370b-4679-b964-ad4090c95743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:35.167286 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698944b2-370b-4679-b964-ad4090c95743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:35.167660 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698944b2-370b-4679-b964-ad4090c95743 admin admin] PATH_INFO: `/v3/projects/752566614b4e4c1091719abe4bcc37c8` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:35.169151 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698944b2-370b-4679-b964-ad4090c95743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=752566614b4e4c1091719abe4bcc37c8)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:35.171361 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698944b2-370b-4679-b964-ad4090c95743 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:35.176152 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1038/2070] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:39:35 2021] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:35.176964 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358802f-257e-4a3f-9d67-8778ce228172 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:35.178544 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-4358802f-257e-4a3f-9d67-8778ce228172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:35.220458 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-698944b2-370b-4679-b964-ad4090c95743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '752566614b4e4c1091719abe4bcc37c8', 'request_id': 'req-698944b2-370b-4679-b964-ad4090c95743'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:35.226607 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-698944b2-370b-4679-b964-ad4090c95743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '752566614b4e4c1091719abe4bcc37c8', 'request_id': 'req-698944b2-370b-4679-b964-ad4090c95743'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:35.233058 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-698944b2-370b-4679-b964-ad4090c95743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '752566614b4e4c1091719abe4bcc37c8', 'request_id': 'req-698944b2-370b-4679-b964-ad4090c95743'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:35.236641 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358802f-257e-4a3f-9d67-8778ce228172 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:35.245708 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-698944b2-370b-4679-b964-ad4090c95743 admin admin] The token cache is being invalidate because project 752566614b4e4c1091719abe4bcc37c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:35.246006 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-698944b2-370b-4679-b964-ad4090c95743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:35.246685 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-698944b2-370b-4679-b964-ad4090c95743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:35.248298 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1033/2071] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:35 2021] DELETE /identity/v3/projects/752566614b4e4c1091719abe4bcc37c8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:35.249519 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a267d72-08b8-42f1-b38c-dba3a448bf6c None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:35.249803 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a267d72-08b8-42f1-b38c-dba3a448bf6c None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:35.250081 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a267d72-08b8-42f1-b38c-dba3a448bf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:35.276071 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-9a267d72-08b8-42f1-b38c-dba3a448bf6c None None] MFA Rules not processed for user `1f13a848db1e4864a8832478fa8219f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:35.277318 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-9a267d72-08b8-42f1-b38c-dba3a448bf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:35.287873 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ac9db-3e7c-4279-ac06-073decb66dee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:35.288601 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ac9db-3e7c-4279-ac06-073decb66dee service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:35.288892 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ac9db-3e7c-4279-ac06-073decb66dee service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:35.289171 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ac9db-3e7c-4279-ac06-073decb66dee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:35.291414 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-888ac9db-3e7c-4279-ac06-073decb66dee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:35.348236 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1034/2072] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:35 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:35.349242 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a267d72-08b8-42f1-b38c-dba3a448bf6c None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:35.350695 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ac9db-3e7c-4279-ac06-073decb66dee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:35.351178 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-9a267d72-08b8-42f1-b38c-dba3a448bf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:35.352393 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ac9db-3e7c-4279-ac06-073decb66dee service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:35.361957 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1039/2073] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:35 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:35.362874 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ac9db-3e7c-4279-ac06-073decb66dee service cinder] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:35.364410 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-888ac9db-3e7c-4279-ac06-073decb66dee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:35.422036 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a267d72-08b8-42f1-b38c-dba3a448bf6c None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:35.432958 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e21793-2efd-4991-ab86-4c47a468792e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:35.434056 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e21793-2efd-4991-ab86-4c47a468792e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:35.434507 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e21793-2efd-4991-ab86-4c47a468792e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:35.434890 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e21793-2efd-4991-ab86-4c47a468792e admin admin] PATH_INFO: `/v3/users/8e8c979ab68548b082f33bfb215c7713` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:35.436533 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e21793-2efd-4991-ab86-4c47a468792e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e8c979ab68548b082f33bfb215c7713)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:35.438580 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e21793-2efd-4991-ab86-4c47a468792e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:35.441357 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ac9db-3e7c-4279-ac06-073decb66dee service cinder] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:35.449058 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5a325-8743-42d4-90ab-b268af7d6ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:35.449940 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5a325-8743-42d4-90ab-b268af7d6ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:35.450904 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5a325-8743-42d4-90ab-b268af7d6ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:35.451192 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5a325-8743-42d4-90ab-b268af7d6ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:35.452479 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5a325-8743-42d4-90ab-b268af7d6ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:35.454190 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5a325-8743-42d4-90ab-b268af7d6ea4 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:35.465675 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1040/2074] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:35 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:35.466626 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5a325-8743-42d4-90ab-b268af7d6ea4 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:35.477626 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-b4b5a325-8743-42d4-90ab-b268af7d6ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:35.496279 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5a325-8743-42d4-90ab-b268af7d6ea4 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:35.500430 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-58e21793-2efd-4991-ab86-4c47a468792e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e8c979ab68548b082f33bfb215c7713'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:35.501784 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ce84f-a3b1-4936-8e83-515d18169dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:35.502695 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ce84f-a3b1-4936-8e83-515d18169dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:35.502977 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ce84f-a3b1-4936-8e83-515d18169dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:35.503253 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ce84f-a3b1-4936-8e83-515d18169dd5 admin admin] PATH_INFO: `/v3/users/fd94e2218e3f4e9182c82451b198062f` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:35.504519 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ce84f-a3b1-4936-8e83-515d18169dd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd94e2218e3f4e9182c82451b198062f)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:35.506449 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ce84f-a3b1-4936-8e83-515d18169dd5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:35.513891 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-58e21793-2efd-4991-ab86-4c47a468792e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e8c979ab68548b082f33bfb215c7713'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:35.522901 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-58e21793-2efd-4991-ab86-4c47a468792e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e8c979ab68548b082f33bfb215c7713'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:35.523642 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-58e21793-2efd-4991-ab86-4c47a468792e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e8c979ab68548b082f33bfb215c7713'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:35.531933 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-58e21793-2efd-4991-ab86-4c47a468792e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e8c979ab68548b082f33bfb215c7713'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:35.540588 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1035/2075] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:35 2021] DELETE /identity/v3/users/8e8c979ab68548b082f33bfb215c7713 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:35.540851 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e21793-2efd-4991-ab86-4c47a468792e admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:35.542923 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-58e21793-2efd-4991-ab86-4c47a468792e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:35.556228 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-766ce84f-a3b1-4936-8e83-515d18169dd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd94e2218e3f4e9182c82451b198062f'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:35.571716 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-766ce84f-a3b1-4936-8e83-515d18169dd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd94e2218e3f4e9182c82451b198062f'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:35.581287 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-766ce84f-a3b1-4936-8e83-515d18169dd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd94e2218e3f4e9182c82451b198062f'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:35.581956 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-766ce84f-a3b1-4936-8e83-515d18169dd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd94e2218e3f4e9182c82451b198062f'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:35.593231 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-766ce84f-a3b1-4936-8e83-515d18169dd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd94e2218e3f4e9182c82451b198062f'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:35.602526 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1041/2076] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:35 2021] DELETE /identity/v3/users/fd94e2218e3f4e9182c82451b198062f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:35.603116 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ce84f-a3b1-4936-8e83-515d18169dd5 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:35.605368 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-766ce84f-a3b1-4936-8e83-515d18169dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:35.629104 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e21793-2efd-4991-ab86-4c47a468792e admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:35.711443 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ce84f-a3b1-4936-8e83-515d18169dd5 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:35.711658 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37edc2a3-9f86-458f-af31-876cbb7ecc7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:35.712170 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edc2a3-9f86-458f-af31-876cbb7ecc7f service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:35.712526 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edc2a3-9f86-458f-af31-876cbb7ecc7f service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:35.716608 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edc2a3-9f86-458f-af31-876cbb7ecc7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:35.719035 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d216dec-3a9c-461e-885b-5cf6fdb7c2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:35.719802 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d216dec-3a9c-461e-885b-5cf6fdb7c2ab admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:35.720497 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d216dec-3a9c-461e-885b-5cf6fdb7c2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:35.721424 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-37edc2a3-9f86-458f-af31-876cbb7ecc7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:35.721574 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d216dec-3a9c-461e-885b-5cf6fdb7c2ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:35.723507 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d216dec-3a9c-461e-885b-5cf6fdb7c2ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:35.725990 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d216dec-3a9c-461e-885b-5cf6fdb7c2ab admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:35.759293 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1042/2077] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:35 2021] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:35.763108 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d216dec-3a9c-461e-885b-5cf6fdb7c2ab admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:35.764236 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-3d216dec-3a9c-461e-885b-5cf6fdb7c2ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:35.788307 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d216dec-3a9c-461e-885b-5cf6fdb7c2ab admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:35.793999 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d672cd-c0a8-490f-9443-6b8f9b421c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:35.795338 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d672cd-c0a8-490f-9443-6b8f9b421c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:35.795544 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d672cd-c0a8-490f-9443-6b8f9b421c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:35.796034 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d672cd-c0a8-490f-9443-6b8f9b421c2f admin admin] PATH_INFO: `/v3/projects/0e3771e448cc4b798d048ac3fa182787` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:35.797230 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d672cd-c0a8-490f-9443-6b8f9b421c2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e3771e448cc4b798d048ac3fa182787)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:35.799715 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d672cd-c0a8-490f-9443-6b8f9b421c2f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:35.849910 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37edc2a3-9f86-458f-af31-876cbb7ecc7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:35.851892 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37edc2a3-9f86-458f-af31-876cbb7ecc7f service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:35.866079 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1036/2078] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:35 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:35.866986 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37edc2a3-9f86-458f-af31-876cbb7ecc7f service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:35.882693 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37edc2a3-9f86-458f-af31-876cbb7ecc7f service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:35.891755 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56521211-8b0b-4c37-b807-4e4bd5d13804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:35.892822 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56521211-8b0b-4c37-b807-4e4bd5d13804 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:35.893529 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56521211-8b0b-4c37-b807-4e4bd5d13804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:35.893809 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56521211-8b0b-4c37-b807-4e4bd5d13804 admin admin] PATH_INFO: `/v3/projects/eaa6dcdca23049f3bdd48fd73d70311f/users/d6b7b7e0a200461a8a8039dea2c45bbf/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:35.914509 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56521211-8b0b-4c37-b807-4e4bd5d13804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa6dcdca23049f3bdd48fd73d70311f, user_id=d6b7b7e0a200461a8a8039dea2c45bbf, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:35.918598 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56521211-8b0b-4c37-b807-4e4bd5d13804 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:35.919831 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d6d672cd-c0a8-490f-9443-6b8f9b421c2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e3771e448cc4b798d048ac3fa182787', 'request_id': 'req-d6d672cd-c0a8-490f-9443-6b8f9b421c2f'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:35.927530 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d6d672cd-c0a8-490f-9443-6b8f9b421c2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e3771e448cc4b798d048ac3fa182787', 'request_id': 'req-d6d672cd-c0a8-490f-9443-6b8f9b421c2f'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:35.934382 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d6d672cd-c0a8-490f-9443-6b8f9b421c2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e3771e448cc4b798d048ac3fa182787', 'request_id': 'req-d6d672cd-c0a8-490f-9443-6b8f9b421c2f'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:35.938191 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1037/2079] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:35 2021] PUT /identity/v3/projects/eaa6dcdca23049f3bdd48fd73d70311f/users/d6b7b7e0a200461a8a8039dea2c45bbf/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:35.949426 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc14dfb-8163-4c8a-865d-e9e71ac14306 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:35.949704 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc14dfb-8163-4c8a-865d-e9e71ac14306 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:35.949993 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc14dfb-8163-4c8a-865d-e9e71ac14306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:36.001238 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d6d672cd-c0a8-490f-9443-6b8f9b421c2f admin admin] The token cache is being invalidate because project 0e3771e448cc4b798d048ac3fa182787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:36.002029 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d6d672cd-c0a8-490f-9443-6b8f9b421c2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:36.003594 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d6d672cd-c0a8-490f-9443-6b8f9b421c2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:36.005934 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1043/2080] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:35 2021] DELETE /identity/v3/projects/0e3771e448cc4b798d048ac3fa182787 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:36.015110 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f5547-5f8c-4e7f-8ff7-03ead5007754 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:36.015497 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f5547-5f8c-4e7f-8ff7-03ead5007754 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:36.015871 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f5547-5f8c-4e7f-8ff7-03ead5007754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:36.016994 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-3dc14dfb-8163-4c8a-865d-e9e71ac14306 None None] MFA Rules not processed for user `d6b7b7e0a200461a8a8039dea2c45bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:36.018201 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-3dc14dfb-8163-4c8a-865d-e9e71ac14306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:36.039240 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-4f3f5547-5f8c-4e7f-8ff7-03ead5007754 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:36.040511 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-4f3f5547-5f8c-4e7f-8ff7-03ead5007754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:36.097255 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1038/2081] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:35 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:36.100992 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc14dfb-8163-4c8a-865d-e9e71ac14306 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:36.101965 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-3dc14dfb-8163-4c8a-865d-e9e71ac14306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:36.119301 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1044/2082] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:36.120211 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f5547-5f8c-4e7f-8ff7-03ead5007754 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:36.121479 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-4f3f5547-5f8c-4e7f-8ff7-03ead5007754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:36.133331 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f5547-5f8c-4e7f-8ff7-03ead5007754 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:36.140038 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40255853-fa54-485c-9069-91a0381b9fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:36.141279 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40255853-fa54-485c-9069-91a0381b9fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:36.141657 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40255853-fa54-485c-9069-91a0381b9fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:36.142025 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40255853-fa54-485c-9069-91a0381b9fa8 admin admin] PATH_INFO: `/v3/projects/4f8cd2cfb8474b44848919b7557d33a7` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:36.143331 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40255853-fa54-485c-9069-91a0381b9fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f8cd2cfb8474b44848919b7557d33a7)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:36.145450 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40255853-fa54-485c-9069-91a0381b9fa8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:36.173165 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc14dfb-8163-4c8a-865d-e9e71ac14306 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:36.177658 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b3d1b-5f49-4854-b444-ce65c21a95f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:36.178302 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b3d1b-5f49-4854-b444-ce65c21a95f0 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:36.178766 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b3d1b-5f49-4854-b444-ce65c21a95f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:36.179045 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b3d1b-5f49-4854-b444-ce65c21a95f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:36.182167 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e49b3d1b-5f49-4854-b444-ce65c21a95f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:36.195471 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-40255853-fa54-485c-9069-91a0381b9fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f8cd2cfb8474b44848919b7557d33a7', 'request_id': 'req-40255853-fa54-485c-9069-91a0381b9fa8'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:36.201817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-40255853-fa54-485c-9069-91a0381b9fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f8cd2cfb8474b44848919b7557d33a7', 'request_id': 'req-40255853-fa54-485c-9069-91a0381b9fa8'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:36.207475 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-40255853-fa54-485c-9069-91a0381b9fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f8cd2cfb8474b44848919b7557d33a7', 'request_id': 'req-40255853-fa54-485c-9069-91a0381b9fa8'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:36.222959 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-40255853-fa54-485c-9069-91a0381b9fa8 admin admin] The token cache is being invalidate because project 4f8cd2cfb8474b44848919b7557d33a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:36.223220 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-40255853-fa54-485c-9069-91a0381b9fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:36.223988 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-40255853-fa54-485c-9069-91a0381b9fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:36.225798 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1045/2083] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:36 2021] DELETE /identity/v3/projects/4f8cd2cfb8474b44848919b7557d33a7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:36.226574 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40255853-fa54-485c-9069-91a0381b9fa8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:36.227936 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-40255853-fa54-485c-9069-91a0381b9fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:36.253202 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b3d1b-5f49-4854-b444-ce65c21a95f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:36.254641 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b3d1b-5f49-4854-b444-ce65c21a95f0 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:36.263791 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1039/2084] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:36 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:36.264876 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0fd72-ca0d-46aa-90fc-466968731051 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:36.265162 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0fd72-ca0d-46aa-90fc-466968731051 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:36.265443 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0fd72-ca0d-46aa-90fc-466968731051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:36.286187 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-5ba0fd72-ca0d-46aa-90fc-466968731051 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:36.287404 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-5ba0fd72-ca0d-46aa-90fc-466968731051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:36.317983 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40255853-fa54-485c-9069-91a0381b9fa8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:36.326750 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76714933-ff35-4fc4-99a0-c43bbf5a9789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:36.327493 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76714933-ff35-4fc4-99a0-c43bbf5a9789 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:36.327890 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76714933-ff35-4fc4-99a0-c43bbf5a9789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:36.328245 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76714933-ff35-4fc4-99a0-c43bbf5a9789 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:36.329099 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76714933-ff35-4fc4-99a0-c43bbf5a9789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:36.331108 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76714933-ff35-4fc4-99a0-c43bbf5a9789 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:36.358974 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1040/2085] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:36.361272 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677373d-dd8d-4f28-b1e7-7ab6e0ea33d3 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:36.361566 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677373d-dd8d-4f28-b1e7-7ab6e0ea33d3 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:36.361847 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677373d-dd8d-4f28-b1e7-7ab6e0ea33d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:36.371930 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1046/2086] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:39:36 2021] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:36.371930 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76714933-ff35-4fc4-99a0-c43bbf5a9789 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:36.382278 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-b677373d-dd8d-4f28-b1e7-7ab6e0ea33d3 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:36.383552 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-b677373d-dd8d-4f28-b1e7-7ab6e0ea33d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:36.449102 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76714933-ff35-4fc4-99a0-c43bbf5a9789 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:36.454694 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4210c2-9fdc-43b7-ba41-c2c09cac89cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:36.455514 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4210c2-9fdc-43b7-ba41-c2c09cac89cf admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:36.455973 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4210c2-9fdc-43b7-ba41-c2c09cac89cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:36.456274 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4210c2-9fdc-43b7-ba41-c2c09cac89cf admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:36.457024 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4210c2-9fdc-43b7-ba41-c2c09cac89cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:39:36.458664 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4210c2-9fdc-43b7-ba41-c2c09cac89cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:36.459409 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4210c2-9fdc-43b7-ba41-c2c09cac89cf admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:36.471012 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1041/2087] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:36.472458 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677373d-dd8d-4f28-b1e7-7ab6e0ea33d3 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:36.476913 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1047/2088] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:39:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:39:36.477952 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4210c2-9fdc-43b7-ba41-c2c09cac89cf admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:36.488198 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4210c2-9fdc-43b7-ba41-c2c09cac89cf admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:36.492676 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215256a8-c965-4cf2-ace5-08a87ee2a709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:36.493328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215256a8-c965-4cf2-ace5-08a87ee2a709 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:36.493443 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677373d-dd8d-4f28-b1e7-7ab6e0ea33d3 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:36.493630 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215256a8-c965-4cf2-ace5-08a87ee2a709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:36.493881 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215256a8-c965-4cf2-ace5-08a87ee2a709 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:36.495123 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215256a8-c965-4cf2-ace5-08a87ee2a709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:36.497567 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215256a8-c965-4cf2-ace5-08a87ee2a709 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:36.498848 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47edd94-3729-4b49-9a4e-2a333e054df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:36.499665 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47edd94-3729-4b49-9a4e-2a333e054df0 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:36.500104 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47edd94-3729-4b49-9a4e-2a333e054df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:36.500380 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47edd94-3729-4b49-9a4e-2a333e054df0 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:36.501536 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47edd94-3729-4b49-9a4e-2a333e054df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:36.503791 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47edd94-3729-4b49-9a4e-2a333e054df0 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:36.533193 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1042/2089] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:39:36 2021] POST /identity/v3/users => generated 290 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:36.534297 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb7b85-6da7-41a5-88c6-8c29d539d650 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:36.534585 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb7b85-6da7-41a5-88c6-8c29d539d650 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:36.534863 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb7b85-6da7-41a5-88c6-8c29d539d650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:36.559133 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-e8fb7b85-6da7-41a5-88c6-8c29d539d650 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:36.560378 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e8fb7b85-6da7-41a5-88c6-8c29d539d650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:36.564467 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1048/2090] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:39:36 2021] POST /identity/v3/projects => generated 389 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:36.565619 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215256a8-c965-4cf2-ace5-08a87ee2a709 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:36.682454 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215256a8-c965-4cf2-ace5-08a87ee2a709 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:36.690800 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1043/2091] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:36.692106 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb7b85-6da7-41a5-88c6-8c29d539d650 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:36.694618 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd66a49-f23b-4039-8399-4f1b638f43f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:36.695309 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd66a49-f23b-4039-8399-4f1b638f43f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:36.695590 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd66a49-f23b-4039-8399-4f1b638f43f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:36.695891 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd66a49-f23b-4039-8399-4f1b638f43f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:36.696702 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd66a49-f23b-4039-8399-4f1b638f43f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:36.698412 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd66a49-f23b-4039-8399-4f1b638f43f1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:36.705282 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb7b85-6da7-41a5-88c6-8c29d539d650 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:36.709788 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1049/2092] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:36 2021] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:36.712747 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd66a49-f23b-4039-8399-4f1b638f43f1 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:36.713682 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2704e-444d-401f-a51d-6c38d1f396ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:36.714782 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2704e-444d-401f-a51d-6c38d1f396ec admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:36.715141 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2704e-444d-401f-a51d-6c38d1f396ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:36.715611 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2704e-444d-401f-a51d-6c38d1f396ec admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:36.716447 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2704e-444d-401f-a51d-6c38d1f396ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:36.719121 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2704e-444d-401f-a51d-6c38d1f396ec admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:36.725899 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd66a49-f23b-4039-8399-4f1b638f43f1 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:36.731716 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41140413-5a58-453d-af72-2bb40043012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:36.732198 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41140413-5a58-453d-af72-2bb40043012c admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:36.732491 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41140413-5a58-453d-af72-2bb40043012c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:36.732922 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41140413-5a58-453d-af72-2bb40043012c admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:36.733720 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41140413-5a58-453d-af72-2bb40043012c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:39:36.734107 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41140413-5a58-453d-af72-2bb40043012c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:36.735894 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41140413-5a58-453d-af72-2bb40043012c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:36.747726 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1044/2093] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:39:36 2021] POST /identity/v3/users => generated 295 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:36.747726 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2704e-444d-401f-a51d-6c38d1f396ec admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:36.749552 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1050/2094] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:39:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:39:36.750686 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41140413-5a58-453d-af72-2bb40043012c admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:36.760784 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2704e-444d-401f-a51d-6c38d1f396ec admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:36.763525 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41140413-5a58-453d-af72-2bb40043012c admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:36.765606 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d0255-3628-4ceb-8ec7-235b598cf355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:36.766286 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d0255-3628-4ceb-8ec7-235b598cf355 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:36.766569 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d0255-3628-4ceb-8ec7-235b598cf355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:36.766842 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d0255-3628-4ceb-8ec7-235b598cf355 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:36.767571 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d0255-3628-4ceb-8ec7-235b598cf355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:36.768711 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43050f09-4424-4313-bd59-de7ec87d3552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:36.769266 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d0255-3628-4ceb-8ec7-235b598cf355 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:36.769361 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43050f09-4424-4313-bd59-de7ec87d3552 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:36.769612 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43050f09-4424-4313-bd59-de7ec87d3552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:36.769884 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43050f09-4424-4313-bd59-de7ec87d3552 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:36.770740 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43050f09-4424-4313-bd59-de7ec87d3552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:36.772701 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43050f09-4424-4313-bd59-de7ec87d3552 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:36.780374 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1045/2095] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:36 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:36.781403 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d0255-3628-4ceb-8ec7-235b598cf355 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:36.787727 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1051/2096] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:36 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:36.788282 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43050f09-4424-4313-bd59-de7ec87d3552 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:36.793610 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d0255-3628-4ceb-8ec7-235b598cf355 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:36.798111 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43050f09-4424-4313-bd59-de7ec87d3552 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:36.798234 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b954152-655d-486b-94ed-cbeb7afbc539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:36.798751 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b954152-655d-486b-94ed-cbeb7afbc539 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:36.799115 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b954152-655d-486b-94ed-cbeb7afbc539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:36.799321 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b954152-655d-486b-94ed-cbeb7afbc539 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:36.800050 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b954152-655d-486b-94ed-cbeb7afbc539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:36.801941 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b954152-655d-486b-94ed-cbeb7afbc539 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:36.802784 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f32052-9903-49c0-bfeb-1300675be816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:36.803628 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f32052-9903-49c0-bfeb-1300675be816 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:36.804064 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f32052-9903-49c0-bfeb-1300675be816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:36.804336 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f32052-9903-49c0-bfeb-1300675be816 admin admin] PATH_INFO: `/v3/projects/facc5f6fdd9c4506b07e695a6529e928/users/15ab88a71b774c8faf32ea695dbf818e/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:36.818819 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f32052-9903-49c0-bfeb-1300675be816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=facc5f6fdd9c4506b07e695a6529e928, user_id=15ab88a71b774c8faf32ea695dbf818e, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:36.821519 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f32052-9903-49c0-bfeb-1300675be816 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:36.828774 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1046/2097] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:39:36 2021] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:36.829606 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b954152-655d-486b-94ed-cbeb7afbc539 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:36.837380 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1052/2098] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:36 2021] PUT /identity/v3/projects/facc5f6fdd9c4506b07e695a6529e928/users/15ab88a71b774c8faf32ea695dbf818e/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:36.846970 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f32052-9903-49c0-bfeb-1300675be816 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:36.901038 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f32052-9903-49c0-bfeb-1300675be816 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:36.905742 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49be28-383e-405f-bb3c-62d9c53543a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:36.906575 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49be28-383e-405f-bb3c-62d9c53543a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:36.906666 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49be28-383e-405f-bb3c-62d9c53543a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:36.906933 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49be28-383e-405f-bb3c-62d9c53543a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:36.907053 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b954152-655d-486b-94ed-cbeb7afbc539 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:36.907639 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49be28-383e-405f-bb3c-62d9c53543a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:36.909575 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49be28-383e-405f-bb3c-62d9c53543a5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:36.914448 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79654b66-c26c-402d-b588-bda6fa7ae05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:36.915108 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79654b66-c26c-402d-b588-bda6fa7ae05d admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:36.915387 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79654b66-c26c-402d-b588-bda6fa7ae05d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:36.915661 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79654b66-c26c-402d-b588-bda6fa7ae05d admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:36.916461 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79654b66-c26c-402d-b588-bda6fa7ae05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:36.918211 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79654b66-c26c-402d-b588-bda6fa7ae05d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:36.930024 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1047/2099] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:36 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:36.930390 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1053/2100] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:39:36 2021] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:36.933638 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfd4a2-dacb-4850-833c-c74dcc3eff16 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:36.934138 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfd4a2-dacb-4850-833c-c74dcc3eff16 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:36.934426 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfd4a2-dacb-4850-833c-c74dcc3eff16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:36.934575 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49be28-383e-405f-bb3c-62d9c53543a5 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:36.946644 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49be28-383e-405f-bb3c-62d9c53543a5 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:36.952303 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da42ec-c979-4a60-b8dc-5c9ee3e7ce02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:36.953167 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da42ec-c979-4a60-b8dc-5c9ee3e7ce02 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:36.953445 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da42ec-c979-4a60-b8dc-5c9ee3e7ce02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:36.953743 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da42ec-c979-4a60-b8dc-5c9ee3e7ce02 admin admin] PATH_INFO: `/v3/projects/4687122800414ea6b0203e53a18a54ff/users/1e012909f2e14c9c9e8c93d76aead42d/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:36.968938 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-7dcfd4a2-dacb-4850-833c-c74dcc3eff16 None None] MFA Rules not processed for user `15ab88a71b774c8faf32ea695dbf818e`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:36.970740 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7dcfd4a2-dacb-4850-833c-c74dcc3eff16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:36.973480 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da42ec-c979-4a60-b8dc-5c9ee3e7ce02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4687122800414ea6b0203e53a18a54ff, user_id=1e012909f2e14c9c9e8c93d76aead42d, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:36.976788 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da42ec-c979-4a60-b8dc-5c9ee3e7ce02 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:36.993686 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1054/2101] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:36 2021] PUT /identity/v3/projects/4687122800414ea6b0203e53a18a54ff/users/1e012909f2e14c9c9e8c93d76aead42d/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:36.993686 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da42ec-c979-4a60-b8dc-5c9ee3e7ce02 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:37.047172 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1048/2102] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:36 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:37.047172 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad3a0e-bb9c-4878-87b9-2b1c71c48359 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:37.047172 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad3a0e-bb9c-4878-87b9-2b1c71c48359 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:37.047172 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad3a0e-bb9c-4878-87b9-2b1c71c48359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:37.064831 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-0aad3a0e-bb9c-4878-87b9-2b1c71c48359 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:37.066147 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-0aad3a0e-bb9c-4878-87b9-2b1c71c48359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:37.066857 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da42ec-c979-4a60-b8dc-5c9ee3e7ce02 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:37.071961 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a243484-a629-45ad-83b5-222522b9fcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:37.073194 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a243484-a629-45ad-83b5-222522b9fcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:37.073454 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a243484-a629-45ad-83b5-222522b9fcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:37.074092 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a243484-a629-45ad-83b5-222522b9fcf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:37.074485 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a243484-a629-45ad-83b5-222522b9fcf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:37.075580 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1049/2103] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:37.076550 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad3a0e-bb9c-4878-87b9-2b1c71c48359 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:37.079572 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a243484-a629-45ad-83b5-222522b9fcf6 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:37.086947 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad3a0e-bb9c-4878-87b9-2b1c71c48359 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:37.092427 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fd559-6413-4fdb-8b50-bb8ee611cbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:37.093074 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fd559-6413-4fdb-8b50-bb8ee611cbaa admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:37.093451 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fd559-6413-4fdb-8b50-bb8ee611cbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:37.093728 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fd559-6413-4fdb-8b50-bb8ee611cbaa admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:37.094426 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fd559-6413-4fdb-8b50-bb8ee611cbaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:37.096450 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fd559-6413-4fdb-8b50-bb8ee611cbaa admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:37.096718 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1055/2104] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:36 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:37.097700 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a243484-a629-45ad-83b5-222522b9fcf6 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:37.099528 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-5a243484-a629-45ad-83b5-222522b9fcf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:37.132141 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1050/2105] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:39:37 2021] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:37.134419 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fd559-6413-4fdb-8b50-bb8ee611cbaa admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:37.162698 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a243484-a629-45ad-83b5-222522b9fcf6 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:37.211871 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fd559-6413-4fdb-8b50-bb8ee611cbaa admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:37.218780 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffb5d9-1e39-4ea4-8097-550b9f8fc979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:37.219457 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffb5d9-1e39-4ea4-8097-550b9f8fc979 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:37.219791 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffb5d9-1e39-4ea4-8097-550b9f8fc979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:37.220416 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffb5d9-1e39-4ea4-8097-550b9f8fc979 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:37.221599 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ffb5d9-1e39-4ea4-8097-550b9f8fc979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:37.223291 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ffb5d9-1e39-4ea4-8097-550b9f8fc979 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:37.229303 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540c895-f70e-46cf-8782-a580f20aac8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:37.235778 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1051/2106] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:37 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:37.236993 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffb5d9-1e39-4ea4-8097-550b9f8fc979 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:37.245297 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540c895-f70e-46cf-8782-a580f20aac8a service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:37.245831 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540c895-f70e-46cf-8782-a580f20aac8a service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:37.247220 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540c895-f70e-46cf-8782-a580f20aac8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:37.254034 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffb5d9-1e39-4ea4-8097-550b9f8fc979 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:37.259493 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd0bae-05fc-44ac-887e-02ff1ee21271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:37.260797 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd0bae-05fc-44ac-887e-02ff1ee21271 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:37.261089 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd0bae-05fc-44ac-887e-02ff1ee21271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:37.261605 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd0bae-05fc-44ac-887e-02ff1ee21271 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:37.262521 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd0bae-05fc-44ac-887e-02ff1ee21271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:37.265299 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd0bae-05fc-44ac-887e-02ff1ee21271 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:37.265942 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540c895-f70e-46cf-8782-a580f20aac8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:37.269357 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540c895-f70e-46cf-8782-a580f20aac8a service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:37.284432 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1056/2107] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:37.285324 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540c895-f70e-46cf-8782-a580f20aac8a service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:37.287073 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1052/2108] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:39:37 2021] POST /identity/v3/users => generated 296 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:37.291093 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd0bae-05fc-44ac-887e-02ff1ee21271 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:37.302703 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd0bae-05fc-44ac-887e-02ff1ee21271 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:37.304749 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540c895-f70e-46cf-8782-a580f20aac8a service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:37.308144 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844460d-054f-46ee-bef7-41b9aa0bd6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:37.308898 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844460d-054f-46ee-bef7-41b9aa0bd6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:37.309436 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844460d-054f-46ee-bef7-41b9aa0bd6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:37.309963 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844460d-054f-46ee-bef7-41b9aa0bd6c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:37.311114 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844460d-054f-46ee-bef7-41b9aa0bd6c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:37.312743 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1688a-c4af-4e38-abbd-4a5101113902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:37.313484 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844460d-054f-46ee-bef7-41b9aa0bd6c7 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:37.313832 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1688a-c4af-4e38-abbd-4a5101113902 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:37.314210 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1688a-c4af-4e38-abbd-4a5101113902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:37.314526 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1688a-c4af-4e38-abbd-4a5101113902 admin admin] PATH_INFO: `/v3/projects/ac6f626ef59945c4a1495ec58574460c/users/a650582846f042b780d2e3f92d1a9803/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:37.325901 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1053/2109] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:37 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:39:37.330149 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844460d-054f-46ee-bef7-41b9aa0bd6c7 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:37.332141 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1688a-c4af-4e38-abbd-4a5101113902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac6f626ef59945c4a1495ec58574460c, user_id=a650582846f042b780d2e3f92d1a9803, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:37.334828 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1688a-c4af-4e38-abbd-4a5101113902 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:37.343078 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844460d-054f-46ee-bef7-41b9aa0bd6c7 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:37.349736 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1057/2110] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:37 2021] PUT /identity/v3/projects/ac6f626ef59945c4a1495ec58574460c/users/a650582846f042b780d2e3f92d1a9803/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:37.361399 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61374b3-c881-4471-86ee-6fbcc11272e1 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:37.361923 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61374b3-c881-4471-86ee-6fbcc11272e1 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:37.362344 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61374b3-c881-4471-86ee-6fbcc11272e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:37.393624 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-c61374b3-c881-4471-86ee-6fbcc11272e1 None None] MFA Rules not processed for user `a650582846f042b780d2e3f92d1a9803`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:37.394841 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-c61374b3-c881-4471-86ee-6fbcc11272e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:37.410887 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0744c7-2ef0-4b84-87ec-4c38a0bc4eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:37.411800 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0744c7-2ef0-4b84-87ec-4c38a0bc4eeb admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:37.412084 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0744c7-2ef0-4b84-87ec-4c38a0bc4eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:37.412365 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0744c7-2ef0-4b84-87ec-4c38a0bc4eeb admin admin] PATH_INFO: `/v3/projects/7fee557be1a6474380ea0ba1b76d3bea/users/35b3b38436524e39a07c0cc9de79263f/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:37.427656 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0744c7-2ef0-4b84-87ec-4c38a0bc4eeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fee557be1a6474380ea0ba1b76d3bea, user_id=35b3b38436524e39a07c0cc9de79263f, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:37.430434 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0744c7-2ef0-4b84-87ec-4c38a0bc4eeb admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:37.446985 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1054/2111] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:37 2021] PUT /identity/v3/projects/7fee557be1a6474380ea0ba1b76d3bea/users/35b3b38436524e39a07c0cc9de79263f/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:39:37.451458 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0744c7-2ef0-4b84-87ec-4c38a0bc4eeb admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:37.482358 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1058/2112] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:37 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:39:37.486396 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61374b3-c881-4471-86ee-6fbcc11272e1 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:37.488226 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-c61374b3-c881-4471-86ee-6fbcc11272e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:37.561697 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0744c7-2ef0-4b84-87ec-4c38a0bc4eeb admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:37.569305 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c33bf-8156-4da5-bc9f-88940ab2445d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:37.571853 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c33bf-8156-4da5-bc9f-88940ab2445d admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:37.572186 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c33bf-8156-4da5-bc9f-88940ab2445d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:37.573155 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c33bf-8156-4da5-bc9f-88940ab2445d admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:37.573949 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c33bf-8156-4da5-bc9f-88940ab2445d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:37.575207 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61374b3-c881-4471-86ee-6fbcc11272e1 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:37.575593 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c33bf-8156-4da5-bc9f-88940ab2445d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:37.599853 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1055/2113] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:37 2021] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:37.601611 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c33bf-8156-4da5-bc9f-88940ab2445d admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:37.612012 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c33bf-8156-4da5-bc9f-88940ab2445d admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:37.617896 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a8c9d-ddb0-4a31-ba14-04da786fb708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:37.618767 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a8c9d-ddb0-4a31-ba14-04da786fb708 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:37.619050 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a8c9d-ddb0-4a31-ba14-04da786fb708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:37.620166 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a8c9d-ddb0-4a31-ba14-04da786fb708 admin admin] PATH_INFO: `/v3/projects/7fee557be1a6474380ea0ba1b76d3bea/users/35b3b38436524e39a07c0cc9de79263f/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:37.621898 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a8c9d-ddb0-4a31-ba14-04da786fb708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fee557be1a6474380ea0ba1b76d3bea, user_id=35b3b38436524e39a07c0cc9de79263f, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:37.624715 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a8c9d-ddb0-4a31-ba14-04da786fb708 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:37.640918 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1056/2114] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:37 2021] PUT /identity/v3/projects/7fee557be1a6474380ea0ba1b76d3bea/users/35b3b38436524e39a07c0cc9de79263f/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:39:37.652696 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c178a-3b2e-4ba7-b19e-bcab7991f8d8 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:37.653125 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c178a-3b2e-4ba7-b19e-bcab7991f8d8 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:37.653621 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c178a-3b2e-4ba7-b19e-bcab7991f8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:37.657262 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f34e78-77e0-4b8a-b780-6ee840a64db5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456c83b8619847279927251ca48fca37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:37.658015 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f34e78-77e0-4b8a-b780-6ee840a64db5 service glance] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:37.658306 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f34e78-77e0-4b8a-b780-6ee840a64db5 service glance] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:37.658572 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f34e78-77e0-4b8a-b780-6ee840a64db5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:37.731463 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-983c178a-3b2e-4ba7-b19e-bcab7991f8d8 None None] MFA Rules not processed for user `35b3b38436524e39a07c0cc9de79263f`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:37.738271 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-983c178a-3b2e-4ba7-b19e-bcab7991f8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:37.758724 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f34e78-77e0-4b8a-b780-6ee840a64db5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:37.761626 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f34e78-77e0-4b8a-b780-6ee840a64db5 service glance] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:37.797547 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1059/2115] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:37 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:37.903880 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affaca79-29b9-4979-88cd-a35354c69c96 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:37.904204 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affaca79-29b9-4979-88cd-a35354c69c96 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:37.904353 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affaca79-29b9-4979-88cd-a35354c69c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:37.940506 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1057/2116] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:37 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:39:37.945754 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-affaca79-29b9-4979-88cd-a35354c69c96 None None] MFA Rules not processed for user `f1f3db9250cc4edbacb392d5d0d18e08`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:37.946990 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-affaca79-29b9-4979-88cd-a35354c69c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:38.039251 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1060/2117] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:37 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:39:38.039471 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c178a-3b2e-4ba7-b19e-bcab7991f8d8 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:38.041149 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-983c178a-3b2e-4ba7-b19e-bcab7991f8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:38.136793 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c178a-3b2e-4ba7-b19e-bcab7991f8d8 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:38.148802 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d843097-16ed-470f-a700-44773f99a767 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:38.149570 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d843097-16ed-470f-a700-44773f99a767 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:38.149851 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d843097-16ed-470f-a700-44773f99a767 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:38.150129 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d843097-16ed-470f-a700-44773f99a767 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:38.170440 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d843097-16ed-470f-a700-44773f99a767 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:38.172376 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d843097-16ed-470f-a700-44773f99a767 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:38.183347 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1058/2118] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:38 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:38.294437 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affaca79-29b9-4979-88cd-a35354c69c96 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:38.305162 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affaca79-29b9-4979-88cd-a35354c69c96 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:38.309844 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562d0ee-0472-4826-bc6b-48af3054af5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:38.310669 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562d0ee-0472-4826-bc6b-48af3054af5e service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:38.311266 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562d0ee-0472-4826-bc6b-48af3054af5e service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:38.311748 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562d0ee-0472-4826-bc6b-48af3054af5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:38.316200 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-5562d0ee-0472-4826-bc6b-48af3054af5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:38.385680 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562d0ee-0472-4826-bc6b-48af3054af5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:38.387136 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562d0ee-0472-4826-bc6b-48af3054af5e service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:38.397981 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1061/2119] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:38 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:41.330764 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d843097-16ed-470f-a700-44773f99a767 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:41.332356 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7d843097-16ed-470f-a700-44773f99a767 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:41.522401 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d843097-16ed-470f-a700-44773f99a767 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:41.566382 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11338a-0c31-4713-a728-c5e40aed913a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:41.567383 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11338a-0c31-4713-a728-c5e40aed913a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:41.567540 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11338a-0c31-4713-a728-c5e40aed913a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:41.567847 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11338a-0c31-4713-a728-c5e40aed913a admin admin] PATH_INFO: `/v3/users/492897b4e91f41179c30e9fc1324fbe1` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:41.570526 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11338a-0c31-4713-a728-c5e40aed913a admin admin] RBAC: Authorizing `identity:delete_user(user_id=492897b4e91f41179c30e9fc1324fbe1)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:41.572986 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11338a-0c31-4713-a728-c5e40aed913a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:41.676973 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-4b11338a-0c31-4713-a728-c5e40aed913a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '492897b4e91f41179c30e9fc1324fbe1'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:41.694600 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-4b11338a-0c31-4713-a728-c5e40aed913a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '492897b4e91f41179c30e9fc1324fbe1'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:41.705703 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-4b11338a-0c31-4713-a728-c5e40aed913a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '492897b4e91f41179c30e9fc1324fbe1'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:41.706728 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-4b11338a-0c31-4713-a728-c5e40aed913a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '492897b4e91f41179c30e9fc1324fbe1'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:41.717178 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-4b11338a-0c31-4713-a728-c5e40aed913a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '492897b4e91f41179c30e9fc1324fbe1'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:41.725410 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1059/2120] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:41 2021] DELETE /identity/v3/users/492897b4e91f41179c30e9fc1324fbe1 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:41.730478 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb525829-f724-4585-9153-7aab87669569 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:41.732395 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb525829-f724-4585-9153-7aab87669569 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:41.732926 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb525829-f724-4585-9153-7aab87669569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:41.758030 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-fb525829-f724-4585-9153-7aab87669569 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:41.760235 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-fb525829-f724-4585-9153-7aab87669569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:41.869069 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1062/2121] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:41.925074 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11338a-0c31-4713-a728-c5e40aed913a admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:41.926529 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-4b11338a-0c31-4713-a728-c5e40aed913a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:41.932774 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb525829-f724-4585-9153-7aab87669569 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:41.934134 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-fb525829-f724-4585-9153-7aab87669569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:41.949330 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11338a-0c31-4713-a728-c5e40aed913a admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:41.974424 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f90f1a-44b2-4de0-bb16-0440fc647a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:41.975369 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f90f1a-44b2-4de0-bb16-0440fc647a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:41.975700 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f90f1a-44b2-4de0-bb16-0440fc647a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:41.975967 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f90f1a-44b2-4de0-bb16-0440fc647a26 admin admin] PATH_INFO: `/v3/users/d6b7b7e0a200461a8a8039dea2c45bbf` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:41.977618 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f90f1a-44b2-4de0-bb16-0440fc647a26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6b7b7e0a200461a8a8039dea2c45bbf)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:41.984665 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f90f1a-44b2-4de0-bb16-0440fc647a26 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:42.013462 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb525829-f724-4585-9153-7aab87669569 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:42.018397 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e715f-4a3d-4a30-ba73-68f14bf6aced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:42.019067 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e715f-4a3d-4a30-ba73-68f14bf6aced service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:42.019349 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e715f-4a3d-4a30-ba73-68f14bf6aced service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:42.019625 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e715f-4a3d-4a30-ba73-68f14bf6aced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:42.030811 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e715f-4a3d-4a30-ba73-68f14bf6aced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:42.032313 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e715f-4a3d-4a30-ba73-68f14bf6aced service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:42.045615 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1063/2122] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:39:42.101464 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-c5f90f1a-44b2-4de0-bb16-0440fc647a26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6b7b7e0a200461a8a8039dea2c45bbf'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:42.139456 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-c5f90f1a-44b2-4de0-bb16-0440fc647a26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6b7b7e0a200461a8a8039dea2c45bbf'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:42.152827 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-c5f90f1a-44b2-4de0-bb16-0440fc647a26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6b7b7e0a200461a8a8039dea2c45bbf'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:42.154592 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-c5f90f1a-44b2-4de0-bb16-0440fc647a26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6b7b7e0a200461a8a8039dea2c45bbf'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:42.174205 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-c5f90f1a-44b2-4de0-bb16-0440fc647a26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6b7b7e0a200461a8a8039dea2c45bbf'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:42.185279 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abe147-4859-41c7-980f-9a9309649301 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:42.185569 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abe147-4859-41c7-980f-9a9309649301 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:42.186016 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abe147-4859-41c7-980f-9a9309649301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:42.187156 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1060/2123] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:41 2021] DELETE /identity/v3/users/d6b7b7e0a200461a8a8039dea2c45bbf => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:42.206912 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-81abe147-4859-41c7-980f-9a9309649301 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:42.208985 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-81abe147-4859-41c7-980f-9a9309649301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:42.291639 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1064/2124] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:39:42.330857 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f90f1a-44b2-4de0-bb16-0440fc647a26 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:42.334304 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c5f90f1a-44b2-4de0-bb16-0440fc647a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:42.482487 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f90f1a-44b2-4de0-bb16-0440fc647a26 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:42.487952 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8b806-37b8-42c7-a935-adbe36d4ee9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:42.488868 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8b806-37b8-42c7-a935-adbe36d4ee9d service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:42.489355 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8b806-37b8-42c7-a935-adbe36d4ee9d service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:42.489825 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8b806-37b8-42c7-a935-adbe36d4ee9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:42.501828 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8b806-37b8-42c7-a935-adbe36d4ee9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:42.503665 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8b806-37b8-42c7-a935-adbe36d4ee9d service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:42.518535 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1061/2125] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:42.916155 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abe147-4859-41c7-980f-9a9309649301 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:42.918401 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-81abe147-4859-41c7-980f-9a9309649301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:42.934845 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abe147-4859-41c7-980f-9a9309649301 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:42.956559 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb203a-552f-43a8-887a-eda24e500566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:42.957432 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb203a-552f-43a8-887a-eda24e500566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:42.957658 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb203a-552f-43a8-887a-eda24e500566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:42.957937 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb203a-552f-43a8-887a-eda24e500566 admin admin] PATH_INFO: `/v3/projects/dff99176871c4ff3b7835d6c0c8c6044` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:42.960244 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb203a-552f-43a8-887a-eda24e500566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dff99176871c4ff3b7835d6c0c8c6044)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:42.962260 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb203a-552f-43a8-887a-eda24e500566 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:43.057942 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d4fb203a-552f-43a8-887a-eda24e500566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dff99176871c4ff3b7835d6c0c8c6044', 'request_id': 'req-d4fb203a-552f-43a8-887a-eda24e500566'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:43.074850 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d4fb203a-552f-43a8-887a-eda24e500566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dff99176871c4ff3b7835d6c0c8c6044', 'request_id': 'req-d4fb203a-552f-43a8-887a-eda24e500566'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:43.081447 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d4fb203a-552f-43a8-887a-eda24e500566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dff99176871c4ff3b7835d6c0c8c6044', 'request_id': 'req-d4fb203a-552f-43a8-887a-eda24e500566'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:43.102825 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d4fb203a-552f-43a8-887a-eda24e500566 admin admin] The token cache is being invalidate because project dff99176871c4ff3b7835d6c0c8c6044 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:43.103210 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d4fb203a-552f-43a8-887a-eda24e500566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:43.104583 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d4fb203a-552f-43a8-887a-eda24e500566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:43.110863 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8b806-37b8-42c7-a935-adbe36d4ee9d service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:43.112423 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1065/2126] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:42 2021] DELETE /identity/v3/projects/dff99176871c4ff3b7835d6c0c8c6044 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:43.148609 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8b806-37b8-42c7-a935-adbe36d4ee9d service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:43.283143 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f226b-d5fd-4cdd-a203-0cac2d51d47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:43.284203 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f226b-d5fd-4cdd-a203-0cac2d51d47e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:43.284581 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f226b-d5fd-4cdd-a203-0cac2d51d47e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:43.284948 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f226b-d5fd-4cdd-a203-0cac2d51d47e admin admin] PATH_INFO: `/v3/users/1f13a848db1e4864a8832478fa8219f3` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:43.286339 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f226b-d5fd-4cdd-a203-0cac2d51d47e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f13a848db1e4864a8832478fa8219f3)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:43.288726 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f226b-d5fd-4cdd-a203-0cac2d51d47e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:43.373736 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-e19f226b-d5fd-4cdd-a203-0cac2d51d47e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f13a848db1e4864a8832478fa8219f3'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:43.416684 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-e19f226b-d5fd-4cdd-a203-0cac2d51d47e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f13a848db1e4864a8832478fa8219f3'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:43.429706 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-e19f226b-d5fd-4cdd-a203-0cac2d51d47e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f13a848db1e4864a8832478fa8219f3'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:43.443392 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-e19f226b-d5fd-4cdd-a203-0cac2d51d47e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f13a848db1e4864a8832478fa8219f3'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:43.466442 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-e19f226b-d5fd-4cdd-a203-0cac2d51d47e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f13a848db1e4864a8832478fa8219f3'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:43.487293 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1062/2127] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:43 2021] DELETE /identity/v3/users/1f13a848db1e4864a8832478fa8219f3 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:43.589054 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb203a-552f-43a8-887a-eda24e500566 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:43.590783 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-d4fb203a-552f-43a8-887a-eda24e500566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:43.610557 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb203a-552f-43a8-887a-eda24e500566 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:43.667801 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c586493-6385-47b3-823f-155cf5727808 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:43.668044 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c586493-6385-47b3-823f-155cf5727808 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:43.668306 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c586493-6385-47b3-823f-155cf5727808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:43.719014 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-8c586493-6385-47b3-823f-155cf5727808 None None] MFA Rules not processed for user `1e012909f2e14c9c9e8c93d76aead42d`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:43.721984 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-8c586493-6385-47b3-823f-155cf5727808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:43.789906 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d0c8a-adf7-4cdf-8ed9-91e837ccb53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:43.792062 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d0c8a-adf7-4cdf-8ed9-91e837ccb53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:43.792347 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d0c8a-adf7-4cdf-8ed9-91e837ccb53d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:43.792621 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d0c8a-adf7-4cdf-8ed9-91e837ccb53d admin admin] PATH_INFO: `/v3/projects/eaa6dcdca23049f3bdd48fd73d70311f` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:43.795872 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d0c8a-adf7-4cdf-8ed9-91e837ccb53d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaa6dcdca23049f3bdd48fd73d70311f)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:43.798872 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d0c8a-adf7-4cdf-8ed9-91e837ccb53d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:43.864724 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1063/2128] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:43 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:39:43.870805 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-268d0c8a-adf7-4cdf-8ed9-91e837ccb53d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaa6dcdca23049f3bdd48fd73d70311f', 'request_id': 'req-268d0c8a-adf7-4cdf-8ed9-91e837ccb53d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:43.875700 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b53f40-e935-4a0d-ac61-53bf4b58d3b9 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:43.876010 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b53f40-e935-4a0d-ac61-53bf4b58d3b9 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:43.876291 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b53f40-e935-4a0d-ac61-53bf4b58d3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:43.878946 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-268d0c8a-adf7-4cdf-8ed9-91e837ccb53d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaa6dcdca23049f3bdd48fd73d70311f', 'request_id': 'req-268d0c8a-adf7-4cdf-8ed9-91e837ccb53d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:43.885765 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-268d0c8a-adf7-4cdf-8ed9-91e837ccb53d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaa6dcdca23049f3bdd48fd73d70311f', 'request_id': 'req-268d0c8a-adf7-4cdf-8ed9-91e837ccb53d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:43.901336 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-268d0c8a-adf7-4cdf-8ed9-91e837ccb53d admin admin] The token cache is being invalidate because project eaa6dcdca23049f3bdd48fd73d70311f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:43.901664 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-268d0c8a-adf7-4cdf-8ed9-91e837ccb53d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:43.902459 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-37b53f40-e935-4a0d-ac61-53bf4b58d3b9 None None] MFA Rules not processed for user `1e012909f2e14c9c9e8c93d76aead42d`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:43.902573 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-268d0c8a-adf7-4cdf-8ed9-91e837ccb53d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:43.903666 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-37b53f40-e935-4a0d-ac61-53bf4b58d3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:43.907098 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1066/2129] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:43 2021] DELETE /identity/v3/projects/eaa6dcdca23049f3bdd48fd73d70311f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:43.908184 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d0c8a-adf7-4cdf-8ed9-91e837ccb53d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:43.909593 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-268d0c8a-adf7-4cdf-8ed9-91e837ccb53d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:43.966503 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1064/2130] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:43 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:39:43.979169 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b53f40-e935-4a0d-ac61-53bf4b58d3b9 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:43.980727 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-37b53f40-e935-4a0d-ac61-53bf4b58d3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:43.981626 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d0c8a-adf7-4cdf-8ed9-91e837ccb53d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:43.986465 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffbedc-b07e-41f6-ade0-3f8ef92973d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:43.987374 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffbedc-b07e-41f6-ade0-3f8ef92973d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:43.987710 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffbedc-b07e-41f6-ade0-3f8ef92973d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:43.988033 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffbedc-b07e-41f6-ade0-3f8ef92973d4 admin admin] PATH_INFO: `/v3/users/15ab88a71b774c8faf32ea695dbf818e` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:43.990181 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffbedc-b07e-41f6-ade0-3f8ef92973d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ab88a71b774c8faf32ea695dbf818e)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:43.992219 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffbedc-b07e-41f6-ade0-3f8ef92973d4 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:44.058735 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-4dffbedc-b07e-41f6-ade0-3f8ef92973d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ab88a71b774c8faf32ea695dbf818e'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:44.069192 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b53f40-e935-4a0d-ac61-53bf4b58d3b9 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:44.081799 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dfb6d-7dcd-4f83-9655-9f502ed9bf7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:44.084478 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dfb6d-7dcd-4f83-9655-9f502ed9bf7e service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:44.084814 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dfb6d-7dcd-4f83-9655-9f502ed9bf7e service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:44.085121 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dfb6d-7dcd-4f83-9655-9f502ed9bf7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:44.089812 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-4dffbedc-b07e-41f6-ade0-3f8ef92973d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ab88a71b774c8faf32ea695dbf818e'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:44.090072 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-044dfb6d-7dcd-4f83-9655-9f502ed9bf7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:44.100609 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-4dffbedc-b07e-41f6-ade0-3f8ef92973d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ab88a71b774c8faf32ea695dbf818e'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:44.109903 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-4dffbedc-b07e-41f6-ade0-3f8ef92973d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ab88a71b774c8faf32ea695dbf818e'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:44.114112 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044dfb6d-7dcd-4f83-9655-9f502ed9bf7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:44.122528 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044dfb6d-7dcd-4f83-9655-9f502ed9bf7e service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:44.122844 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-4dffbedc-b07e-41f6-ade0-3f8ef92973d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ab88a71b774c8faf32ea695dbf818e'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:44.133417 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1065/2132] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:43 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:44.134286 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dfb6d-7dcd-4f83-9655-9f502ed9bf7e service nova] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:44.135552 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1067/2132] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:43 2021] DELETE /identity/v3/users/15ab88a71b774c8faf32ea695dbf818e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:39:44.137068 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-044dfb6d-7dcd-4f83-9655-9f502ed9bf7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:44.152093 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dfb6d-7dcd-4f83-9655-9f502ed9bf7e service nova] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:44.241919 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112683c6-47a2-4473-bc13-20f6cf81adff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:44.245532 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112683c6-47a2-4473-bc13-20f6cf81adff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:44.247407 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112683c6-47a2-4473-bc13-20f6cf81adff admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:44.247870 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112683c6-47a2-4473-bc13-20f6cf81adff admin admin] PATH_INFO: `/v3/projects/4894ed4be5c543749b908a61c31561e9` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:44.251409 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112683c6-47a2-4473-bc13-20f6cf81adff admin admin] RBAC: Authorizing `identity:delete_project(project_id=4894ed4be5c543749b908a61c31561e9)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:44.255870 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112683c6-47a2-4473-bc13-20f6cf81adff admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:44.331653 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-112683c6-47a2-4473-bc13-20f6cf81adff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4894ed4be5c543749b908a61c31561e9', 'request_id': 'req-112683c6-47a2-4473-bc13-20f6cf81adff'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:44.340901 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-112683c6-47a2-4473-bc13-20f6cf81adff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4894ed4be5c543749b908a61c31561e9', 'request_id': 'req-112683c6-47a2-4473-bc13-20f6cf81adff'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:44.347516 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-112683c6-47a2-4473-bc13-20f6cf81adff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4894ed4be5c543749b908a61c31561e9', 'request_id': 'req-112683c6-47a2-4473-bc13-20f6cf81adff'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:44.374185 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-112683c6-47a2-4473-bc13-20f6cf81adff admin admin] The token cache is being invalidate because project 4894ed4be5c543749b908a61c31561e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:44.375381 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-112683c6-47a2-4473-bc13-20f6cf81adff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:44.376310 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-112683c6-47a2-4473-bc13-20f6cf81adff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:44.379118 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1066/2133] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:44 2021] DELETE /identity/v3/projects/4894ed4be5c543749b908a61c31561e9 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:44.388757 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2c34e-0051-44a6-b9e9-3e61c7157bd4 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:44.389303 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2c34e-0051-44a6-b9e9-3e61c7157bd4 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:44.389583 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2c34e-0051-44a6-b9e9-3e61c7157bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:44.418861 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-0cb2c34e-0051-44a6-b9e9-3e61c7157bd4 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:44.420583 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-0cb2c34e-0051-44a6-b9e9-3e61c7157bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:44.539664 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1068/2134] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:44.548208 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ef310-54d8-45d4-ab39-c471c535ccaa None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:44.548489 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ef310-54d8-45d4-ab39-c471c535ccaa None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:44.548946 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ef310-54d8-45d4-ab39-c471c535ccaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:44.577166 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-062ef310-54d8-45d4-ab39-c471c535ccaa None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:44.578524 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-062ef310-54d8-45d4-ab39-c471c535ccaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:44.592098 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1067/2135] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:44.595393 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2c34e-0051-44a6-b9e9-3e61c7157bd4 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:44.614156 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2c34e-0051-44a6-b9e9-3e61c7157bd4 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:44.622386 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58769f81-9c5d-4f67-9dec-bbde1572f8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:44.624140 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58769f81-9c5d-4f67-9dec-bbde1572f8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:44.624639 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58769f81-9c5d-4f67-9dec-bbde1572f8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:44.625113 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58769f81-9c5d-4f67-9dec-bbde1572f8b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:44.632747 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58769f81-9c5d-4f67-9dec-bbde1572f8b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:39:44.633422 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58769f81-9c5d-4f67-9dec-bbde1572f8b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:44.635874 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58769f81-9c5d-4f67-9dec-bbde1572f8b0 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:44.664931 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1069/2136] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:39:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:39:44.669861 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ef310-54d8-45d4-ab39-c471c535ccaa None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:44.683260 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ef310-54d8-45d4-ab39-c471c535ccaa None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:44.692379 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd34bb-efbe-4f29-835c-f3b0403db740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:44.693306 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd34bb-efbe-4f29-835c-f3b0403db740 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:44.694051 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd34bb-efbe-4f29-835c-f3b0403db740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:44.694537 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd34bb-efbe-4f29-835c-f3b0403db740 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:44.696310 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd34bb-efbe-4f29-835c-f3b0403db740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:44.699652 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd34bb-efbe-4f29-835c-f3b0403db740 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:44.741364 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1068/2137] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:39:44 2021] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:44.744996 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58769f81-9c5d-4f67-9dec-bbde1572f8b0 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:44.755907 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58769f81-9c5d-4f67-9dec-bbde1572f8b0 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:44.806526 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd34bb-efbe-4f29-835c-f3b0403db740 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:44.811700 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-26fd34bb-efbe-4f29-835c-f3b0403db740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:44.950631 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd34bb-efbe-4f29-835c-f3b0403db740 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:44.965178 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ffb84-c713-4485-90fc-fc9eb33b5211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:44.966180 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ffb84-c713-4485-90fc-fc9eb33b5211 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:44.967791 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ffb84-c713-4485-90fc-fc9eb33b5211 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:44.968280 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ffb84-c713-4485-90fc-fc9eb33b5211 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:44.971097 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c079d-a756-4dd7-bd1e-75fff85667a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:44.972499 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c079d-a756-4dd7-bd1e-75fff85667a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:44.972986 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c079d-a756-4dd7-bd1e-75fff85667a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:44.973397 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ffb84-c713-4485-90fc-fc9eb33b5211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:44.973646 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c079d-a756-4dd7-bd1e-75fff85667a7 admin admin] PATH_INFO: `/v3/projects/facc5f6fdd9c4506b07e695a6529e928` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:44.975356 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c079d-a756-4dd7-bd1e-75fff85667a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=facc5f6fdd9c4506b07e695a6529e928)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:44.977691 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ffb84-c713-4485-90fc-fc9eb33b5211 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:44.979347 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c079d-a756-4dd7-bd1e-75fff85667a7 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:45.024040 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1070/2138] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:39:44 2021] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:39:45.025011 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ffb84-c713-4485-90fc-fc9eb33b5211 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:45.036499 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-6a9c079d-a756-4dd7-bd1e-75fff85667a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'facc5f6fdd9c4506b07e695a6529e928', 'request_id': 'req-6a9c079d-a756-4dd7-bd1e-75fff85667a7'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:45.042324 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ffb84-c713-4485-90fc-fc9eb33b5211 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:45.057403 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-6a9c079d-a756-4dd7-bd1e-75fff85667a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'facc5f6fdd9c4506b07e695a6529e928', 'request_id': 'req-6a9c079d-a756-4dd7-bd1e-75fff85667a7'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:45.060266 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-6a9c079d-a756-4dd7-bd1e-75fff85667a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'facc5f6fdd9c4506b07e695a6529e928', 'request_id': 'req-6a9c079d-a756-4dd7-bd1e-75fff85667a7'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:45.079488 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-6a9c079d-a756-4dd7-bd1e-75fff85667a7 admin admin] The token cache is being invalidate because project facc5f6fdd9c4506b07e695a6529e928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:45.080075 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-6a9c079d-a756-4dd7-bd1e-75fff85667a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:45.080981 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-6a9c079d-a756-4dd7-bd1e-75fff85667a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:45.083035 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1069/2139] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:44 2021] DELETE /identity/v3/projects/facc5f6fdd9c4506b07e695a6529e928 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:45.087211 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c079d-a756-4dd7-bd1e-75fff85667a7 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:45.088941 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-6a9c079d-a756-4dd7-bd1e-75fff85667a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:45.112146 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3372fd0-f1d5-4e82-b932-47aa1283838f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:45.113613 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3372fd0-f1d5-4e82-b932-47aa1283838f admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:45.114123 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3372fd0-f1d5-4e82-b932-47aa1283838f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:45.114606 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3372fd0-f1d5-4e82-b932-47aa1283838f admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:45.115740 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3372fd0-f1d5-4e82-b932-47aa1283838f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:45.117713 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3372fd0-f1d5-4e82-b932-47aa1283838f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:45.132930 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1071/2140] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:45 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:45.138255 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3372fd0-f1d5-4e82-b932-47aa1283838f admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:45.141165 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-c3372fd0-f1d5-4e82-b932-47aa1283838f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:45.158510 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3372fd0-f1d5-4e82-b932-47aa1283838f admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:45.165328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c6d11-72b8-43ee-9f2d-6b91c93a02e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:45.166272 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c6d11-72b8-43ee-9f2d-6b91c93a02e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:45.166454 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c6d11-72b8-43ee-9f2d-6b91c93a02e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:45.166743 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c6d11-72b8-43ee-9f2d-6b91c93a02e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:45.167619 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c6d11-72b8-43ee-9f2d-6b91c93a02e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:45.169460 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c6d11-72b8-43ee-9f2d-6b91c93a02e6 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:45.175513 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c079d-a756-4dd7-bd1e-75fff85667a7 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:45.181261 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ac746-b80b-448a-b244-2e276f49dc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:45.185814 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ac746-b80b-448a-b244-2e276f49dc84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:45.185972 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1072/2141] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:45 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:39:45.186077 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ac746-b80b-448a-b244-2e276f49dc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:45.186077 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ac746-b80b-448a-b244-2e276f49dc84 admin admin] PATH_INFO: `/v3/users/35b3b38436524e39a07c0cc9de79263f` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:45.186077 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ac746-b80b-448a-b244-2e276f49dc84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35b3b38436524e39a07c0cc9de79263f)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:45.186991 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c6d11-72b8-43ee-9f2d-6b91c93a02e6 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:45.192069 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ac746-b80b-448a-b244-2e276f49dc84 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:45.199787 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c6d11-72b8-43ee-9f2d-6b91c93a02e6 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:45.206396 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00da14-74f7-4dde-a9c4-712bf0f43615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:45.206764 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00da14-74f7-4dde-a9c4-712bf0f43615 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:45.207130 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00da14-74f7-4dde-a9c4-712bf0f43615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:45.207439 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00da14-74f7-4dde-a9c4-712bf0f43615 admin admin] PATH_INFO: `/v3/projects/22ef5e73477a48dca86738df21ce82ef/users/6b8cf2aedd93473aab4d5da8e7a48f72/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:45.224205 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00da14-74f7-4dde-a9c4-712bf0f43615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ef5e73477a48dca86738df21ce82ef, user_id=6b8cf2aedd93473aab4d5da8e7a48f72, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:45.227225 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00da14-74f7-4dde-a9c4-712bf0f43615 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:45.246811 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1073/2142] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:45 2021] PUT /identity/v3/projects/22ef5e73477a48dca86738df21ce82ef/users/6b8cf2aedd93473aab4d5da8e7a48f72/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:45.258258 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bfd05-6258-4156-a227-c39adb8b2f68 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:45.258533 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bfd05-6258-4156-a227-c39adb8b2f68 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:45.258824 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bfd05-6258-4156-a227-c39adb8b2f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:45.279196 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-f86ac746-b80b-448a-b244-2e276f49dc84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35b3b38436524e39a07c0cc9de79263f'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:45.292323 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-f86ac746-b80b-448a-b244-2e276f49dc84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35b3b38436524e39a07c0cc9de79263f'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:45.295383 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-035bfd05-6258-4156-a227-c39adb8b2f68 None None] MFA Rules not processed for user `6b8cf2aedd93473aab4d5da8e7a48f72`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:45.297111 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-035bfd05-6258-4156-a227-c39adb8b2f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:45.301022 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-f86ac746-b80b-448a-b244-2e276f49dc84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35b3b38436524e39a07c0cc9de79263f'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:45.301987 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-f86ac746-b80b-448a-b244-2e276f49dc84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35b3b38436524e39a07c0cc9de79263f'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:45.311237 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-f86ac746-b80b-448a-b244-2e276f49dc84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35b3b38436524e39a07c0cc9de79263f'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:45.319211 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1070/2143] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:45 2021] DELETE /identity/v3/users/35b3b38436524e39a07c0cc9de79263f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:45.387183 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1074/2144] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:45 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:39:45.391780 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ac746-b80b-448a-b244-2e276f49dc84 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:45.393797 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-f86ac746-b80b-448a-b244-2e276f49dc84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:45.425621 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2ab5c-bfd6-45ac-83a9-0a8a0e631f0e None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:45.425915 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2ab5c-bfd6-45ac-83a9-0a8a0e631f0e None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:45.426197 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2ab5c-bfd6-45ac-83a9-0a8a0e631f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:45.459348 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-3dd2ab5c-bfd6-45ac-83a9-0a8a0e631f0e None None] MFA Rules not processed for user `1e012909f2e14c9c9e8c93d76aead42d`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:45.462951 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-3dd2ab5c-bfd6-45ac-83a9-0a8a0e631f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:45.527314 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ac746-b80b-448a-b244-2e276f49dc84 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:45.535651 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849bb9f-3ab1-4aee-834a-c8ead1bf9b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:45.536452 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849bb9f-3ab1-4aee-834a-c8ead1bf9b50 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:45.536805 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849bb9f-3ab1-4aee-834a-c8ead1bf9b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:45.537161 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849bb9f-3ab1-4aee-834a-c8ead1bf9b50 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:45.538083 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849bb9f-3ab1-4aee-834a-c8ead1bf9b50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:45.538339 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1075/2145] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:45 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:45.542528 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849bb9f-3ab1-4aee-834a-c8ead1bf9b50 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:45.622636 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1071/2146] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:39:45 2021] POST /identity/v3/projects => generated 385 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:45.624680 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2ab5c-bfd6-45ac-83a9-0a8a0e631f0e None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:45.644487 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2ab5c-bfd6-45ac-83a9-0a8a0e631f0e None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:45.763316 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849bb9f-3ab1-4aee-834a-c8ead1bf9b50 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:45.765309 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e849bb9f-3ab1-4aee-834a-c8ead1bf9b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:45.800754 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb2516-b8cb-4502-bc71-1c9d25857aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:45.801556 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb2516-b8cb-4502-bc71-1c9d25857aff admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:45.802220 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb2516-b8cb-4502-bc71-1c9d25857aff admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:45.802330 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb2516-b8cb-4502-bc71-1c9d25857aff admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:45.803094 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb2516-b8cb-4502-bc71-1c9d25857aff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:45.805454 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb2516-b8cb-4502-bc71-1c9d25857aff admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:45.849885 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1076/2147] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:39:45 2021] POST /identity/v3/users => generated 299 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:45.853610 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb2516-b8cb-4502-bc71-1c9d25857aff admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:45.870001 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb2516-b8cb-4502-bc71-1c9d25857aff admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:45.893466 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec699aaf-6459-40a5-be32-891285fdcc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:45.895083 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849bb9f-3ab1-4aee-834a-c8ead1bf9b50 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:45.900480 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0e677-9d7f-475a-b502-a8f2e710fc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:45.901389 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0e677-9d7f-475a-b502-a8f2e710fc21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:45.901679 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0e677-9d7f-475a-b502-a8f2e710fc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:45.901960 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0e677-9d7f-475a-b502-a8f2e710fc21 admin admin] PATH_INFO: `/v3/projects/7fee557be1a6474380ea0ba1b76d3bea` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:45.903289 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0e677-9d7f-475a-b502-a8f2e710fc21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fee557be1a6474380ea0ba1b76d3bea)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:45.904938 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec699aaf-6459-40a5-be32-891285fdcc74 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:45.905457 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec699aaf-6459-40a5-be32-891285fdcc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:45.908338 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec699aaf-6459-40a5-be32-891285fdcc74 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:45.910744 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec699aaf-6459-40a5-be32-891285fdcc74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:45.913202 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec699aaf-6459-40a5-be32-891285fdcc74 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:45.927711 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1077/2148] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:45 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:39:45.928403 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0e677-9d7f-475a-b502-a8f2e710fc21 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:45.933113 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec699aaf-6459-40a5-be32-891285fdcc74 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:45.949273 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec699aaf-6459-40a5-be32-891285fdcc74 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:45.960014 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f193f-216f-4193-a620-7c01476f1af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:45.962336 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f193f-216f-4193-a620-7c01476f1af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:45.964763 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f193f-216f-4193-a620-7c01476f1af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:45.968971 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f193f-216f-4193-a620-7c01476f1af1 admin admin] PATH_INFO: `/v3/projects/512a965718f84b8a8730dea3781e6a38/users/3f01bb137fc240ad94c88dce19699232/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:46.001826 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f193f-216f-4193-a620-7c01476f1af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=512a965718f84b8a8730dea3781e6a38, user_id=3f01bb137fc240ad94c88dce19699232, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:46.006122 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f193f-216f-4193-a620-7c01476f1af1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:46.030921 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1078/2149] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:45 2021] PUT /identity/v3/projects/512a965718f84b8a8730dea3781e6a38/users/3f01bb137fc240ad94c88dce19699232/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:46.032321 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f193f-216f-4193-a620-7c01476f1af1 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:46.061882 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-b9d0e677-9d7f-475a-b502-a8f2e710fc21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fee557be1a6474380ea0ba1b76d3bea', 'request_id': 'req-b9d0e677-9d7f-475a-b502-a8f2e710fc21'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:46.080810 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-b9d0e677-9d7f-475a-b502-a8f2e710fc21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fee557be1a6474380ea0ba1b76d3bea', 'request_id': 'req-b9d0e677-9d7f-475a-b502-a8f2e710fc21'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:46.100566 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-b9d0e677-9d7f-475a-b502-a8f2e710fc21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fee557be1a6474380ea0ba1b76d3bea', 'request_id': 'req-b9d0e677-9d7f-475a-b502-a8f2e710fc21'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:46.120863 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-b9d0e677-9d7f-475a-b502-a8f2e710fc21 admin admin] The token cache is being invalidate because project 7fee557be1a6474380ea0ba1b76d3bea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:46.123379 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-b9d0e677-9d7f-475a-b502-a8f2e710fc21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:46.125860 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-b9d0e677-9d7f-475a-b502-a8f2e710fc21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:46.134299 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1072/2150] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:45 2021] DELETE /identity/v3/projects/7fee557be1a6474380ea0ba1b76d3bea => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:39:46.136271 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4918a-1783-40f9-bdfe-fc7a2d77eb3a None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:46.136495 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4918a-1783-40f9-bdfe-fc7a2d77eb3a None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:46.136837 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4918a-1783-40f9-bdfe-fc7a2d77eb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:46.178648 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-38b4918a-1783-40f9-bdfe-fc7a2d77eb3a None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:46.180261 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-38b4918a-1783-40f9-bdfe-fc7a2d77eb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:46.250302 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f193f-216f-4193-a620-7c01476f1af1 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:46.325400 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1073/2151] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:46.335530 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bc211-7242-4075-a64a-9dc93496951b None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:46.336032 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bc211-7242-4075-a64a-9dc93496951b None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:46.339539 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bc211-7242-4075-a64a-9dc93496951b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:46.381010 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-6a9bc211-7242-4075-a64a-9dc93496951b None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:46.382587 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-6a9bc211-7242-4075-a64a-9dc93496951b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:46.393790 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1074/2152] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:46.396213 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a1f54-265d-4d08-aafc-aa818e0261f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:46.396564 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a1f54-265d-4d08-aafc-aa818e0261f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:46.396934 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a1f54-265d-4d08-aafc-aa818e0261f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:46.397095 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a1f54-265d-4d08-aafc-aa818e0261f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:46.397885 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a1f54-265d-4d08-aafc-aa818e0261f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:46.398489 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bc211-7242-4075-a64a-9dc93496951b None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:46.401935 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a1f54-265d-4d08-aafc-aa818e0261f4 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:46.409493 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bc211-7242-4075-a64a-9dc93496951b None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:46.412858 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1079/2153] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:46 2021] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:46.417465 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a1f54-265d-4d08-aafc-aa818e0261f4 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:46.420598 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995be13-a8dc-4a38-82c6-f8bf9df6fda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:46.421902 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995be13-a8dc-4a38-82c6-f8bf9df6fda3 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:46.422357 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995be13-a8dc-4a38-82c6-f8bf9df6fda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:46.422799 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995be13-a8dc-4a38-82c6-f8bf9df6fda3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:46.423743 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995be13-a8dc-4a38-82c6-f8bf9df6fda3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:39:46.424146 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995be13-a8dc-4a38-82c6-f8bf9df6fda3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:46.424298 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-e45a1f54-265d-4d08-aafc-aa818e0261f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:46.425938 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995be13-a8dc-4a38-82c6-f8bf9df6fda3 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:46.440874 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1075/2154] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:39:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:39:46.444685 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995be13-a8dc-4a38-82c6-f8bf9df6fda3 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:46.455927 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a1f54-265d-4d08-aafc-aa818e0261f4 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:46.459080 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995be13-a8dc-4a38-82c6-f8bf9df6fda3 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:46.461798 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e081b-62ae-433b-8ca4-954f1cc7cfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:46.462903 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e081b-62ae-433b-8ca4-954f1cc7cfa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:46.463339 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e081b-62ae-433b-8ca4-954f1cc7cfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:46.464022 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e081b-62ae-433b-8ca4-954f1cc7cfa0 admin admin] PATH_INFO: `/v3/projects/512a965718f84b8a8730dea3781e6a38/users/3f01bb137fc240ad94c88dce19699232/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:46.466338 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d41dd-6f57-42ee-9353-1aea8acf0447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:46.466706 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e081b-62ae-433b-8ca4-954f1cc7cfa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=512a965718f84b8a8730dea3781e6a38, user_id=3f01bb137fc240ad94c88dce19699232, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:46.467135 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d41dd-6f57-42ee-9353-1aea8acf0447 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:46.467481 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d41dd-6f57-42ee-9353-1aea8acf0447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:46.467873 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d41dd-6f57-42ee-9353-1aea8acf0447 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:46.468811 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d41dd-6f57-42ee-9353-1aea8acf0447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:46.470615 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e081b-62ae-433b-8ca4-954f1cc7cfa0 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:46.471653 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d41dd-6f57-42ee-9353-1aea8acf0447 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:46.492149 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1080/2155] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:46 2021] PUT /identity/v3/projects/512a965718f84b8a8730dea3781e6a38/users/3f01bb137fc240ad94c88dce19699232/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:46.501423 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a1459-3cfa-4c6b-bd88-954a5477dae2 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:46.501723 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a1459-3cfa-4c6b-bd88-954a5477dae2 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:46.501998 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a1459-3cfa-4c6b-bd88-954a5477dae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:46.518812 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1076/2156] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:39:46 2021] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:39:46.520920 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d41dd-6f57-42ee-9353-1aea8acf0447 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:46.539427 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-000a1459-3cfa-4c6b-bd88-954a5477dae2 None None] MFA Rules not processed for user `3f01bb137fc240ad94c88dce19699232`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:46.541916 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-000a1459-3cfa-4c6b-bd88-954a5477dae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:46.616154 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d41dd-6f57-42ee-9353-1aea8acf0447 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:46.622864 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6939ec-345a-4fed-9564-eaaa8573786d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:46.623805 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6939ec-345a-4fed-9564-eaaa8573786d admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:46.624301 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6939ec-345a-4fed-9564-eaaa8573786d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:46.624645 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6939ec-345a-4fed-9564-eaaa8573786d admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:46.625951 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6939ec-345a-4fed-9564-eaaa8573786d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:46.628635 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6939ec-345a-4fed-9564-eaaa8573786d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:46.659104 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1077/2157] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:39:46 2021] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:46.660069 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6939ec-345a-4fed-9564-eaaa8573786d admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:46.676095 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6939ec-345a-4fed-9564-eaaa8573786d admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:46.690429 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1081/2158] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:46 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:46.695801 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af83b2-bce9-4f7e-a857-a9dea0b3e462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:46.698111 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af83b2-bce9-4f7e-a857-a9dea0b3e462 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:46.698398 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af83b2-bce9-4f7e-a857-a9dea0b3e462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:46.698675 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af83b2-bce9-4f7e-a857-a9dea0b3e462 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:46.700590 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af83b2-bce9-4f7e-a857-a9dea0b3e462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:46.701589 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a1459-3cfa-4c6b-bd88-954a5477dae2 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:46.703274 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-000a1459-3cfa-4c6b-bd88-954a5477dae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:46.704345 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af83b2-bce9-4f7e-a857-a9dea0b3e462 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:46.740979 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1078/2159] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:46 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:46.742102 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af83b2-bce9-4f7e-a857-a9dea0b3e462 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:46.766902 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af83b2-bce9-4f7e-a857-a9dea0b3e462 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:46.780938 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ba1bd-f36e-496c-97e9-3445e0808ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:46.782914 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ba1bd-f36e-496c-97e9-3445e0808ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:46.783432 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ba1bd-f36e-496c-97e9-3445e0808ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:46.783979 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ba1bd-f36e-496c-97e9-3445e0808ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:46.785048 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ba1bd-f36e-496c-97e9-3445e0808ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:46.787567 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ba1bd-f36e-496c-97e9-3445e0808ca9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:46.824552 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1079/2160] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:46 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:46.829986 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ba1bd-f36e-496c-97e9-3445e0808ca9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:46.852705 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a1459-3cfa-4c6b-bd88-954a5477dae2 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:46.858414 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ba1bd-f36e-496c-97e9-3445e0808ca9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:46.859441 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6763a2-1e47-4bc8-b52e-8a3ca8b25d1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:46.860580 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6763a2-1e47-4bc8-b52e-8a3ca8b25d1e service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:46.861155 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6763a2-1e47-4bc8-b52e-8a3ca8b25d1e service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:46.861688 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6763a2-1e47-4bc8-b52e-8a3ca8b25d1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:46.874893 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449de35-efc5-4ca6-b49e-8406540f715f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:46.876049 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6763a2-1e47-4bc8-b52e-8a3ca8b25d1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:46.876590 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449de35-efc5-4ca6-b49e-8406540f715f admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:46.876808 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449de35-efc5-4ca6-b49e-8406540f715f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:46.877090 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449de35-efc5-4ca6-b49e-8406540f715f admin admin] PATH_INFO: `/v3/projects/179489b967484436b097819682003c3b/users/6f285e8863a8465aa48c10c216647bfc/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:46.879002 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6763a2-1e47-4bc8-b52e-8a3ca8b25d1e service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:46.901108 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1082/2161] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:46 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:46.901341 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449de35-efc5-4ca6-b49e-8406540f715f admin admin] RBAC: Authorizing `identity:create_grant(project_id=179489b967484436b097819682003c3b, user_id=6f285e8863a8465aa48c10c216647bfc, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:46.905632 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449de35-efc5-4ca6-b49e-8406540f715f admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:46.925641 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1080/2162] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:46 2021] PUT /identity/v3/projects/179489b967484436b097819682003c3b/users/6f285e8863a8465aa48c10c216647bfc/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:46.940345 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50077c7-0fdb-4eb5-91eb-a1ec155a6cd3 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:46.941117 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50077c7-0fdb-4eb5-91eb-a1ec155a6cd3 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:46.941654 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50077c7-0fdb-4eb5-91eb-a1ec155a6cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:46.988879 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-a50077c7-0fdb-4eb5-91eb-a1ec155a6cd3 None None] MFA Rules not processed for user `6f285e8863a8465aa48c10c216647bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:46.990497 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-a50077c7-0fdb-4eb5-91eb-a1ec155a6cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:47.076926 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1083/2163] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:46 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:47.088064 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449de35-efc5-4ca6-b49e-8406540f715f admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:47.208692 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449de35-efc5-4ca6-b49e-8406540f715f admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:47.215028 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710ed72-fb03-499a-aade-93f0c4209c00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:47.216123 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710ed72-fb03-499a-aade-93f0c4209c00 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:47.216496 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710ed72-fb03-499a-aade-93f0c4209c00 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:47.216866 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710ed72-fb03-499a-aade-93f0c4209c00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:47.237417 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710ed72-fb03-499a-aade-93f0c4209c00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:47.243731 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710ed72-fb03-499a-aade-93f0c4209c00 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:47.280265 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1081/2164] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:47 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:47.303350 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50077c7-0fdb-4eb5-91eb-a1ec155a6cd3 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:47.390614 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710ed72-fb03-499a-aade-93f0c4209c00 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:47.393410 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e710ed72-fb03-499a-aade-93f0c4209c00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:47.428496 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50077c7-0fdb-4eb5-91eb-a1ec155a6cd3 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:47.442315 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b32d9b-e59d-43c5-b69a-a85ebb289a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:47.443385 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b32d9b-e59d-43c5-b69a-a85ebb289a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:47.443804 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b32d9b-e59d-43c5-b69a-a85ebb289a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:47.444234 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b32d9b-e59d-43c5-b69a-a85ebb289a61 admin admin] PATH_INFO: `/v3/users/6f285e8863a8465aa48c10c216647bfc` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:47.445914 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b32d9b-e59d-43c5-b69a-a85ebb289a61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f285e8863a8465aa48c10c216647bfc)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:47.455024 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b32d9b-e59d-43c5-b69a-a85ebb289a61 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:47.535830 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-71b32d9b-e59d-43c5-b69a-a85ebb289a61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f285e8863a8465aa48c10c216647bfc'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:47.574069 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-71b32d9b-e59d-43c5-b69a-a85ebb289a61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f285e8863a8465aa48c10c216647bfc'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:47.585739 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710ed72-fb03-499a-aade-93f0c4209c00 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:47.601273 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f808beb-0a98-47ae-8cf0-2e568a305edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:47.602469 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f808beb-0a98-47ae-8cf0-2e568a305edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:47.603065 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f808beb-0a98-47ae-8cf0-2e568a305edc admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:47.604161 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f808beb-0a98-47ae-8cf0-2e568a305edc admin admin] PATH_INFO: `/v3/users/de5af1fd00e44cac8cc30236ba302b57` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:47.609634 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-71b32d9b-e59d-43c5-b69a-a85ebb289a61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f285e8863a8465aa48c10c216647bfc'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:47.610715 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f808beb-0a98-47ae-8cf0-2e568a305edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=de5af1fd00e44cac8cc30236ba302b57)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:47.612740 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f808beb-0a98-47ae-8cf0-2e568a305edc admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:47.623261 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-71b32d9b-e59d-43c5-b69a-a85ebb289a61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f285e8863a8465aa48c10c216647bfc'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:47.634375 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-71b32d9b-e59d-43c5-b69a-a85ebb289a61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f285e8863a8465aa48c10c216647bfc'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:47.643727 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1084/2165] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:47 2021] DELETE /identity/v3/users/6f285e8863a8465aa48c10c216647bfc => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:47.646966 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9c846-9ab6-4ce7-875e-98b11dad21bc None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:47.649281 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9c846-9ab6-4ce7-875e-98b11dad21bc None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:47.650359 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9c846-9ab6-4ce7-875e-98b11dad21bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:47.708745 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-81e9c846-9ab6-4ce7-875e-98b11dad21bc None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:47.709315 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-6f808beb-0a98-47ae-8cf0-2e568a305edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de5af1fd00e44cac8cc30236ba302b57'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:47.709985 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-81e9c846-9ab6-4ce7-875e-98b11dad21bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:47.732479 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-6f808beb-0a98-47ae-8cf0-2e568a305edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de5af1fd00e44cac8cc30236ba302b57'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:47.749575 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-6f808beb-0a98-47ae-8cf0-2e568a305edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de5af1fd00e44cac8cc30236ba302b57'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:47.752086 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-6f808beb-0a98-47ae-8cf0-2e568a305edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de5af1fd00e44cac8cc30236ba302b57'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:47.770426 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-6f808beb-0a98-47ae-8cf0-2e568a305edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de5af1fd00e44cac8cc30236ba302b57'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:47.784926 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1082/2166] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:47 2021] DELETE /identity/v3/users/de5af1fd00e44cac8cc30236ba302b57 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:47.788826 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78060d-cb0f-4da3-b85b-e555c78982f4 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:47.789284 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78060d-cb0f-4da3-b85b-e555c78982f4 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:47.792552 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78060d-cb0f-4da3-b85b-e555c78982f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:47.826491 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-9a78060d-cb0f-4da3-b85b-e555c78982f4 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:47.829592 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-9a78060d-cb0f-4da3-b85b-e555c78982f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:47.873205 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1085/2167] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:47.874761 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9c846-9ab6-4ce7-875e-98b11dad21bc None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:47.877213 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-81e9c846-9ab6-4ce7-875e-98b11dad21bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:47.905107 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9c846-9ab6-4ce7-875e-98b11dad21bc None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:47.961656 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1083/2168] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:47.964385 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78060d-cb0f-4da3-b85b-e555c78982f4 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:47.967507 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-9a78060d-cb0f-4da3-b85b-e555c78982f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:48.017758 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c699ae2-c327-4caf-8a06-8cc3a3d44dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:48.020392 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c699ae2-c327-4caf-8a06-8cc3a3d44dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:48.020886 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c699ae2-c327-4caf-8a06-8cc3a3d44dca admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:48.021179 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c699ae2-c327-4caf-8a06-8cc3a3d44dca admin admin] PATH_INFO: `/v3/users/6b8cf2aedd93473aab4d5da8e7a48f72` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:48.022700 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c699ae2-c327-4caf-8a06-8cc3a3d44dca admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b8cf2aedd93473aab4d5da8e7a48f72)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:48.027565 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c699ae2-c327-4caf-8a06-8cc3a3d44dca admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:48.077539 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78060d-cb0f-4da3-b85b-e555c78982f4 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:48.081742 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260b778-aaf0-4a38-b4a0-74403568ff9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:48.082402 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260b778-aaf0-4a38-b4a0-74403568ff9b service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:48.082733 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260b778-aaf0-4a38-b4a0-74403568ff9b service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:48.083507 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260b778-aaf0-4a38-b4a0-74403568ff9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:48.103896 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260b778-aaf0-4a38-b4a0-74403568ff9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:48.123324 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260b778-aaf0-4a38-b4a0-74403568ff9b service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:48.130234 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8c699ae2-c327-4caf-8a06-8cc3a3d44dca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b8cf2aedd93473aab4d5da8e7a48f72'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:48.142478 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1084/2169] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:48.143591 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260b778-aaf0-4a38-b4a0-74403568ff9b service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:48.155320 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8c699ae2-c327-4caf-8a06-8cc3a3d44dca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b8cf2aedd93473aab4d5da8e7a48f72'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:48.160330 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260b778-aaf0-4a38-b4a0-74403568ff9b service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:48.164037 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8c699ae2-c327-4caf-8a06-8cc3a3d44dca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b8cf2aedd93473aab4d5da8e7a48f72'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:48.170550 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b13873-af68-4b69-938c-df43720bcec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:48.171224 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b13873-af68-4b69-938c-df43720bcec0 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:48.171511 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b13873-af68-4b69-938c-df43720bcec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:48.171919 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b13873-af68-4b69-938c-df43720bcec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:48.183197 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8c699ae2-c327-4caf-8a06-8cc3a3d44dca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b8cf2aedd93473aab4d5da8e7a48f72'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:48.194818 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b13873-af68-4b69-938c-df43720bcec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:48.196327 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b13873-af68-4b69-938c-df43720bcec0 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:48.206842 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8c699ae2-c327-4caf-8a06-8cc3a3d44dca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b8cf2aedd93473aab4d5da8e7a48f72'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:48.230305 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1085/2170] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:48.260885 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bbc2c-f35b-41f9-bac3-27ed9d236fe0 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:48.261213 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bbc2c-f35b-41f9-bac3-27ed9d236fe0 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:48.261436 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bbc2c-f35b-41f9-bac3-27ed9d236fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:48.262996 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1086/2171] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:47 2021] DELETE /identity/v3/users/6b8cf2aedd93473aab4d5da8e7a48f72 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:48.310088 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-1b4bbc2c-f35b-41f9-bac3-27ed9d236fe0 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:48.311343 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-1b4bbc2c-f35b-41f9-bac3-27ed9d236fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:48.465289 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1086/2172] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:48.484043 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c699ae2-c327-4caf-8a06-8cc3a3d44dca admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:48.485829 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-8c699ae2-c327-4caf-8a06-8cc3a3d44dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:48.680288 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c699ae2-c327-4caf-8a06-8cc3a3d44dca admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:48.684992 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8729e1-60f9-4cfe-a8db-2b0b71bf2ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:48.685651 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8729e1-60f9-4cfe-a8db-2b0b71bf2ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:48.685932 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8729e1-60f9-4cfe-a8db-2b0b71bf2ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:48.686207 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8729e1-60f9-4cfe-a8db-2b0b71bf2ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:48.718651 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8729e1-60f9-4cfe-a8db-2b0b71bf2ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:48.723496 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8729e1-60f9-4cfe-a8db-2b0b71bf2ba2 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:48.744820 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1087/2173] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:49.004276 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bbc2c-f35b-41f9-bac3-27ed9d236fe0 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:49.006580 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-1b4bbc2c-f35b-41f9-bac3-27ed9d236fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:49.034688 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bbc2c-f35b-41f9-bac3-27ed9d236fe0 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:49.070454 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ffc23-dee9-4a5b-b2c8-18d3164a2c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:49.071782 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ffc23-dee9-4a5b-b2c8-18d3164a2c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:49.071961 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ffc23-dee9-4a5b-b2c8-18d3164a2c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:49.072242 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ffc23-dee9-4a5b-b2c8-18d3164a2c99 admin admin] PATH_INFO: `/v3/projects/179489b967484436b097819682003c3b` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:49.073566 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ffc23-dee9-4a5b-b2c8-18d3164a2c99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=179489b967484436b097819682003c3b)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:49.075570 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ffc23-dee9-4a5b-b2c8-18d3164a2c99 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:49.140344 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-e43ffc23-dee9-4a5b-b2c8-18d3164a2c99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '179489b967484436b097819682003c3b', 'request_id': 'req-e43ffc23-dee9-4a5b-b2c8-18d3164a2c99'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:49.147102 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-e43ffc23-dee9-4a5b-b2c8-18d3164a2c99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '179489b967484436b097819682003c3b', 'request_id': 'req-e43ffc23-dee9-4a5b-b2c8-18d3164a2c99'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:49.153648 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-e43ffc23-dee9-4a5b-b2c8-18d3164a2c99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '179489b967484436b097819682003c3b', 'request_id': 'req-e43ffc23-dee9-4a5b-b2c8-18d3164a2c99'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:49.169199 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-e43ffc23-dee9-4a5b-b2c8-18d3164a2c99 admin admin] The token cache is being invalidate because project 179489b967484436b097819682003c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:49.169499 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-e43ffc23-dee9-4a5b-b2c8-18d3164a2c99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:49.170185 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-e43ffc23-dee9-4a5b-b2c8-18d3164a2c99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:49.172485 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1087/2174] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:48 2021] DELETE /identity/v3/projects/179489b967484436b097819682003c3b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:49.177987 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b1c09-73f2-4581-940a-552cf726a825 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:49.178510 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b1c09-73f2-4581-940a-552cf726a825 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:49.178605 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b1c09-73f2-4581-940a-552cf726a825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:49.202415 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-1a3b1c09-73f2-4581-940a-552cf726a825 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:49.206636 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-1a3b1c09-73f2-4581-940a-552cf726a825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:49.303532 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1088/2175] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:49.313042 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7991072-5605-4214-a393-2ebe46a747d0 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:49.313362 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7991072-5605-4214-a393-2ebe46a747d0 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:49.313684 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7991072-5605-4214-a393-2ebe46a747d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:49.318848 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b1c09-73f2-4581-940a-552cf726a825 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:49.320515 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-1a3b1c09-73f2-4581-940a-552cf726a825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:49.334748 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b1c09-73f2-4581-940a-552cf726a825 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:49.355182 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215aa8ac-12a3-4d7a-828c-0c3fb9517090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:49.355355 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-e7991072-5605-4214-a393-2ebe46a747d0 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:49.356570 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e7991072-5605-4214-a393-2ebe46a747d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:49.357143 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215aa8ac-12a3-4d7a-828c-0c3fb9517090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:49.357607 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215aa8ac-12a3-4d7a-828c-0c3fb9517090 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:49.358076 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215aa8ac-12a3-4d7a-828c-0c3fb9517090 admin admin] PATH_INFO: `/v3/projects/ad8a39e369044619b6586289e3f7e477` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:49.359345 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215aa8ac-12a3-4d7a-828c-0c3fb9517090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad8a39e369044619b6586289e3f7e477)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:49.361781 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215aa8ac-12a3-4d7a-828c-0c3fb9517090 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:49.374177 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1088/2176] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:49.378538 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7991072-5605-4214-a393-2ebe46a747d0 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:49.398617 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7991072-5605-4214-a393-2ebe46a747d0 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:49.404874 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825c611-99c4-42a7-ab2f-7ade5f44fcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:49.405593 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825c611-99c4-42a7-ab2f-7ade5f44fcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:49.405926 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825c611-99c4-42a7-ab2f-7ade5f44fcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:49.406212 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825c611-99c4-42a7-ab2f-7ade5f44fcf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:49.406951 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825c611-99c4-42a7-ab2f-7ade5f44fcf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:39:49.407256 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825c611-99c4-42a7-ab2f-7ade5f44fcf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:49.412683 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825c611-99c4-42a7-ab2f-7ade5f44fcf4 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:49.434977 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1089/2177] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:39:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:39:49.436467 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825c611-99c4-42a7-ab2f-7ade5f44fcf4 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:49.452685 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825c611-99c4-42a7-ab2f-7ade5f44fcf4 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:49.453750 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-215aa8ac-12a3-4d7a-828c-0c3fb9517090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad8a39e369044619b6586289e3f7e477', 'request_id': 'req-215aa8ac-12a3-4d7a-828c-0c3fb9517090'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:49.464782 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-215aa8ac-12a3-4d7a-828c-0c3fb9517090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad8a39e369044619b6586289e3f7e477', 'request_id': 'req-215aa8ac-12a3-4d7a-828c-0c3fb9517090'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:49.482620 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-215aa8ac-12a3-4d7a-828c-0c3fb9517090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad8a39e369044619b6586289e3f7e477', 'request_id': 'req-215aa8ac-12a3-4d7a-828c-0c3fb9517090'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:49.518477 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-215aa8ac-12a3-4d7a-828c-0c3fb9517090 admin admin] The token cache is being invalidate because project ad8a39e369044619b6586289e3f7e477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:49.519288 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-215aa8ac-12a3-4d7a-828c-0c3fb9517090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:49.520540 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-215aa8ac-12a3-4d7a-828c-0c3fb9517090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:49.523349 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1089/2178] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:49 2021] DELETE /identity/v3/projects/ad8a39e369044619b6586289e3f7e477 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:49.529883 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37aa013-6e73-4dcc-864b-1d7bb7fe1099 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:49.530283 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37aa013-6e73-4dcc-864b-1d7bb7fe1099 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:49.530664 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37aa013-6e73-4dcc-864b-1d7bb7fe1099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:49.566233 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb06ac3-76cf-45a1-8350-63a6a038d5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:49.567239 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb06ac3-76cf-45a1-8350-63a6a038d5cf admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:49.567239 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb06ac3-76cf-45a1-8350-63a6a038d5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:49.567532 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb06ac3-76cf-45a1-8350-63a6a038d5cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:49.568146 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb06ac3-76cf-45a1-8350-63a6a038d5cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:49.573444 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb06ac3-76cf-45a1-8350-63a6a038d5cf admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:49.578066 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-a37aa013-6e73-4dcc-864b-1d7bb7fe1099 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:49.579413 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-a37aa013-6e73-4dcc-864b-1d7bb7fe1099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:49.609951 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1090/2179] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:39:49.611602 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37aa013-6e73-4dcc-864b-1d7bb7fe1099 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:49.613975 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-a37aa013-6e73-4dcc-864b-1d7bb7fe1099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:49.624120 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1090/2180] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:39:49 2021] POST /identity/v3/projects => generated 379 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:49.627069 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff828caa-f578-4cdd-a15b-6740386bf3fe None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:49.627362 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff828caa-f578-4cdd-a15b-6740386bf3fe None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:49.627729 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff828caa-f578-4cdd-a15b-6740386bf3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:49.653754 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37aa013-6e73-4dcc-864b-1d7bb7fe1099 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:49.664150 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-ff828caa-f578-4cdd-a15b-6740386bf3fe None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:49.669958 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-ff828caa-f578-4cdd-a15b-6740386bf3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:49.762290 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1091/2181] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:49.763260 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff828caa-f578-4cdd-a15b-6740386bf3fe None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:49.764689 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-ff828caa-f578-4cdd-a15b-6740386bf3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:49.784352 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e3d97-ecf4-4cfd-90dc-d4b23c8e5df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:49.785637 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e3d97-ecf4-4cfd-90dc-d4b23c8e5df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:49.785987 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e3d97-ecf4-4cfd-90dc-d4b23c8e5df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:49.786511 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e3d97-ecf4-4cfd-90dc-d4b23c8e5df9 admin admin] PATH_INFO: `/v3/projects/22ef5e73477a48dca86738df21ce82ef` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:49.789163 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e3d97-ecf4-4cfd-90dc-d4b23c8e5df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ef5e73477a48dca86738df21ce82ef)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:49.793335 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e3d97-ecf4-4cfd-90dc-d4b23c8e5df9 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:49.797987 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff828caa-f578-4cdd-a15b-6740386bf3fe None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:49.812434 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c715ad-4d96-4212-97e8-de3254f39ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:49.813389 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c715ad-4d96-4212-97e8-de3254f39ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:49.813735 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c715ad-4d96-4212-97e8-de3254f39ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:49.820157 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c715ad-4d96-4212-97e8-de3254f39ab9 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:49.821656 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c715ad-4d96-4212-97e8-de3254f39ab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:49.824721 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c715ad-4d96-4212-97e8-de3254f39ab9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:49.876389 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1092/2182] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:39:49 2021] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:49.877573 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c715ad-4d96-4212-97e8-de3254f39ab9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:49.926926 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c715ad-4d96-4212-97e8-de3254f39ab9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:49.932168 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-4e9e3d97-ecf4-4cfd-90dc-d4b23c8e5df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ef5e73477a48dca86738df21ce82ef', 'request_id': 'req-4e9e3d97-ecf4-4cfd-90dc-d4b23c8e5df9'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:49.945459 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-4e9e3d97-ecf4-4cfd-90dc-d4b23c8e5df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ef5e73477a48dca86738df21ce82ef', 'request_id': 'req-4e9e3d97-ecf4-4cfd-90dc-d4b23c8e5df9'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:49.955400 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-4e9e3d97-ecf4-4cfd-90dc-d4b23c8e5df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ef5e73477a48dca86738df21ce82ef', 'request_id': 'req-4e9e3d97-ecf4-4cfd-90dc-d4b23c8e5df9'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:49.983332 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-4e9e3d97-ecf4-4cfd-90dc-d4b23c8e5df9 admin admin] The token cache is being invalidate because project 22ef5e73477a48dca86738df21ce82ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:49.983540 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-4e9e3d97-ecf4-4cfd-90dc-d4b23c8e5df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:49.984174 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-4e9e3d97-ecf4-4cfd-90dc-d4b23c8e5df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:49.985912 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1091/2183] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:49 2021] DELETE /identity/v3/projects/22ef5e73477a48dca86738df21ce82ef => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:49.987828 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e3d97-ecf4-4cfd-90dc-d4b23c8e5df9 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:49.989486 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-4e9e3d97-ecf4-4cfd-90dc-d4b23c8e5df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:50.045183 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b32be8-0d26-4423-84c4-70ec275d3e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:50.046609 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b32be8-0d26-4423-84c4-70ec275d3e80 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:50.047150 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b32be8-0d26-4423-84c4-70ec275d3e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:50.047546 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b32be8-0d26-4423-84c4-70ec275d3e80 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:50.048842 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b32be8-0d26-4423-84c4-70ec275d3e80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:39:50.049350 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b32be8-0d26-4423-84c4-70ec275d3e80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:50.051915 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b32be8-0d26-4423-84c4-70ec275d3e80 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:50.099068 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1093/2184] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:39:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:39:50.100503 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b32be8-0d26-4423-84c4-70ec275d3e80 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:50.104005 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-81b32be8-0d26-4423-84c4-70ec275d3e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:50.131406 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e3d97-ecf4-4cfd-90dc-d4b23c8e5df9 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:50.148119 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b32be8-0d26-4423-84c4-70ec275d3e80 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:50.152848 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c7ad3-7e8e-45c9-adf2-53c1b2e03d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:50.153879 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c7ad3-7e8e-45c9-adf2-53c1b2e03d27 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:50.154634 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c7ad3-7e8e-45c9-adf2-53c1b2e03d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:50.155074 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c7ad3-7e8e-45c9-adf2-53c1b2e03d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:50.155874 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c7ad3-7e8e-45c9-adf2-53c1b2e03d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:50.157559 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c7ad3-7e8e-45c9-adf2-53c1b2e03d27 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:50.167124 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01918bfa-5580-4338-8e13-f754ea570b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:50.168375 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01918bfa-5580-4338-8e13-f754ea570b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:50.168762 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01918bfa-5580-4338-8e13-f754ea570b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:50.169134 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01918bfa-5580-4338-8e13-f754ea570b07 admin admin] PATH_INFO: `/v3/users/3f01bb137fc240ad94c88dce19699232` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:50.173216 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01918bfa-5580-4338-8e13-f754ea570b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f01bb137fc240ad94c88dce19699232)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:50.177083 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01918bfa-5580-4338-8e13-f754ea570b07 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:50.202884 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1092/2185] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:49 2021] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:50.216575 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c7ad3-7e8e-45c9-adf2-53c1b2e03d27 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:50.221440 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-676c7ad3-7e8e-45c9-adf2-53c1b2e03d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:50.249381 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c7ad3-7e8e-45c9-adf2-53c1b2e03d27 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:50.288659 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8544a92-6195-4fa5-a256-8acd7db4d56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:50.289569 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8544a92-6195-4fa5-a256-8acd7db4d56d admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:50.292739 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8544a92-6195-4fa5-a256-8acd7db4d56d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:50.295119 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8544a92-6195-4fa5-a256-8acd7db4d56d admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:50.296102 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8544a92-6195-4fa5-a256-8acd7db4d56d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:50.299696 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8544a92-6195-4fa5-a256-8acd7db4d56d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:50.305140 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-01918bfa-5580-4338-8e13-f754ea570b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f01bb137fc240ad94c88dce19699232'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:50.321892 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-01918bfa-5580-4338-8e13-f754ea570b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f01bb137fc240ad94c88dce19699232'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:50.333289 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-01918bfa-5580-4338-8e13-f754ea570b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f01bb137fc240ad94c88dce19699232'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:50.334182 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-01918bfa-5580-4338-8e13-f754ea570b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f01bb137fc240ad94c88dce19699232'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:50.348202 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-01918bfa-5580-4338-8e13-f754ea570b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f01bb137fc240ad94c88dce19699232'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:50.356056 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1094/2186] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:50 2021] DELETE /identity/v3/users/3f01bb137fc240ad94c88dce19699232 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:50.357075 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01918bfa-5580-4338-8e13-f754ea570b07 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:50.358719 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1093/2187] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:39:50 2021] POST /identity/v3/projects => generated 397 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:50.362248 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-01918bfa-5580-4338-8e13-f754ea570b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:50.363411 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8544a92-6195-4fa5-a256-8acd7db4d56d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:50.368014 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-c8544a92-6195-4fa5-a256-8acd7db4d56d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:50.442572 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8544a92-6195-4fa5-a256-8acd7db4d56d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:50.449362 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c907e-2d8e-4fd8-ac97-2a90e71ebcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:50.450371 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c907e-2d8e-4fd8-ac97-2a90e71ebcb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:50.450805 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c907e-2d8e-4fd8-ac97-2a90e71ebcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:50.451331 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c907e-2d8e-4fd8-ac97-2a90e71ebcb9 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:50.452606 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c907e-2d8e-4fd8-ac97-2a90e71ebcb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:50.455591 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c907e-2d8e-4fd8-ac97-2a90e71ebcb9 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:50.481838 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1094/2188] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:39:50 2021] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:50.485870 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c907e-2d8e-4fd8-ac97-2a90e71ebcb9 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:50.488466 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01918bfa-5580-4338-8e13-f754ea570b07 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:50.497535 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c907e-2d8e-4fd8-ac97-2a90e71ebcb9 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:50.498984 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097783bc-2483-4f2b-9130-e2c96bdbce78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:50.499776 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097783bc-2483-4f2b-9130-e2c96bdbce78 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:50.500135 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097783bc-2483-4f2b-9130-e2c96bdbce78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:50.500486 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097783bc-2483-4f2b-9130-e2c96bdbce78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:50.501311 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097783bc-2483-4f2b-9130-e2c96bdbce78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:50.502997 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097783bc-2483-4f2b-9130-e2c96bdbce78 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:50.503445 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd322f9f-6357-4ec7-9dfc-401208c867d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:50.504134 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd322f9f-6357-4ec7-9dfc-401208c867d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:50.504417 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd322f9f-6357-4ec7-9dfc-401208c867d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:50.504688 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd322f9f-6357-4ec7-9dfc-401208c867d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:50.505766 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd322f9f-6357-4ec7-9dfc-401208c867d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:50.507545 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd322f9f-6357-4ec7-9dfc-401208c867d9 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:50.521454 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1095/2189] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:50 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:50.522371 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd322f9f-6357-4ec7-9dfc-401208c867d9 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:50.527959 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1095/2190] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:50 2021] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:50.530165 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097783bc-2483-4f2b-9130-e2c96bdbce78 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:50.533829 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd322f9f-6357-4ec7-9dfc-401208c867d9 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:50.541634 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4af98-e277-43ba-b03c-0dc36a3246cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:50.542457 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4af98-e277-43ba-b03c-0dc36a3246cf admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:50.542841 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4af98-e277-43ba-b03c-0dc36a3246cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:50.543220 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4af98-e277-43ba-b03c-0dc36a3246cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:50.544189 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4af98-e277-43ba-b03c-0dc36a3246cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:50.546271 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4af98-e277-43ba-b03c-0dc36a3246cf admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:50.550198 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097783bc-2483-4f2b-9130-e2c96bdbce78 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:50.563880 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df807966-b941-4cfd-b1e8-12f14e08bd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:50.564947 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1096/2191] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:50 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:50.567730 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df807966-b941-4cfd-b1e8-12f14e08bd15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:50.568229 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df807966-b941-4cfd-b1e8-12f14e08bd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:50.568754 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df807966-b941-4cfd-b1e8-12f14e08bd15 admin admin] PATH_INFO: `/v3/projects/6065f66d6938444d868fb5b3225ce1a1/users/1a90e3068213436498812ad167bcb19f/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:50.577001 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4af98-e277-43ba-b03c-0dc36a3246cf admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:50.592101 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4af98-e277-43ba-b03c-0dc36a3246cf admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:50.592667 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df807966-b941-4cfd-b1e8-12f14e08bd15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6065f66d6938444d868fb5b3225ce1a1, user_id=1a90e3068213436498812ad167bcb19f, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:50.596513 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df807966-b941-4cfd-b1e8-12f14e08bd15 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:50.600984 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0efff3-5377-488b-be06-b9d3c784410a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:50.603035 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0efff3-5377-488b-be06-b9d3c784410a admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:50.604212 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0efff3-5377-488b-be06-b9d3c784410a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:50.604970 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0efff3-5377-488b-be06-b9d3c784410a admin admin] PATH_INFO: `/v3/projects/ef6ee5c5d12e489fa42f3ee9ed559afa/users/e5b9ce9ec2154899a8c11a9e2c320fdc/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:50.615988 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1096/2192] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:50 2021] PUT /identity/v3/projects/6065f66d6938444d868fb5b3225ce1a1/users/1a90e3068213436498812ad167bcb19f/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:50.622754 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d8680-addd-4d82-a5c7-dc77eae135f6 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:50.623735 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d8680-addd-4d82-a5c7-dc77eae135f6 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:50.623735 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d8680-addd-4d82-a5c7-dc77eae135f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:50.633027 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0efff3-5377-488b-be06-b9d3c784410a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef6ee5c5d12e489fa42f3ee9ed559afa, user_id=e5b9ce9ec2154899a8c11a9e2c320fdc, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:50.636446 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0efff3-5377-488b-be06-b9d3c784410a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:50.656544 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1097/2193] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:50 2021] PUT /identity/v3/projects/ef6ee5c5d12e489fa42f3ee9ed559afa/users/e5b9ce9ec2154899a8c11a9e2c320fdc/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:50.656980 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-c58d8680-addd-4d82-a5c7-dc77eae135f6 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:50.663922 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c58d8680-addd-4d82-a5c7-dc77eae135f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:50.668091 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5fe21-cdc1-489e-8308-ee9b5a7773a5 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:50.668491 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5fe21-cdc1-489e-8308-ee9b5a7773a5 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:50.668876 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5fe21-cdc1-489e-8308-ee9b5a7773a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:50.714821 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-22b5fe21-cdc1-489e-8308-ee9b5a7773a5 None None] MFA Rules not processed for user `e5b9ce9ec2154899a8c11a9e2c320fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:50.716276 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-22b5fe21-cdc1-489e-8308-ee9b5a7773a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:50.743323 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1097/2194] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:50.773082 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d8680-addd-4d82-a5c7-dc77eae135f6 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:50.775127 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c58d8680-addd-4d82-a5c7-dc77eae135f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:50.845750 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1098/2195] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:50 2021] POST /identity/v3/auth/tokens => generated 3417 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:50.854361 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5fe21-cdc1-489e-8308-ee9b5a7773a5 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:50.855955 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-22b5fe21-cdc1-489e-8308-ee9b5a7773a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:50.863386 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d8680-addd-4d82-a5c7-dc77eae135f6 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:50.869712 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403691c-2e6e-4299-acd3-e53b69191fe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:50.870933 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403691c-2e6e-4299-acd3-e53b69191fe5 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:50.870933 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403691c-2e6e-4299-acd3-e53b69191fe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:50.871238 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403691c-2e6e-4299-acd3-e53b69191fe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:50.886920 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403691c-2e6e-4299-acd3-e53b69191fe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:50.890020 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403691c-2e6e-4299-acd3-e53b69191fe5 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:50.914635 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1098/2196] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:50.965141 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5fe21-cdc1-489e-8308-ee9b5a7773a5 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:50.970364 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739038e-cedd-445f-a78b-9c8a0ed0938c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:50.970711 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739038e-cedd-445f-a78b-9c8a0ed0938c service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:50.971141 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739038e-cedd-445f-a78b-9c8a0ed0938c service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:50.971708 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739038e-cedd-445f-a78b-9c8a0ed0938c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:50.986759 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739038e-cedd-445f-a78b-9c8a0ed0938c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:50.989752 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739038e-cedd-445f-a78b-9c8a0ed0938c service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:51.003832 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1099/2197] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:50 2021] GET /identity/v3/auth/tokens => generated 3417 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:39:51.167695 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403691c-2e6e-4299-acd3-e53b69191fe5 service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:51.169565 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-f403691c-2e6e-4299-acd3-e53b69191fe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:51.192562 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403691c-2e6e-4299-acd3-e53b69191fe5 service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:51.204524 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40654fee-6b08-4815-80c5-cc2020d5f01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:51.205396 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40654fee-6b08-4815-80c5-cc2020d5f01c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:51.205727 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40654fee-6b08-4815-80c5-cc2020d5f01c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:51.206948 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40654fee-6b08-4815-80c5-cc2020d5f01c admin admin] PATH_INFO: `/v3/projects/512a965718f84b8a8730dea3781e6a38` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:51.208665 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40654fee-6b08-4815-80c5-cc2020d5f01c admin admin] RBAC: Authorizing `identity:delete_project(project_id=512a965718f84b8a8730dea3781e6a38)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:51.210597 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40654fee-6b08-4815-80c5-cc2020d5f01c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:51.289968 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-40654fee-6b08-4815-80c5-cc2020d5f01c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '512a965718f84b8a8730dea3781e6a38', 'request_id': 'req-40654fee-6b08-4815-80c5-cc2020d5f01c'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:51.299254 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-40654fee-6b08-4815-80c5-cc2020d5f01c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '512a965718f84b8a8730dea3781e6a38', 'request_id': 'req-40654fee-6b08-4815-80c5-cc2020d5f01c'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:51.306065 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-40654fee-6b08-4815-80c5-cc2020d5f01c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '512a965718f84b8a8730dea3781e6a38', 'request_id': 'req-40654fee-6b08-4815-80c5-cc2020d5f01c'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:51.323977 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-40654fee-6b08-4815-80c5-cc2020d5f01c admin admin] The token cache is being invalidate because project 512a965718f84b8a8730dea3781e6a38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:51.327603 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-40654fee-6b08-4815-80c5-cc2020d5f01c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:51.328763 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-40654fee-6b08-4815-80c5-cc2020d5f01c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:51.331907 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1099/2198] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:51 2021] DELETE /identity/v3/projects/512a965718f84b8a8730dea3781e6a38 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:51.338059 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1489d5-d72b-406b-9c41-85564e54c678 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:51.338581 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1489d5-d72b-406b-9c41-85564e54c678 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:51.338860 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1489d5-d72b-406b-9c41-85564e54c678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:51.363654 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-2b1489d5-d72b-406b-9c41-85564e54c678 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:51.365725 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-2b1489d5-d72b-406b-9c41-85564e54c678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:51.456942 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1100/2199] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:51.465393 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8440575-b7ea-4a21-9023-fce0dba38181 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:51.465788 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8440575-b7ea-4a21-9023-fce0dba38181 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:51.466454 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8440575-b7ea-4a21-9023-fce0dba38181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:51.488385 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-e8440575-b7ea-4a21-9023-fce0dba38181 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:51.490082 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e8440575-b7ea-4a21-9023-fce0dba38181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:51.515239 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1100/2200] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:51.515903 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1489d5-d72b-406b-9c41-85564e54c678 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:51.531037 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1489d5-d72b-406b-9c41-85564e54c678 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:51.536448 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8e74c-5f19-4c41-b34d-2f77af5d81d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:51.537718 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8e74c-5f19-4c41-b34d-2f77af5d81d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:51.538186 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8e74c-5f19-4c41-b34d-2f77af5d81d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:51.538806 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8e74c-5f19-4c41-b34d-2f77af5d81d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:51.539806 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8e74c-5f19-4c41-b34d-2f77af5d81d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:39:51.540413 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8e74c-5f19-4c41-b34d-2f77af5d81d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:51.543101 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8e74c-5f19-4c41-b34d-2f77af5d81d8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:51.564807 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8440575-b7ea-4a21-9023-fce0dba38181 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:51.575058 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8440575-b7ea-4a21-9023-fce0dba38181 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:51.575779 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1101/2201] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:39:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:39:51.582023 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281991d-942b-49f1-8435-f975ceead0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:51.582953 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281991d-942b-49f1-8435-f975ceead0f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:51.583462 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281991d-942b-49f1-8435-f975ceead0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:51.584320 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281991d-942b-49f1-8435-f975ceead0f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:51.585157 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281991d-942b-49f1-8435-f975ceead0f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:51.587179 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281991d-942b-49f1-8435-f975ceead0f8 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:51.625755 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1101/2202] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:39:51 2021] POST /identity/v3/projects => generated 359 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:51.630203 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8e74c-5f19-4c41-b34d-2f77af5d81d8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:51.642160 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8e74c-5f19-4c41-b34d-2f77af5d81d8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:51.706240 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046c16f-f952-4bf7-8b28-d06830a77c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:51.707043 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046c16f-f952-4bf7-8b28-d06830a77c58 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:51.707309 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046c16f-f952-4bf7-8b28-d06830a77c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:51.707586 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046c16f-f952-4bf7-8b28-d06830a77c58 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:51.708403 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046c16f-f952-4bf7-8b28-d06830a77c58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:51.710363 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046c16f-f952-4bf7-8b28-d06830a77c58 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:51.737200 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1102/2203] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:39:51 2021] POST /identity/v3/users => generated 280 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:51.738487 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281991d-942b-49f1-8435-f975ceead0f8 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:51.754073 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281991d-942b-49f1-8435-f975ceead0f8 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:51.763136 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899afa7-af71-460c-bb18-039dbd6dc47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:51.763925 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899afa7-af71-460c-bb18-039dbd6dc47b admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:51.764212 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899afa7-af71-460c-bb18-039dbd6dc47b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:51.764493 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899afa7-af71-460c-bb18-039dbd6dc47b admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:51.765240 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899afa7-af71-460c-bb18-039dbd6dc47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:51.766857 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899afa7-af71-460c-bb18-039dbd6dc47b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:51.781142 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1102/2204] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:51 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:51.782298 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046c16f-f952-4bf7-8b28-d06830a77c58 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:51.793349 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046c16f-f952-4bf7-8b28-d06830a77c58 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:51.798203 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ae797-dffe-44b2-bb27-89dbebc9f1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:51.798871 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ae797-dffe-44b2-bb27-89dbebc9f1fd admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:51.799272 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ae797-dffe-44b2-bb27-89dbebc9f1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:51.799703 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ae797-dffe-44b2-bb27-89dbebc9f1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:51.800583 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ae797-dffe-44b2-bb27-89dbebc9f1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:51.802331 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ae797-dffe-44b2-bb27-89dbebc9f1fd admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:51.814077 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1103/2205] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:51 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:39:51.818470 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899afa7-af71-460c-bb18-039dbd6dc47b admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:51.831296 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899afa7-af71-460c-bb18-039dbd6dc47b admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:51.837021 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da67ef-6e66-4fc0-90b5-9dadfebe06c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:51.838110 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da67ef-6e66-4fc0-90b5-9dadfebe06c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:51.838521 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da67ef-6e66-4fc0-90b5-9dadfebe06c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:51.838864 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da67ef-6e66-4fc0-90b5-9dadfebe06c3 admin admin] PATH_INFO: `/v3/projects/e8b5c086f2164ef59529a62f351e5d50/users/9f815fd179394f55b94e3855c638f445/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:51.861804 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da67ef-6e66-4fc0-90b5-9dadfebe06c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8b5c086f2164ef59529a62f351e5d50, user_id=9f815fd179394f55b94e3855c638f445, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:51.864837 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da67ef-6e66-4fc0-90b5-9dadfebe06c3 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:51.880523 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1103/2206] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:51 2021] PUT /identity/v3/projects/e8b5c086f2164ef59529a62f351e5d50/users/9f815fd179394f55b94e3855c638f445/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:51.893156 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f82959-7674-4fb0-adff-e1e45f92c4da None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:51.893692 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f82959-7674-4fb0-adff-e1e45f92c4da None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:51.894045 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f82959-7674-4fb0-adff-e1e45f92c4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:51.921486 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-74f82959-7674-4fb0-adff-e1e45f92c4da None None] MFA Rules not processed for user `9f815fd179394f55b94e3855c638f445`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:51.923311 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-74f82959-7674-4fb0-adff-e1e45f92c4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:52.028379 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1104/2207] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:51 2021] POST /identity/v3/auth/tokens => generated 3379 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:52.059634 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da67ef-6e66-4fc0-90b5-9dadfebe06c3 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:52.061434 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-42da67ef-6e66-4fc0-90b5-9dadfebe06c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:52.177769 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da67ef-6e66-4fc0-90b5-9dadfebe06c3 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:52.190774 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7acbd-16af-4e12-af49-7787d6ecd0b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:52.193893 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7acbd-16af-4e12-af49-7787d6ecd0b8 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:52.194188 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7acbd-16af-4e12-af49-7787d6ecd0b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:52.194477 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7acbd-16af-4e12-af49-7787d6ecd0b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:52.211823 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7acbd-16af-4e12-af49-7787d6ecd0b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:52.216325 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7acbd-16af-4e12-af49-7787d6ecd0b8 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:52.231187 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1104/2208] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:52 2021] GET /identity/v3/auth/tokens => generated 3379 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:52.253331 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f82959-7674-4fb0-adff-e1e45f92c4da None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:52.359067 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f82959-7674-4fb0-adff-e1e45f92c4da None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:52.366090 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c723f-fbb4-408c-806b-7db6a8ee7ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:52.367118 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c723f-fbb4-408c-806b-7db6a8ee7ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:52.367498 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c723f-fbb4-408c-806b-7db6a8ee7ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:52.367888 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c723f-fbb4-408c-806b-7db6a8ee7ca8 admin admin] PATH_INFO: `/v3/users/9f815fd179394f55b94e3855c638f445` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:52.369308 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c723f-fbb4-408c-806b-7db6a8ee7ca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f815fd179394f55b94e3855c638f445)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:52.371291 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c723f-fbb4-408c-806b-7db6a8ee7ca8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:52.430582 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-b20c723f-fbb4-408c-806b-7db6a8ee7ca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f815fd179394f55b94e3855c638f445'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:52.442035 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-b20c723f-fbb4-408c-806b-7db6a8ee7ca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f815fd179394f55b94e3855c638f445'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:52.450362 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-b20c723f-fbb4-408c-806b-7db6a8ee7ca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f815fd179394f55b94e3855c638f445'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:52.450974 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-b20c723f-fbb4-408c-806b-7db6a8ee7ca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f815fd179394f55b94e3855c638f445'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:52.457830 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-b20c723f-fbb4-408c-806b-7db6a8ee7ca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f815fd179394f55b94e3855c638f445'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:52.464489 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1105/2209] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:52 2021] DELETE /identity/v3/users/9f815fd179394f55b94e3855c638f445 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:52.469056 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaef957-0033-415f-a5ed-078dcf264bfb None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:52.469461 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaef957-0033-415f-a5ed-078dcf264bfb None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:52.469618 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaef957-0033-415f-a5ed-078dcf264bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:52.501535 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-7eaef957-0033-415f-a5ed-078dcf264bfb None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:52.502756 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7eaef957-0033-415f-a5ed-078dcf264bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:52.571084 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1105/2210] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:52.578748 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c723f-fbb4-408c-806b-7db6a8ee7ca8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:52.580768 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-b20c723f-fbb4-408c-806b-7db6a8ee7ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:52.670457 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c723f-fbb4-408c-806b-7db6a8ee7ca8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:52.677121 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4067f-4326-4d5c-b501-1dfe1f9dc720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:52.677995 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4067f-4326-4d5c-b501-1dfe1f9dc720 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:52.678393 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4067f-4326-4d5c-b501-1dfe1f9dc720 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:52.678754 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4067f-4326-4d5c-b501-1dfe1f9dc720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:52.714270 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4067f-4326-4d5c-b501-1dfe1f9dc720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:52.715754 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4067f-4326-4d5c-b501-1dfe1f9dc720 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:52.727752 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1106/2211] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:52.785345 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d23e59-5602-44ae-be04-52e432c253fd None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:52.786056 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d23e59-5602-44ae-be04-52e432c253fd None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:52.786489 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d23e59-5602-44ae-be04-52e432c253fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:52.831234 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-c8d23e59-5602-44ae-be04-52e432c253fd None None] MFA Rules not processed for user `1a90e3068213436498812ad167bcb19f`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:52.847436 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c8d23e59-5602-44ae-be04-52e432c253fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:52.994473 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1106/2212] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:52 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:53.004421 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4067f-4326-4d5c-b501-1dfe1f9dc720 service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:53.006141 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-c0f4067f-4326-4d5c-b501-1dfe1f9dc720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:53.093223 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4067f-4326-4d5c-b501-1dfe1f9dc720 service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:53.098660 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abaeaf-7418-45f4-a6df-f0bbfef19b0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:53.099396 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abaeaf-7418-45f4-a6df-f0bbfef19b0b service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:53.099745 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abaeaf-7418-45f4-a6df-f0bbfef19b0b service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:53.100000 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abaeaf-7418-45f4-a6df-f0bbfef19b0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:53.111018 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abaeaf-7418-45f4-a6df-f0bbfef19b0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:53.112511 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abaeaf-7418-45f4-a6df-f0bbfef19b0b service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:53.122302 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1107/2213] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:53 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:53.157763 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d23e59-5602-44ae-be04-52e432c253fd None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:53.160403 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c8d23e59-5602-44ae-be04-52e432c253fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:53.175295 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d23e59-5602-44ae-be04-52e432c253fd None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:53.180643 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79499b22-776c-4db5-8899-f0a76f7ace75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:53.182163 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79499b22-776c-4db5-8899-f0a76f7ace75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:53.182641 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79499b22-776c-4db5-8899-f0a76f7ace75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:53.183106 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79499b22-776c-4db5-8899-f0a76f7ace75 admin admin] PATH_INFO: `/v3/projects/e8b5c086f2164ef59529a62f351e5d50` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:53.184356 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79499b22-776c-4db5-8899-f0a76f7ace75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8b5c086f2164ef59529a62f351e5d50)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:53.186428 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79499b22-776c-4db5-8899-f0a76f7ace75 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:53.234382 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-79499b22-776c-4db5-8899-f0a76f7ace75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8b5c086f2164ef59529a62f351e5d50', 'request_id': 'req-79499b22-776c-4db5-8899-f0a76f7ace75'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:53.241887 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-79499b22-776c-4db5-8899-f0a76f7ace75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8b5c086f2164ef59529a62f351e5d50', 'request_id': 'req-79499b22-776c-4db5-8899-f0a76f7ace75'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:53.249999 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-79499b22-776c-4db5-8899-f0a76f7ace75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8b5c086f2164ef59529a62f351e5d50', 'request_id': 'req-79499b22-776c-4db5-8899-f0a76f7ace75'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:53.263143 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-79499b22-776c-4db5-8899-f0a76f7ace75 admin admin] The token cache is being invalidate because project e8b5c086f2164ef59529a62f351e5d50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:53.263490 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-79499b22-776c-4db5-8899-f0a76f7ace75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:53.264136 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-79499b22-776c-4db5-8899-f0a76f7ace75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:53.265698 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1107/2214] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:53 2021] DELETE /identity/v3/projects/e8b5c086f2164ef59529a62f351e5d50 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:53.271734 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed70fa2-dd14-4d85-9bf6-be1fced497df None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:53.272033 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed70fa2-dd14-4d85-9bf6-be1fced497df None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:53.272314 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed70fa2-dd14-4d85-9bf6-be1fced497df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:53.292805 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-fed70fa2-dd14-4d85-9bf6-be1fced497df None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:53.294097 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-fed70fa2-dd14-4d85-9bf6-be1fced497df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:53.359466 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1108/2215] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:53.367905 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedff94e-326c-48db-a0f8-b24d0ad66935 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:53.368307 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedff94e-326c-48db-a0f8-b24d0ad66935 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:53.368761 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedff94e-326c-48db-a0f8-b24d0ad66935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:53.393019 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-cedff94e-326c-48db-a0f8-b24d0ad66935 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:53.394289 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-cedff94e-326c-48db-a0f8-b24d0ad66935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:53.414335 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1108/2216] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:53.419965 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed70fa2-dd14-4d85-9bf6-be1fced497df None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:53.430543 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed70fa2-dd14-4d85-9bf6-be1fced497df None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:53.436110 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f58e0c-8797-4651-8910-d909934dabbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:53.436938 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f58e0c-8797-4651-8910-d909934dabbc admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:53.437452 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f58e0c-8797-4651-8910-d909934dabbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:53.438043 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f58e0c-8797-4651-8910-d909934dabbc admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:53.438984 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f58e0c-8797-4651-8910-d909934dabbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:39:53.439471 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f58e0c-8797-4651-8910-d909934dabbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:53.441287 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f58e0c-8797-4651-8910-d909934dabbc admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:53.459126 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1109/2217] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:39:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:39:53.464305 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedff94e-326c-48db-a0f8-b24d0ad66935 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:53.474130 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedff94e-326c-48db-a0f8-b24d0ad66935 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:53.480089 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657de1d-efd8-48b9-a627-26272b690d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:53.481309 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657de1d-efd8-48b9-a627-26272b690d55 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:53.481812 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657de1d-efd8-48b9-a627-26272b690d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:53.482206 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657de1d-efd8-48b9-a627-26272b690d55 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:53.482967 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657de1d-efd8-48b9-a627-26272b690d55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:53.485102 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657de1d-efd8-48b9-a627-26272b690d55 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:53.513352 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1109/2218] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:39:53 2021] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:53.517608 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f58e0c-8797-4651-8910-d909934dabbc admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:53.529082 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f58e0c-8797-4651-8910-d909934dabbc admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:53.586859 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76ef3b-6afc-4ce8-9f97-8759152d6fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:53.588058 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76ef3b-6afc-4ce8-9f97-8759152d6fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:53.588348 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76ef3b-6afc-4ce8-9f97-8759152d6fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:53.588628 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76ef3b-6afc-4ce8-9f97-8759152d6fc6 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:53.589591 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76ef3b-6afc-4ce8-9f97-8759152d6fc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:53.591945 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76ef3b-6afc-4ce8-9f97-8759152d6fc6 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:53.616180 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1110/2219] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:39:53 2021] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:53.621598 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657de1d-efd8-48b9-a627-26272b690d55 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:53.636965 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657de1d-efd8-48b9-a627-26272b690d55 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:53.641624 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190786b-598c-432e-886e-886ddcb964b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:53.642353 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190786b-598c-432e-886e-886ddcb964b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:53.642707 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190786b-598c-432e-886e-886ddcb964b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:53.643107 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190786b-598c-432e-886e-886ddcb964b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:53.644180 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8190786b-598c-432e-886e-886ddcb964b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:53.645857 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8190786b-598c-432e-886e-886ddcb964b1 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:53.657373 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1110/2220] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:53 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:39:53.662391 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76ef3b-6afc-4ce8-9f97-8759152d6fc6 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:53.672616 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76ef3b-6afc-4ce8-9f97-8759152d6fc6 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:53.677341 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ea8ab-cd36-4440-8a01-042f4a032dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:53.677988 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ea8ab-cd36-4440-8a01-042f4a032dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:53.678273 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ea8ab-cd36-4440-8a01-042f4a032dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:53.678551 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ea8ab-cd36-4440-8a01-042f4a032dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:53.679290 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ea8ab-cd36-4440-8a01-042f4a032dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:53.680923 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ea8ab-cd36-4440-8a01-042f4a032dd4 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:53.690986 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1111/2221] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:53 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:53.695178 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190786b-598c-432e-886e-886ddcb964b1 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:53.705549 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190786b-598c-432e-886e-886ddcb964b1 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:53.710240 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ef6cb-4720-405e-a828-9a15732c2f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:53.711100 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ef6cb-4720-405e-a828-9a15732c2f1a admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:53.711391 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ef6cb-4720-405e-a828-9a15732c2f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:53.711691 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ef6cb-4720-405e-a828-9a15732c2f1a admin admin] PATH_INFO: `/v3/projects/3fb51d4a798a4536aa3d4242e5874d18/users/10bd8003fa194c0eacefaa362cde0613/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:53.726764 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ef6cb-4720-405e-a828-9a15732c2f1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fb51d4a798a4536aa3d4242e5874d18, user_id=10bd8003fa194c0eacefaa362cde0613, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:53.729469 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ef6cb-4720-405e-a828-9a15732c2f1a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:53.741711 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1111/2222] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:53 2021] PUT /identity/v3/projects/3fb51d4a798a4536aa3d4242e5874d18/users/10bd8003fa194c0eacefaa362cde0613/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:39:53.752527 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c654139-8781-43bd-b4a9-716ca7aeafa6 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:53.752825 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c654139-8781-43bd-b4a9-716ca7aeafa6 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:53.753103 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c654139-8781-43bd-b4a9-716ca7aeafa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:53.780331 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-3c654139-8781-43bd-b4a9-716ca7aeafa6 None None] MFA Rules not processed for user `10bd8003fa194c0eacefaa362cde0613`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:53.781655 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-3c654139-8781-43bd-b4a9-716ca7aeafa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:53.852652 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1112/2223] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:53 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:39:53.863177 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ef6cb-4720-405e-a828-9a15732c2f1a admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:53.865763 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-db5ef6cb-4720-405e-a828-9a15732c2f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:53.924056 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ef6cb-4720-405e-a828-9a15732c2f1a admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:53.927604 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a7846-8194-490d-9dcf-ba2787f9b0df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:53.928292 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a7846-8194-490d-9dcf-ba2787f9b0df service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:53.928570 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a7846-8194-490d-9dcf-ba2787f9b0df service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:53.928845 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a7846-8194-490d-9dcf-ba2787f9b0df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:53.936921 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a7846-8194-490d-9dcf-ba2787f9b0df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:53.938334 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a7846-8194-490d-9dcf-ba2787f9b0df service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:53.947360 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1112/2224] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:53 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:53.973043 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c654139-8781-43bd-b4a9-716ca7aeafa6 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:54.034046 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c654139-8781-43bd-b4a9-716ca7aeafa6 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:54.038581 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563f18e-c98b-4e68-8692-e8694334d0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:54.039427 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563f18e-c98b-4e68-8692-e8694334d0cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:54.039734 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563f18e-c98b-4e68-8692-e8694334d0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:54.040012 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563f18e-c98b-4e68-8692-e8694334d0cd admin admin] PATH_INFO: `/v3/users/10bd8003fa194c0eacefaa362cde0613` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:54.041240 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563f18e-c98b-4e68-8692-e8694334d0cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=10bd8003fa194c0eacefaa362cde0613)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:54.043428 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563f18e-c98b-4e68-8692-e8694334d0cd admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:54.092682 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f563f18e-c98b-4e68-8692-e8694334d0cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10bd8003fa194c0eacefaa362cde0613'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:54.103673 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f563f18e-c98b-4e68-8692-e8694334d0cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10bd8003fa194c0eacefaa362cde0613'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:54.111055 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f563f18e-c98b-4e68-8692-e8694334d0cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10bd8003fa194c0eacefaa362cde0613'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:54.111913 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f563f18e-c98b-4e68-8692-e8694334d0cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10bd8003fa194c0eacefaa362cde0613'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:54.118576 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f563f18e-c98b-4e68-8692-e8694334d0cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10bd8003fa194c0eacefaa362cde0613'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:54.124875 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1113/2225] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:53 2021] DELETE /identity/v3/users/10bd8003fa194c0eacefaa362cde0613 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:54.129350 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9917a-283f-4268-ab4f-3e9e3bb7be17 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:54.129668 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9917a-283f-4268-ab4f-3e9e3bb7be17 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:54.129942 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9917a-283f-4268-ab4f-3e9e3bb7be17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:54.146802 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-b9b9917a-283f-4268-ab4f-3e9e3bb7be17 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:54.148081 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-b9b9917a-283f-4268-ab4f-3e9e3bb7be17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:54.203806 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1113/2226] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:54.214347 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563f18e-c98b-4e68-8692-e8694334d0cd admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:54.215755 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-f563f18e-c98b-4e68-8692-e8694334d0cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:54.269942 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563f18e-c98b-4e68-8692-e8694334d0cd admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:54.273624 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30acee-33db-4abe-b84f-8ca1519f571c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:54.274254 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30acee-33db-4abe-b84f-8ca1519f571c service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:54.274532 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30acee-33db-4abe-b84f-8ca1519f571c service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:54.274803 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30acee-33db-4abe-b84f-8ca1519f571c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:54.284139 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30acee-33db-4abe-b84f-8ca1519f571c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:54.285562 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30acee-33db-4abe-b84f-8ca1519f571c service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:54.297298 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1114/2227] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:54.567962 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9917a-283f-4268-ab4f-3e9e3bb7be17 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:54.569459 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-b9b9917a-283f-4268-ab4f-3e9e3bb7be17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:54.581816 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9917a-283f-4268-ab4f-3e9e3bb7be17 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:54.586531 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38581d6-b74b-4e7c-88a6-cc82978ebb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:54.588069 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38581d6-b74b-4e7c-88a6-cc82978ebb1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:54.588381 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38581d6-b74b-4e7c-88a6-cc82978ebb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:54.588656 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38581d6-b74b-4e7c-88a6-cc82978ebb1a admin admin] PATH_INFO: `/v3/projects/3fb51d4a798a4536aa3d4242e5874d18` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:54.590131 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38581d6-b74b-4e7c-88a6-cc82978ebb1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fb51d4a798a4536aa3d4242e5874d18)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:54.592155 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38581d6-b74b-4e7c-88a6-cc82978ebb1a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:54.640739 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a38581d6-b74b-4e7c-88a6-cc82978ebb1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fb51d4a798a4536aa3d4242e5874d18', 'request_id': 'req-a38581d6-b74b-4e7c-88a6-cc82978ebb1a'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:54.647126 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a38581d6-b74b-4e7c-88a6-cc82978ebb1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fb51d4a798a4536aa3d4242e5874d18', 'request_id': 'req-a38581d6-b74b-4e7c-88a6-cc82978ebb1a'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:54.653631 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a38581d6-b74b-4e7c-88a6-cc82978ebb1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fb51d4a798a4536aa3d4242e5874d18', 'request_id': 'req-a38581d6-b74b-4e7c-88a6-cc82978ebb1a'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:54.665426 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a38581d6-b74b-4e7c-88a6-cc82978ebb1a admin admin] The token cache is being invalidate because project 3fb51d4a798a4536aa3d4242e5874d18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:39:54.665746 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a38581d6-b74b-4e7c-88a6-cc82978ebb1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:54.666373 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a38581d6-b74b-4e7c-88a6-cc82978ebb1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:54.667949 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1114/2228] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:39:54 2021] DELETE /identity/v3/projects/3fb51d4a798a4536aa3d4242e5874d18 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:54.673643 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997934e-3517-402f-b492-0f6693a17e3a None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:54.674113 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997934e-3517-402f-b492-0f6693a17e3a None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:54.674238 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997934e-3517-402f-b492-0f6693a17e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:54.692229 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-3997934e-3517-402f-b492-0f6693a17e3a None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:54.693595 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-3997934e-3517-402f-b492-0f6693a17e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:54.751232 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1115/2229] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:54.760224 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46872c1-cc85-4482-9459-ec0f76bd1781 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:54.760511 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46872c1-cc85-4482-9459-ec0f76bd1781 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:54.760788 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46872c1-cc85-4482-9459-ec0f76bd1781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:54.779364 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-b46872c1-cc85-4482-9459-ec0f76bd1781 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:54.780636 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-b46872c1-cc85-4482-9459-ec0f76bd1781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:54.789927 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1115/2230] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:54.794328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997934e-3517-402f-b492-0f6693a17e3a None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:54.803904 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997934e-3517-402f-b492-0f6693a17e3a None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:54.808899 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10cb9b-4acf-458a-9990-6eb4b74ce846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:54.809530 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10cb9b-4acf-458a-9990-6eb4b74ce846 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:54.809804 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10cb9b-4acf-458a-9990-6eb4b74ce846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:54.810069 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10cb9b-4acf-458a-9990-6eb4b74ce846 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:54.810788 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10cb9b-4acf-458a-9990-6eb4b74ce846 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:39:54.811083 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10cb9b-4acf-458a-9990-6eb4b74ce846 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:54.812690 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10cb9b-4acf-458a-9990-6eb4b74ce846 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:54.824412 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1116/2231] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:39:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:39:54.828611 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46872c1-cc85-4482-9459-ec0f76bd1781 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:54.837985 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46872c1-cc85-4482-9459-ec0f76bd1781 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:54.842886 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0cfe1-522e-4f3a-b832-2ddcf329b890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:54.843535 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0cfe1-522e-4f3a-b832-2ddcf329b890 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:54.843852 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0cfe1-522e-4f3a-b832-2ddcf329b890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:54.844123 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0cfe1-522e-4f3a-b832-2ddcf329b890 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:54.844824 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0cfe1-522e-4f3a-b832-2ddcf329b890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:54.846731 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0cfe1-522e-4f3a-b832-2ddcf329b890 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:54.871529 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1116/2232] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:39:54 2021] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:54.875571 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10cb9b-4acf-458a-9990-6eb4b74ce846 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:54.885940 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10cb9b-4acf-458a-9990-6eb4b74ce846 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:54.943596 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a73e0a-8192-4e1a-a6e7-f3c63535ff6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:54.944292 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a73e0a-8192-4e1a-a6e7-f3c63535ff6c admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:54.944573 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a73e0a-8192-4e1a-a6e7-f3c63535ff6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:54.944842 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a73e0a-8192-4e1a-a6e7-f3c63535ff6c admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:54.945540 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a73e0a-8192-4e1a-a6e7-f3c63535ff6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:54.948181 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a73e0a-8192-4e1a-a6e7-f3c63535ff6c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:54.967780 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1117/2233] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:39:54 2021] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:39:54.972148 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0cfe1-522e-4f3a-b832-2ddcf329b890 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:54.982225 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0cfe1-522e-4f3a-b832-2ddcf329b890 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:54.987048 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1e519-3e40-4581-89bf-1bf918b74b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:54.987696 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1e519-3e40-4581-89bf-1bf918b74b76 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:54.988000 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1e519-3e40-4581-89bf-1bf918b74b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:54.988272 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1e519-3e40-4581-89bf-1bf918b74b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:54.988997 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1e519-3e40-4581-89bf-1bf918b74b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:54.990574 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1e519-3e40-4581-89bf-1bf918b74b76 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:55.001077 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1117/2234] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:54 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:55.004920 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a73e0a-8192-4e1a-a6e7-f3c63535ff6c admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:55.015360 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a73e0a-8192-4e1a-a6e7-f3c63535ff6c admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:55.020064 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc377bfe-882e-4759-8cfc-83a5a615bbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:55.020773 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc377bfe-882e-4759-8cfc-83a5a615bbee admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:55.021121 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc377bfe-882e-4759-8cfc-83a5a615bbee admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:55.021461 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc377bfe-882e-4759-8cfc-83a5a615bbee admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:55.022203 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc377bfe-882e-4759-8cfc-83a5a615bbee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:55.023809 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc377bfe-882e-4759-8cfc-83a5a615bbee admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:55.033615 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1118/2235] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:39:55 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:39:55.037459 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1e519-3e40-4581-89bf-1bf918b74b76 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:55.047171 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1e519-3e40-4581-89bf-1bf918b74b76 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:55.051758 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fd8e8-84d3-40ab-9800-a0a8bc884e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:55.052614 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fd8e8-84d3-40ab-9800-a0a8bc884e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:55.052895 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fd8e8-84d3-40ab-9800-a0a8bc884e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:55.053171 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fd8e8-84d3-40ab-9800-a0a8bc884e50 admin admin] PATH_INFO: `/v3/projects/de088af04e804d909ae6daa141302d4c/users/d1bb22a3461a47e5afeb229038cb4a8d/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:55.067523 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fd8e8-84d3-40ab-9800-a0a8bc884e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de088af04e804d909ae6daa141302d4c, user_id=d1bb22a3461a47e5afeb229038cb4a8d, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:55.070186 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fd8e8-84d3-40ab-9800-a0a8bc884e50 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:55.083829 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1118/2236] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:39:55 2021] PUT /identity/v3/projects/de088af04e804d909ae6daa141302d4c/users/d1bb22a3461a47e5afeb229038cb4a8d/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:55.088711 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266151a-1700-4c9b-be15-4ad16bfb688a None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:55.089258 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266151a-1700-4c9b-be15-4ad16bfb688a None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:55.089536 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266151a-1700-4c9b-be15-4ad16bfb688a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:55.107324 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-6266151a-1700-4c9b-be15-4ad16bfb688a None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:55.108555 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-6266151a-1700-4c9b-be15-4ad16bfb688a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:55.163947 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1119/2237] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:55.174643 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fd8e8-84d3-40ab-9800-a0a8bc884e50 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:55.176362 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-952fd8e8-84d3-40ab-9800-a0a8bc884e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:55.231230 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fd8e8-84d3-40ab-9800-a0a8bc884e50 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:55.234926 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f683979-5734-46cd-ad4e-e2e708273044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:55.235568 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f683979-5734-46cd-ad4e-e2e708273044 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:55.235883 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f683979-5734-46cd-ad4e-e2e708273044 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:55.236160 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f683979-5734-46cd-ad4e-e2e708273044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:55.246002 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f683979-5734-46cd-ad4e-e2e708273044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:55.247430 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f683979-5734-46cd-ad4e-e2e708273044 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:55.256705 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1119/2238] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:39:57.753063 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4b030-f693-4841-8f73-9505bc8c9628 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:57.753642 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4b030-f693-4841-8f73-9505bc8c9628 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:57.753642 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4b030-f693-4841-8f73-9505bc8c9628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:57.773750 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-64a4b030-f693-4841-8f73-9505bc8c9628 None None] MFA Rules not processed for user `1a90e3068213436498812ad167bcb19f`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:57.775771 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-64a4b030-f693-4841-8f73-9505bc8c9628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:57.847455 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1120/2239] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:57 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:59.555920 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f683979-5734-46cd-ad4e-e2e708273044 service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:59.558409 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-3f683979-5734-46cd-ad4e-e2e708273044 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:59.584987 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f683979-5734-46cd-ad4e-e2e708273044 service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:59.593322 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5827d76-01fd-4456-b3d2-528e2b2e3bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:59.594700 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5827d76-01fd-4456-b3d2-528e2b2e3bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:59.595147 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5827d76-01fd-4456-b3d2-528e2b2e3bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:59.595570 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5827d76-01fd-4456-b3d2-528e2b2e3bf7 admin admin] PATH_INFO: `/v3/users/e5b9ce9ec2154899a8c11a9e2c320fdc` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:59.599758 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5827d76-01fd-4456-b3d2-528e2b2e3bf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5b9ce9ec2154899a8c11a9e2c320fdc)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:39:59.602069 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5827d76-01fd-4456-b3d2-528e2b2e3bf7 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:39:59.705665 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-c5827d76-01fd-4456-b3d2-528e2b2e3bf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5b9ce9ec2154899a8c11a9e2c320fdc'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:59.721979 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-c5827d76-01fd-4456-b3d2-528e2b2e3bf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5b9ce9ec2154899a8c11a9e2c320fdc'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:59.736280 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-c5827d76-01fd-4456-b3d2-528e2b2e3bf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5b9ce9ec2154899a8c11a9e2c320fdc'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:59.737054 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-c5827d76-01fd-4456-b3d2-528e2b2e3bf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5b9ce9ec2154899a8c11a9e2c320fdc'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:59.749358 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-c5827d76-01fd-4456-b3d2-528e2b2e3bf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5b9ce9ec2154899a8c11a9e2c320fdc'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:39:59.778286 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1120/2240] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:39:59 2021] DELETE /identity/v3/users/e5b9ce9ec2154899a8c11a9e2c320fdc => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:39:59.783016 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df769542-4b6f-463d-8f52-ae69074fb268 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:59.784021 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df769542-4b6f-463d-8f52-ae69074fb268 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:59.784614 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df769542-4b6f-463d-8f52-ae69074fb268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:39:59.816303 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-df769542-4b6f-463d-8f52-ae69074fb268 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:39:59.819350 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-df769542-4b6f-463d-8f52-ae69074fb268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:59.890401 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1121/2241] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:39:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:39:59.902632 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5827d76-01fd-4456-b3d2-528e2b2e3bf7 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:39:59.904119 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c5827d76-01fd-4456-b3d2-528e2b2e3bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:39:59.986396 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5827d76-01fd-4456-b3d2-528e2b2e3bf7 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:39:59.990575 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6b456-0d75-4334-8c18-407d2808966e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:39:59.991246 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6b456-0d75-4334-8c18-407d2808966e service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:39:59.991529 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6b456-0d75-4334-8c18-407d2808966e service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:39:59.991850 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6b456-0d75-4334-8c18-407d2808966e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:00.004425 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6b456-0d75-4334-8c18-407d2808966e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:00.006073 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6b456-0d75-4334-8c18-407d2808966e service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:00.023328 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1121/2242] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:39:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:40:00.407997 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d13688-b9b0-422f-b24a-579a107d17ed None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:00.408426 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d13688-b9b0-422f-b24a-579a107d17ed None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:00.408809 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d13688-b9b0-422f-b24a-579a107d17ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:00.444732 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-15d13688-b9b0-422f-b24a-579a107d17ed None None] MFA Rules not processed for user `d1bb22a3461a47e5afeb229038cb4a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:40:00.446316 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-15d13688-b9b0-422f-b24a-579a107d17ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:00.462211 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6b456-0d75-4334-8c18-407d2808966e service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:00.464767 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-fff6b456-0d75-4334-8c18-407d2808966e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:00.492153 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6b456-0d75-4334-8c18-407d2808966e service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:00.499526 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b8d20-79d5-4ad0-b0ff-1d34de5f41ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:00.501185 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b8d20-79d5-4ad0-b0ff-1d34de5f41ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:00.501664 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b8d20-79d5-4ad0-b0ff-1d34de5f41ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:00.502114 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b8d20-79d5-4ad0-b0ff-1d34de5f41ea admin admin] PATH_INFO: `/v3/projects/ef6ee5c5d12e489fa42f3ee9ed559afa` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:00.503804 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b8d20-79d5-4ad0-b0ff-1d34de5f41ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef6ee5c5d12e489fa42f3ee9ed559afa)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:00.506032 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b8d20-79d5-4ad0-b0ff-1d34de5f41ea admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:00.544026 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1122/2243] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:40:00 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:40:00.549226 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d13688-b9b0-422f-b24a-579a107d17ed None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:00.555280 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-15d13688-b9b0-422f-b24a-579a107d17ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:00.582185 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d13688-b9b0-422f-b24a-579a107d17ed None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:00.591266 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-0a8b8d20-79d5-4ad0-b0ff-1d34de5f41ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef6ee5c5d12e489fa42f3ee9ed559afa', 'request_id': 'req-0a8b8d20-79d5-4ad0-b0ff-1d34de5f41ea'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:40:00.601452 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-0a8b8d20-79d5-4ad0-b0ff-1d34de5f41ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef6ee5c5d12e489fa42f3ee9ed559afa', 'request_id': 'req-0a8b8d20-79d5-4ad0-b0ff-1d34de5f41ea'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:40:00.609857 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-0a8b8d20-79d5-4ad0-b0ff-1d34de5f41ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef6ee5c5d12e489fa42f3ee9ed559afa', 'request_id': 'req-0a8b8d20-79d5-4ad0-b0ff-1d34de5f41ea'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:40:00.631170 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-0a8b8d20-79d5-4ad0-b0ff-1d34de5f41ea admin admin] The token cache is being invalidate because project ef6ee5c5d12e489fa42f3ee9ed559afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:40:00.631703 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-0a8b8d20-79d5-4ad0-b0ff-1d34de5f41ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:40:00.632557 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-0a8b8d20-79d5-4ad0-b0ff-1d34de5f41ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:40:00.635369 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1122/2244] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:40:00 2021] DELETE /identity/v3/projects/ef6ee5c5d12e489fa42f3ee9ed559afa => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:40:00.644820 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e18a8-1e22-482a-81fc-068a67bd4688 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:00.646005 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e18a8-1e22-482a-81fc-068a67bd4688 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:00.646706 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e18a8-1e22-482a-81fc-068a67bd4688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:00.681871 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-4c1e18a8-1e22-482a-81fc-068a67bd4688 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:40:00.684587 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-4c1e18a8-1e22-482a-81fc-068a67bd4688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:00.710186 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e90fe8-3ebb-4f9f-aa89-89669d3abcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:00.712075 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e90fe8-3ebb-4f9f-aa89-89669d3abcb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:00.715065 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e90fe8-3ebb-4f9f-aa89-89669d3abcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:00.715377 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e90fe8-3ebb-4f9f-aa89-89669d3abcb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:00.718495 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e90fe8-3ebb-4f9f-aa89-89669d3abcb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:00.725767 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e90fe8-3ebb-4f9f-aa89-89669d3abcb2 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:00.794763 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1123/2245] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:40:00 2021] POST /identity/v3/projects => generated 379 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:40:00.798912 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e90fe8-3ebb-4f9f-aa89-89669d3abcb2 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:00.800730 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-72e90fe8-3ebb-4f9f-aa89-89669d3abcb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:00.815957 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1123/2246] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:40:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:40:00.823744 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32296de4-d049-4b6c-af5e-27e49eb55371 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:00.825957 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32296de4-d049-4b6c-af5e-27e49eb55371 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:00.827106 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32296de4-d049-4b6c-af5e-27e49eb55371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:00.864608 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-32296de4-d049-4b6c-af5e-27e49eb55371 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:40:00.865832 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-32296de4-d049-4b6c-af5e-27e49eb55371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:00.957819 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e90fe8-3ebb-4f9f-aa89-89669d3abcb2 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:00.972472 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1a6ef-dc7b-489c-8a08-0c560832dea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:00.978613 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1a6ef-dc7b-489c-8a08-0c560832dea4 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:00.979072 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1a6ef-dc7b-489c-8a08-0c560832dea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:00.979360 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1a6ef-dc7b-489c-8a08-0c560832dea4 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:00.980131 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1a6ef-dc7b-489c-8a08-0c560832dea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:00.989327 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1a6ef-dc7b-489c-8a08-0c560832dea4 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:01.017794 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1124/2247] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:40:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:40:01.018682 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32296de4-d049-4b6c-af5e-27e49eb55371 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:01.028244 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32296de4-d049-4b6c-af5e-27e49eb55371 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:01.035500 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1124/2248] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:40:00 2021] POST /identity/v3/users => generated 296 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:40:01.036763 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1a6ef-dc7b-489c-8a08-0c560832dea4 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:01.043388 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a5ab4-7f00-475e-8800-1226124478be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:01.044297 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a5ab4-7f00-475e-8800-1226124478be admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:01.044725 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a5ab4-7f00-475e-8800-1226124478be admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:01.045158 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a5ab4-7f00-475e-8800-1226124478be admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:01.046039 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a5ab4-7f00-475e-8800-1226124478be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:40:01.048905 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a5ab4-7f00-475e-8800-1226124478be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:01.050740 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a5ab4-7f00-475e-8800-1226124478be admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:01.063147 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1a6ef-dc7b-489c-8a08-0c560832dea4 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:01.069542 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1125/2249] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:40:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:40:01.074953 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a5ab4-7f00-475e-8800-1226124478be admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:01.085653 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848ee66-0266-42ce-9c01-c448283998f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:01.086448 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848ee66-0266-42ce-9c01-c448283998f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:01.086829 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848ee66-0266-42ce-9c01-c448283998f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:01.087465 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848ee66-0266-42ce-9c01-c448283998f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:01.088489 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848ee66-0266-42ce-9c01-c448283998f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:01.092810 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848ee66-0266-42ce-9c01-c448283998f7 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:01.093203 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a5ab4-7f00-475e-8800-1226124478be admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:01.106262 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09707905-5e2b-4187-bbc9-4093c90f6754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:01.106645 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09707905-5e2b-4187-bbc9-4093c90f6754 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:01.107011 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09707905-5e2b-4187-bbc9-4093c90f6754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:01.107382 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09707905-5e2b-4187-bbc9-4093c90f6754 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:01.108356 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09707905-5e2b-4187-bbc9-4093c90f6754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:01.110709 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09707905-5e2b-4187-bbc9-4093c90f6754 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:01.117373 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1125/2250] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:40:01 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:40:01.119241 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848ee66-0266-42ce-9c01-c448283998f7 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:01.130099 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848ee66-0266-42ce-9c01-c448283998f7 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:01.135309 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf70e0-fe0b-42cb-a6bc-e9979fb9ae9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:01.136516 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf70e0-fe0b-42cb-a6bc-e9979fb9ae9e admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:01.136998 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf70e0-fe0b-42cb-a6bc-e9979fb9ae9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:01.137468 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf70e0-fe0b-42cb-a6bc-e9979fb9ae9e admin admin] PATH_INFO: `/v3/projects/d4337b1475c94aa98b10e013f36b3ce0/users/1a77645ba4534892a7ee7d5f44e391f7/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:01.173982 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf70e0-fe0b-42cb-a6bc-e9979fb9ae9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4337b1475c94aa98b10e013f36b3ce0, user_id=1a77645ba4534892a7ee7d5f44e391f7, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:01.180601 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1126/2251] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:40:01 2021] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:40:01.182600 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09707905-5e2b-4187-bbc9-4093c90f6754 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:01.183289 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf70e0-fe0b-42cb-a6bc-e9979fb9ae9e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:01.206904 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1126/2252] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:40:01 2021] PUT /identity/v3/projects/d4337b1475c94aa98b10e013f36b3ce0/users/1a77645ba4534892a7ee7d5f44e391f7/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:40:01.211368 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf70e0-fe0b-42cb-a6bc-e9979fb9ae9e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:01.299127 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09707905-5e2b-4187-bbc9-4093c90f6754 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:01.365966 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf70e0-fe0b-42cb-a6bc-e9979fb9ae9e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:01.397860 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73191cd7-5115-44c9-8691-bff9ab31d2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:01.398479 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73191cd7-5115-44c9-8691-bff9ab31d2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:01.398768 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73191cd7-5115-44c9-8691-bff9ab31d2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:01.401675 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73191cd7-5115-44c9-8691-bff9ab31d2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:01.402471 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73191cd7-5115-44c9-8691-bff9ab31d2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:01.408431 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73191cd7-5115-44c9-8691-bff9ab31d2f7 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:01.435549 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1127/2253] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:40:01 2021] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:40:01.439189 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73191cd7-5115-44c9-8691-bff9ab31d2f7 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:01.463647 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73191cd7-5115-44c9-8691-bff9ab31d2f7 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:01.469499 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d74e3-a3f4-4b03-a210-010f2c5c175a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:01.470614 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd765de0-15f4-47e4-8487-704b618925fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:01.471386 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd765de0-15f4-47e4-8487-704b618925fe admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:01.471710 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd765de0-15f4-47e4-8487-704b618925fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:01.471885 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d74e3-a3f4-4b03-a210-010f2c5c175a admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:01.472002 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd765de0-15f4-47e4-8487-704b618925fe admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:01.472362 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d74e3-a3f4-4b03-a210-010f2c5c175a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:01.472676 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd765de0-15f4-47e4-8487-704b618925fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:01.472792 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d74e3-a3f4-4b03-a210-010f2c5c175a admin admin] PATH_INFO: `/v3/projects/d4337b1475c94aa98b10e013f36b3ce0/users/1a77645ba4534892a7ee7d5f44e391f7/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:01.475856 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d74e3-a3f4-4b03-a210-010f2c5c175a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4337b1475c94aa98b10e013f36b3ce0, user_id=1a77645ba4534892a7ee7d5f44e391f7, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:01.476024 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd765de0-15f4-47e4-8487-704b618925fe admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:01.481974 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d74e3-a3f4-4b03-a210-010f2c5c175a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:01.499987 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1128/2254] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:40:01 2021] PUT /identity/v3/projects/d4337b1475c94aa98b10e013f36b3ce0/users/1a77645ba4534892a7ee7d5f44e391f7/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:40:01.527978 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1127/2255] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:40:01 2021] POST /identity/v3/users => generated 286 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:40:01.531416 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d74e3-a3f4-4b03-a210-010f2c5c175a admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:01.616640 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d74e3-a3f4-4b03-a210-010f2c5c175a admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:01.622883 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557f545-5160-4983-9e41-8be3d71552df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:01.623581 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557f545-5160-4983-9e41-8be3d71552df admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:01.623933 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557f545-5160-4983-9e41-8be3d71552df admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:01.624259 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557f545-5160-4983-9e41-8be3d71552df admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:01.625006 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557f545-5160-4983-9e41-8be3d71552df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:01.626844 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557f545-5160-4983-9e41-8be3d71552df admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:01.643821 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd765de0-15f4-47e4-8487-704b618925fe admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:01.652951 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1129/2256] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:40:01 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:40:01.656947 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd765de0-15f4-47e4-8487-704b618925fe admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:01.661902 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bb6d9-41b5-4742-9a69-3285892dfed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:01.662631 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bb6d9-41b5-4742-9a69-3285892dfed9 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:01.663117 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bb6d9-41b5-4742-9a69-3285892dfed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:01.663387 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bb6d9-41b5-4742-9a69-3285892dfed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:01.664304 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bb6d9-41b5-4742-9a69-3285892dfed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:01.666148 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bb6d9-41b5-4742-9a69-3285892dfed9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:01.683862 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1128/2257] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:40:01 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:40:01.685061 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557f545-5160-4983-9e41-8be3d71552df admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:01.695900 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557f545-5160-4983-9e41-8be3d71552df admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:01.701219 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362a947-1332-4cf1-a6ab-768c93b169d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:01.702787 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362a947-1332-4cf1-a6ab-768c93b169d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:01.703232 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362a947-1332-4cf1-a6ab-768c93b169d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:01.703343 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362a947-1332-4cf1-a6ab-768c93b169d2 admin admin] PATH_INFO: `/v3/projects/2e70b7afa65b45d19294e3a06917a51d/users/8eb29072473e4c198148b0059eb1bc3e/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:01.735099 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362a947-1332-4cf1-a6ab-768c93b169d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e70b7afa65b45d19294e3a06917a51d, user_id=8eb29072473e4c198148b0059eb1bc3e, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:01.737901 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362a947-1332-4cf1-a6ab-768c93b169d2 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:01.763892 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1130/2258] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:40:01 2021] PUT /identity/v3/projects/2e70b7afa65b45d19294e3a06917a51d/users/8eb29072473e4c198148b0059eb1bc3e/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:40:01.768610 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290a749-081b-4431-a522-fd7c2d2f647d None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:01.768925 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290a749-081b-4431-a522-fd7c2d2f647d None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:01.769200 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290a749-081b-4431-a522-fd7c2d2f647d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:01.790311 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-4290a749-081b-4431-a522-fd7c2d2f647d None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:40:01.792001 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-4290a749-081b-4431-a522-fd7c2d2f647d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:01.886695 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1129/2259] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:40:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:40:01.897868 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362a947-1332-4cf1-a6ab-768c93b169d2 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:01.900433 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-8362a947-1332-4cf1-a6ab-768c93b169d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:01.970863 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362a947-1332-4cf1-a6ab-768c93b169d2 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:01.974563 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f508497-e57f-4079-91b2-027dee7a35ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:01.975217 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f508497-e57f-4079-91b2-027dee7a35ef service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:01.975499 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f508497-e57f-4079-91b2-027dee7a35ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:01.975808 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f508497-e57f-4079-91b2-027dee7a35ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:01.991874 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f508497-e57f-4079-91b2-027dee7a35ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:01.993546 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f508497-e57f-4079-91b2-027dee7a35ef service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:02.008964 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1131/2260] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:40:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:40:09.883138 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5f2ce-587b-4fd3-afcc-eaf4e1f9814c None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:09.883781 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5f2ce-587b-4fd3-afcc-eaf4e1f9814c None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:09.883781 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5f2ce-587b-4fd3-afcc-eaf4e1f9814c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:09.911077 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-acf5f2ce-587b-4fd3-afcc-eaf4e1f9814c None None] MFA Rules not processed for user `f1f3db9250cc4edbacb392d5d0d18e08`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:40:09.912769 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-acf5f2ce-587b-4fd3-afcc-eaf4e1f9814c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:10.043482 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1130/2261] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:40:09 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:40:10.162663 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7f4a2-9908-47ef-9ab0-ebfd5b436b8b None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:10.163158 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7f4a2-9908-47ef-9ab0-ebfd5b436b8b None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:10.163252 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7f4a2-9908-47ef-9ab0-ebfd5b436b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:10.202771 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-35e7f4a2-9908-47ef-9ab0-ebfd5b436b8b None None] MFA Rules not processed for user `1a77645ba4534892a7ee7d5f44e391f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:40:10.204187 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-35e7f4a2-9908-47ef-9ab0-ebfd5b436b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:10.379608 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1132/2262] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:40:10 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:40:10.381253 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5f2ce-587b-4fd3-afcc-eaf4e1f9814c None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:10.383171 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-acf5f2ce-587b-4fd3-afcc-eaf4e1f9814c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:10.508504 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5f2ce-587b-4fd3-afcc-eaf4e1f9814c None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:10.515164 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad7929-a8d2-4197-957d-f2e7581374a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:10.516004 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad7929-a8d2-4197-957d-f2e7581374a1 service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:10.516371 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad7929-a8d2-4197-957d-f2e7581374a1 service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:10.518091 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad7929-a8d2-4197-957d-f2e7581374a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:10.522153 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e6ad7929-a8d2-4197-957d-f2e7581374a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:10.592649 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad7929-a8d2-4197-957d-f2e7581374a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:10.595852 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad7929-a8d2-4197-957d-f2e7581374a1 service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:10.612358 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1131/2263] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:40:10 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:40:11.193015 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ed2f2-e13e-44c4-a05c-25eb0a3f8669 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:11.194036 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ed2f2-e13e-44c4-a05c-25eb0a3f8669 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:11.194532 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ed2f2-e13e-44c4-a05c-25eb0a3f8669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:11.238153 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-040ed2f2-e13e-44c4-a05c-25eb0a3f8669 None None] MFA Rules not processed for user `8eb29072473e4c198148b0059eb1bc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:40:11.239738 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-040ed2f2-e13e-44c4-a05c-25eb0a3f8669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:11.329633 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1133/2264] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:40:11 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:40:11.331431 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad7929-a8d2-4197-957d-f2e7581374a1 service nova] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:11.350056 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad7929-a8d2-4197-957d-f2e7581374a1 service nova] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:11.362905 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ef271-906b-471a-97ab-aade1b9b88cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:11.363654 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ef271-906b-471a-97ab-aade1b9b88cb admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:11.364071 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ef271-906b-471a-97ab-aade1b9b88cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:11.364411 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ef271-906b-471a-97ab-aade1b9b88cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:11.365343 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ef271-906b-471a-97ab-aade1b9b88cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:11.370043 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ef271-906b-471a-97ab-aade1b9b88cb admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:11.434401 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ed2f2-e13e-44c4-a05c-25eb0a3f8669 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:11.434619 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1132/2265] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:40:11 2021] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:40:11.477955 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ed2f2-e13e-44c4-a05c-25eb0a3f8669 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:11.651918 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c076d90-164e-4522-b02f-7d56fae422e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:11.652604 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c076d90-164e-4522-b02f-7d56fae422e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:11.652885 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c076d90-164e-4522-b02f-7d56fae422e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:11.653157 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c076d90-164e-4522-b02f-7d56fae422e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:11.653878 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c076d90-164e-4522-b02f-7d56fae422e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:11.655845 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c076d90-164e-4522-b02f-7d56fae422e9 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:11.710293 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1134/2266] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:40:11 2021] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:40:11.711842 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ef271-906b-471a-97ab-aade1b9b88cb admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:11.728201 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ef271-906b-471a-97ab-aade1b9b88cb admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:11.738441 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095e8f0-30d4-418e-8171-7c781b4f24a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:11.739483 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095e8f0-30d4-418e-8171-7c781b4f24a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:11.740016 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095e8f0-30d4-418e-8171-7c781b4f24a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:11.740506 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095e8f0-30d4-418e-8171-7c781b4f24a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:11.741451 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095e8f0-30d4-418e-8171-7c781b4f24a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:11.744992 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095e8f0-30d4-418e-8171-7c781b4f24a3 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:11.762723 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1133/2267] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:40:11 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:40:11.762917 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c076d90-164e-4522-b02f-7d56fae422e9 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:11.781193 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c076d90-164e-4522-b02f-7d56fae422e9 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:11.787348 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76616f4c-7ae6-4dfe-b13b-b867cac142b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:11.788528 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76616f4c-7ae6-4dfe-b13b-b867cac142b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:11.789170 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76616f4c-7ae6-4dfe-b13b-b867cac142b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:11.789858 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76616f4c-7ae6-4dfe-b13b-b867cac142b9 admin admin] PATH_INFO: `/v3/projects/78920fdeaa5545bf8fa0473c9149aef3/users/e54d3715292b4eed888e8343437fcd6f/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:11.836769 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76616f4c-7ae6-4dfe-b13b-b867cac142b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78920fdeaa5545bf8fa0473c9149aef3, user_id=e54d3715292b4eed888e8343437fcd6f, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:11.840337 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76616f4c-7ae6-4dfe-b13b-b867cac142b9 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:11.885201 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1135/2268] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:40:11 2021] PUT /identity/v3/projects/78920fdeaa5545bf8fa0473c9149aef3/users/e54d3715292b4eed888e8343437fcd6f/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:40:11.888904 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095e8f0-30d4-418e-8171-7c781b4f24a3 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:11.906239 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095e8f0-30d4-418e-8171-7c781b4f24a3 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:12.029931 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2c61e-102a-42ca-b53a-5487240d3db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:12.030614 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2c61e-102a-42ca-b53a-5487240d3db4 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:12.030897 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2c61e-102a-42ca-b53a-5487240d3db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:12.031175 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2c61e-102a-42ca-b53a-5487240d3db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:12.035444 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2c61e-102a-42ca-b53a-5487240d3db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:12.037235 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2c61e-102a-42ca-b53a-5487240d3db4 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:12.057317 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1134/2269] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:40:11 2021] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:40:12.061452 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76616f4c-7ae6-4dfe-b13b-b867cac142b9 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:12.101319 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76616f4c-7ae6-4dfe-b13b-b867cac142b9 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:12.110580 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2c4af-e895-40dd-8228-e3abade95b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:12.111980 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2c4af-e895-40dd-8228-e3abade95b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:12.112267 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2c4af-e895-40dd-8228-e3abade95b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:12.112539 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2c4af-e895-40dd-8228-e3abade95b98 admin admin] PATH_INFO: `/v3/projects/78920fdeaa5545bf8fa0473c9149aef3/users/e54d3715292b4eed888e8343437fcd6f/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:12.114574 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2c4af-e895-40dd-8228-e3abade95b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78920fdeaa5545bf8fa0473c9149aef3, user_id=e54d3715292b4eed888e8343437fcd6f, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:12.120323 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2c4af-e895-40dd-8228-e3abade95b98 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:12.157499 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1136/2270] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:40:12 2021] PUT /identity/v3/projects/78920fdeaa5545bf8fa0473c9149aef3/users/e54d3715292b4eed888e8343437fcd6f/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:40:18.636622 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2c61e-102a-42ca-b53a-5487240d3db4 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:18.639109 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e4b2c61e-102a-42ca-b53a-5487240d3db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:18.654648 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2c61e-102a-42ca-b53a-5487240d3db4 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:18.738407 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878cc7f-5b91-4c48-a29a-a77ce650019b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:18.739585 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878cc7f-5b91-4c48-a29a-a77ce650019b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:18.740152 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878cc7f-5b91-4c48-a29a-a77ce650019b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:18.740623 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878cc7f-5b91-4c48-a29a-a77ce650019b admin admin] PATH_INFO: `/v3/users/a650582846f042b780d2e3f92d1a9803` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:18.743673 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878cc7f-5b91-4c48-a29a-a77ce650019b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a650582846f042b780d2e3f92d1a9803)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:18.745921 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878cc7f-5b91-4c48-a29a-a77ce650019b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:18.811023 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-2878cc7f-5b91-4c48-a29a-a77ce650019b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a650582846f042b780d2e3f92d1a9803'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:40:18.833121 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-2878cc7f-5b91-4c48-a29a-a77ce650019b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a650582846f042b780d2e3f92d1a9803'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:40:18.842692 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-2878cc7f-5b91-4c48-a29a-a77ce650019b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a650582846f042b780d2e3f92d1a9803'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:40:18.843736 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-2878cc7f-5b91-4c48-a29a-a77ce650019b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a650582846f042b780d2e3f92d1a9803'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:40:18.864324 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-2878cc7f-5b91-4c48-a29a-a77ce650019b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a650582846f042b780d2e3f92d1a9803'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:40:18.885767 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1135/2271] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:40:18 2021] DELETE /identity/v3/users/a650582846f042b780d2e3f92d1a9803 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:40:18.891655 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6d95e-25d1-421a-b583-afa29208af0c None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:18.892254 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6d95e-25d1-421a-b583-afa29208af0c None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:18.892347 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6d95e-25d1-421a-b583-afa29208af0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:18.914902 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-3cc6d95e-25d1-421a-b583-afa29208af0c None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:40:18.916402 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-3cc6d95e-25d1-421a-b583-afa29208af0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:18.997869 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1137/2272] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:40:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:40:19.011332 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878cc7f-5b91-4c48-a29a-a77ce650019b admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:19.012841 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-2878cc7f-5b91-4c48-a29a-a77ce650019b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:19.174356 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878cc7f-5b91-4c48-a29a-a77ce650019b admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:19.188609 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d198c94-5e95-48b3-b407-1438ef311b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:19.189200 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d198c94-5e95-48b3-b407-1438ef311b1b service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:19.189490 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d198c94-5e95-48b3-b407-1438ef311b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:19.189771 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d198c94-5e95-48b3-b407-1438ef311b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:19.205917 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d198c94-5e95-48b3-b407-1438ef311b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:19.207405 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d198c94-5e95-48b3-b407-1438ef311b1b service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:19.234964 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1136/2273] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:40:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:40:20.085390 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6d95e-25d1-421a-b583-afa29208af0c None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:20.100668 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-3cc6d95e-25d1-421a-b583-afa29208af0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:20.141280 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6d95e-25d1-421a-b583-afa29208af0c None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:20.159569 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d880cb6-7cbf-4d5b-976f-5d96249ffa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:20.160886 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d880cb6-7cbf-4d5b-976f-5d96249ffa5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:20.161261 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d880cb6-7cbf-4d5b-976f-5d96249ffa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:20.165914 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d880cb6-7cbf-4d5b-976f-5d96249ffa5a admin admin] PATH_INFO: `/v3/projects/ac6f626ef59945c4a1495ec58574460c` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:20.174795 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d880cb6-7cbf-4d5b-976f-5d96249ffa5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac6f626ef59945c4a1495ec58574460c)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:20.177640 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d880cb6-7cbf-4d5b-976f-5d96249ffa5a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:20.292798 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-7d880cb6-7cbf-4d5b-976f-5d96249ffa5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac6f626ef59945c4a1495ec58574460c', 'request_id': 'req-7d880cb6-7cbf-4d5b-976f-5d96249ffa5a'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:40:20.306265 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-7d880cb6-7cbf-4d5b-976f-5d96249ffa5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac6f626ef59945c4a1495ec58574460c', 'request_id': 'req-7d880cb6-7cbf-4d5b-976f-5d96249ffa5a'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:40:20.322165 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-7d880cb6-7cbf-4d5b-976f-5d96249ffa5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac6f626ef59945c4a1495ec58574460c', 'request_id': 'req-7d880cb6-7cbf-4d5b-976f-5d96249ffa5a'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:40:20.355300 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-7d880cb6-7cbf-4d5b-976f-5d96249ffa5a admin admin] The token cache is being invalidate because project ac6f626ef59945c4a1495ec58574460c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:40:20.355611 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-7d880cb6-7cbf-4d5b-976f-5d96249ffa5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:40:20.356334 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-7d880cb6-7cbf-4d5b-976f-5d96249ffa5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:40:20.358268 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1138/2274] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:40:20 2021] DELETE /identity/v3/projects/ac6f626ef59945c4a1495ec58574460c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:40:20.364969 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71ed90-4c32-4c95-82a2-3bb98d130e30 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:20.365522 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71ed90-4c32-4c95-82a2-3bb98d130e30 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:20.365675 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71ed90-4c32-4c95-82a2-3bb98d130e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:20.408890 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-7b71ed90-4c32-4c95-82a2-3bb98d130e30 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:40:20.415903 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7b71ed90-4c32-4c95-82a2-3bb98d130e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:20.616122 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1137/2275] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:40:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:40:20.623564 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d9fae-a754-4bad-8bfe-6635eabf34ba None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:20.624032 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d9fae-a754-4bad-8bfe-6635eabf34ba None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:20.624355 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d9fae-a754-4bad-8bfe-6635eabf34ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:20.702687 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-687d9fae-a754-4bad-8bfe-6635eabf34ba None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:40:20.703971 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-687d9fae-a754-4bad-8bfe-6635eabf34ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:20.747288 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1139/2276] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:40:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:40:20.758645 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71ed90-4c32-4c95-82a2-3bb98d130e30 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:20.778349 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71ed90-4c32-4c95-82a2-3bb98d130e30 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:20.799117 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc09987-93e3-4e0a-924f-a7e65980f3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:20.800099 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc09987-93e3-4e0a-924f-a7e65980f3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:20.802121 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc09987-93e3-4e0a-924f-a7e65980f3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:20.803862 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc09987-93e3-4e0a-924f-a7e65980f3b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:20.805268 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc09987-93e3-4e0a-924f-a7e65980f3b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:40:20.808065 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc09987-93e3-4e0a-924f-a7e65980f3b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:20.812349 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc09987-93e3-4e0a-924f-a7e65980f3b1 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:20.872290 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1138/2277] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:40:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:40:20.872959 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d9fae-a754-4bad-8bfe-6635eabf34ba None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:20.886676 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d9fae-a754-4bad-8bfe-6635eabf34ba None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:20.904373 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1dc2f-3610-4ff2-8f2d-04c1f4a9e85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:20.905073 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1dc2f-3610-4ff2-8f2d-04c1f4a9e85e admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:20.905361 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1dc2f-3610-4ff2-8f2d-04c1f4a9e85e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:20.905639 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1dc2f-3610-4ff2-8f2d-04c1f4a9e85e admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:20.906367 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1dc2f-3610-4ff2-8f2d-04c1f4a9e85e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:20.908388 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1dc2f-3610-4ff2-8f2d-04c1f4a9e85e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:20.971237 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1140/2278] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:40:20 2021] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:40:20.976187 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc09987-93e3-4e0a-924f-a7e65980f3b1 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:20.996692 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc09987-93e3-4e0a-924f-a7e65980f3b1 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:21.156461 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829ab99-c191-46e1-a482-1538d72218a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:21.157627 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829ab99-c191-46e1-a482-1538d72218a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:21.158010 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829ab99-c191-46e1-a482-1538d72218a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:21.158388 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829ab99-c191-46e1-a482-1538d72218a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:21.159364 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829ab99-c191-46e1-a482-1538d72218a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:21.161407 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829ab99-c191-46e1-a482-1538d72218a9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:21.218586 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1139/2279] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:40:20 2021] POST /identity/v3/users => generated 286 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:40:21.222601 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1dc2f-3610-4ff2-8f2d-04c1f4a9e85e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:21.240919 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1dc2f-3610-4ff2-8f2d-04c1f4a9e85e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:21.260113 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995692a8-91be-4e09-aaf7-387b6cce4822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:21.261196 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995692a8-91be-4e09-aaf7-387b6cce4822 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:21.261689 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995692a8-91be-4e09-aaf7-387b6cce4822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:21.262169 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995692a8-91be-4e09-aaf7-387b6cce4822 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:21.263622 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995692a8-91be-4e09-aaf7-387b6cce4822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:21.268252 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995692a8-91be-4e09-aaf7-387b6cce4822 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:21.309565 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1141/2280] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:40:21 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:40:21.313324 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829ab99-c191-46e1-a482-1538d72218a9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:21.329497 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829ab99-c191-46e1-a482-1538d72218a9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:21.354281 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027cea3-299c-43b7-a029-a1efd3bf6809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:21.356302 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027cea3-299c-43b7-a029-a1efd3bf6809 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:21.356975 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027cea3-299c-43b7-a029-a1efd3bf6809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:21.357630 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027cea3-299c-43b7-a029-a1efd3bf6809 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:21.359116 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027cea3-299c-43b7-a029-a1efd3bf6809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:21.366458 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027cea3-299c-43b7-a029-a1efd3bf6809 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:21.409680 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995692a8-91be-4e09-aaf7-387b6cce4822 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:21.412700 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1140/2281] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:40:21 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:40:21.424141 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995692a8-91be-4e09-aaf7-387b6cce4822 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:21.434162 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93d2c3-5c0b-4e7d-968f-bf09a2889f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:21.435407 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93d2c3-5c0b-4e7d-968f-bf09a2889f87 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:21.435887 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93d2c3-5c0b-4e7d-968f-bf09a2889f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:21.436334 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93d2c3-5c0b-4e7d-968f-bf09a2889f87 admin admin] PATH_INFO: `/v3/projects/6e4248e1344b4eea906aa29ac26625f3/users/8a36bca064284ac296d0af7310065acf/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:21.459563 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93d2c3-5c0b-4e7d-968f-bf09a2889f87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4248e1344b4eea906aa29ac26625f3, user_id=8a36bca064284ac296d0af7310065acf, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:21.463244 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93d2c3-5c0b-4e7d-968f-bf09a2889f87 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:21.480666 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1142/2282] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:40:21 2021] PUT /identity/v3/projects/6e4248e1344b4eea906aa29ac26625f3/users/8a36bca064284ac296d0af7310065acf/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:40:21.492346 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b2d49-9007-41ac-90c3-3002f9484a71 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:21.493660 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b2d49-9007-41ac-90c3-3002f9484a71 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:21.494141 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b2d49-9007-41ac-90c3-3002f9484a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:21.550439 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-903b2d49-9007-41ac-90c3-3002f9484a71 None None] MFA Rules not processed for user `8a36bca064284ac296d0af7310065acf`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:40:21.552127 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-903b2d49-9007-41ac-90c3-3002f9484a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:21.561947 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a9d4c-af8c-4084-8d7b-4b318cf48e2d None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:21.562241 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a9d4c-af8c-4084-8d7b-4b318cf48e2d None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:21.562518 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a9d4c-af8c-4084-8d7b-4b318cf48e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:21.596898 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-e99a9d4c-af8c-4084-8d7b-4b318cf48e2d None None] MFA Rules not processed for user `e54d3715292b4eed888e8343437fcd6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:40:21.598313 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-e99a9d4c-af8c-4084-8d7b-4b318cf48e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:21.640254 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1141/2283] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:40:21 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:40:21.694496 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1143/2284] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:40:21 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:40:21.706392 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b2d49-9007-41ac-90c3-3002f9484a71 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:21.707830 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-903b2d49-9007-41ac-90c3-3002f9484a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:21.781669 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b2d49-9007-41ac-90c3-3002f9484a71 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:21.788009 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fffdc-c618-4407-83c7-719068aedf40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:21.788738 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fffdc-c618-4407-83c7-719068aedf40 service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:21.788943 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fffdc-c618-4407-83c7-719068aedf40 service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:21.789216 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fffdc-c618-4407-83c7-719068aedf40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:21.791355 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-0e3fffdc-c618-4407-83c7-719068aedf40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:21.847098 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fffdc-c618-4407-83c7-719068aedf40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:21.848711 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fffdc-c618-4407-83c7-719068aedf40 service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:21.857860 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1142/2285] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:40:21 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:40:23.062508 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886bf03-74b1-432d-83a6-5b51ed599f19 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:23.062974 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886bf03-74b1-432d-83a6-5b51ed599f19 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:23.063066 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886bf03-74b1-432d-83a6-5b51ed599f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:23.081228 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-0886bf03-74b1-432d-83a6-5b51ed599f19 None None] MFA Rules not processed for user `8eb29072473e4c198148b0059eb1bc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:40:23.082555 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-0886bf03-74b1-432d-83a6-5b51ed599f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:23.090713 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1144/2286] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:40:23 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:40:34.902978 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fffdc-c618-4407-83c7-719068aedf40 service nova] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:34.904461 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-0e3fffdc-c618-4407-83c7-719068aedf40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:34.958924 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fffdc-c618-4407-83c7-719068aedf40 service nova] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:34.963035 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736cdb7-f6fa-4b55-9e7c-13da8609c0ac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456c83b8619847279927251ca48fca37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:34.963951 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736cdb7-f6fa-4b55-9e7c-13da8609c0ac service glance] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:34.964235 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736cdb7-f6fa-4b55-9e7c-13da8609c0ac service glance] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:34.964510 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736cdb7-f6fa-4b55-9e7c-13da8609c0ac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:34.972381 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736cdb7-f6fa-4b55-9e7c-13da8609c0ac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:34.973804 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736cdb7-f6fa-4b55-9e7c-13da8609c0ac service glance] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:34.982289 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1143/2287] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:40:34 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:40:35.410785 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e066f-9d5b-4e6e-9174-17edfc1c158b None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:35.411293 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e066f-9d5b-4e6e-9174-17edfc1c158b None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:35.411472 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e066f-9d5b-4e6e-9174-17edfc1c158b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:35.435876 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-777e066f-9d5b-4e6e-9174-17edfc1c158b None None] MFA Rules not processed for user `3f598b94a850413494da575188706cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:40:35.437116 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-777e066f-9d5b-4e6e-9174-17edfc1c158b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:35.517300 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1145/2288] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Oct 15 03:40:35 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:40:35.584213 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736cdb7-f6fa-4b55-9e7c-13da8609c0ac service glance] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:40:35.585825 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e736cdb7-f6fa-4b55-9e7c-13da8609c0ac service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:40:35.688411 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736cdb7-f6fa-4b55-9e7c-13da8609c0ac service glance] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:40:35.694146 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048202b-81ea-4977-919d-8c8cf473a712 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfdf0fb38dd04c75a1c874913ea1bf98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:40:35.694792 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048202b-81ea-4977-919d-8c8cf473a712 service swift] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:40:35.695069 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048202b-81ea-4977-919d-8c8cf473a712 service swift] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:40:35.695340 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048202b-81ea-4977-919d-8c8cf473a712 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:40:35.704335 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048202b-81ea-4977-919d-8c8cf473a712 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:40:35.705963 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048202b-81ea-4977-919d-8c8cf473a712 service swift] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:40:35.714964 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1144/2289] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Oct 15 03:40:35 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 15 03:41:00.506607 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e066f-9d5b-4e6e-9174-17edfc1c158b None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:00.508579 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-777e066f-9d5b-4e6e-9174-17edfc1c158b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:00.574195 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e066f-9d5b-4e6e-9174-17edfc1c158b None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:00.578713 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048cb45-3ced-49a5-bc14-ef45460dd6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:00.579565 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048cb45-3ced-49a5-bc14-ef45460dd6ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:00.579880 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048cb45-3ced-49a5-bc14-ef45460dd6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:00.580155 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048cb45-3ced-49a5-bc14-ef45460dd6ef admin admin] PATH_INFO: `/v3/users/f1f3db9250cc4edbacb392d5d0d18e08` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:00.581705 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048cb45-3ced-49a5-bc14-ef45460dd6ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1f3db9250cc4edbacb392d5d0d18e08)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:00.584169 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048cb45-3ced-49a5-bc14-ef45460dd6ef admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:00.634889 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-4048cb45-3ced-49a5-bc14-ef45460dd6ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1f3db9250cc4edbacb392d5d0d18e08'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:00.649700 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-4048cb45-3ced-49a5-bc14-ef45460dd6ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1f3db9250cc4edbacb392d5d0d18e08'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:00.656999 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-4048cb45-3ced-49a5-bc14-ef45460dd6ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1f3db9250cc4edbacb392d5d0d18e08'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:00.657666 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-4048cb45-3ced-49a5-bc14-ef45460dd6ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1f3db9250cc4edbacb392d5d0d18e08'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:00.664814 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-4048cb45-3ced-49a5-bc14-ef45460dd6ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1f3db9250cc4edbacb392d5d0d18e08'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:00.670525 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1146/2290] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:41:00 2021] DELETE /identity/v3/users/f1f3db9250cc4edbacb392d5d0d18e08 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:00.837413 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048202b-81ea-4977-919d-8c8cf473a712 service swift] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:00.858882 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048202b-81ea-4977-919d-8c8cf473a712 service swift] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:00.922732 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a372a-23da-4777-9e79-9cf50812c739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:00.923580 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a372a-23da-4777-9e79-9cf50812c739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:00.923898 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a372a-23da-4777-9e79-9cf50812c739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:00.924180 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a372a-23da-4777-9e79-9cf50812c739 admin admin] PATH_INFO: `/v3/projects/fca42958bf634cd8be46887a2580f4cc` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:00.925634 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a372a-23da-4777-9e79-9cf50812c739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fca42958bf634cd8be46887a2580f4cc)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:00.927277 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a372a-23da-4777-9e79-9cf50812c739 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:00.976328 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-689a372a-23da-4777-9e79-9cf50812c739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fca42958bf634cd8be46887a2580f4cc', 'request_id': 'req-689a372a-23da-4777-9e79-9cf50812c739'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:00.982756 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-689a372a-23da-4777-9e79-9cf50812c739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fca42958bf634cd8be46887a2580f4cc', 'request_id': 'req-689a372a-23da-4777-9e79-9cf50812c739'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:00.987981 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-689a372a-23da-4777-9e79-9cf50812c739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fca42958bf634cd8be46887a2580f4cc', 'request_id': 'req-689a372a-23da-4777-9e79-9cf50812c739'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:00.999980 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-689a372a-23da-4777-9e79-9cf50812c739 admin admin] The token cache is being invalidate because project fca42958bf634cd8be46887a2580f4cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:41:01.000269 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-689a372a-23da-4777-9e79-9cf50812c739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:01.000892 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-689a372a-23da-4777-9e79-9cf50812c739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:01.002416 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1145/2291] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:41:00 2021] DELETE /identity/v3/projects/fca42958bf634cd8be46887a2580f4cc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:01.008928 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef9e91-78c3-4e6a-a340-4b0435ca941f None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:01.009285 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef9e91-78c3-4e6a-a340-4b0435ca941f None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:01.009622 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef9e91-78c3-4e6a-a340-4b0435ca941f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:01.028962 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-5bef9e91-78c3-4e6a-a340-4b0435ca941f None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:01.030171 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-5bef9e91-78c3-4e6a-a340-4b0435ca941f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:01.095072 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1147/2292] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:41:01.102921 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9c816-915d-4ad6-b608-c1dc89f49dbf None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:01.103200 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9c816-915d-4ad6-b608-c1dc89f49dbf None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:01.103474 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9c816-915d-4ad6-b608-c1dc89f49dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:01.121730 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-6ad9c816-915d-4ad6-b608-c1dc89f49dbf None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:01.122928 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-6ad9c816-915d-4ad6-b608-c1dc89f49dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:01.130964 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1146/2293] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:41:01.135568 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef9e91-78c3-4e6a-a340-4b0435ca941f None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:01.145140 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef9e91-78c3-4e6a-a340-4b0435ca941f None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:01.149727 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ed173-5861-4900-af64-ed0f2b6f1896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:01.150400 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ed173-5861-4900-af64-ed0f2b6f1896 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:01.150933 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ed173-5861-4900-af64-ed0f2b6f1896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:01.150933 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ed173-5861-4900-af64-ed0f2b6f1896 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:01.151874 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ed173-5861-4900-af64-ed0f2b6f1896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:41:01.151999 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ed173-5861-4900-af64-ed0f2b6f1896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:01.153578 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ed173-5861-4900-af64-ed0f2b6f1896 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:01.170875 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1148/2294] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:41:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:41:01.174319 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9c816-915d-4ad6-b608-c1dc89f49dbf None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:01.184043 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9c816-915d-4ad6-b608-c1dc89f49dbf None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:01.194421 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dde42a-0cef-4ade-8077-9ef4e4a6edbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:01.194421 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dde42a-0cef-4ade-8077-9ef4e4a6edbb admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:01.194421 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dde42a-0cef-4ade-8077-9ef4e4a6edbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:01.194421 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dde42a-0cef-4ade-8077-9ef4e4a6edbb admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:01.194974 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dde42a-0cef-4ade-8077-9ef4e4a6edbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:01.196053 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dde42a-0cef-4ade-8077-9ef4e4a6edbb admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:01.224109 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1147/2295] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:41:01 2021] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:41:01.228302 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ed173-5861-4900-af64-ed0f2b6f1896 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:01.238181 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ed173-5861-4900-af64-ed0f2b6f1896 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:01.297215 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbc262-833f-4755-953f-29cadfa7c3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:01.297880 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbc262-833f-4755-953f-29cadfa7c3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:01.298259 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbc262-833f-4755-953f-29cadfa7c3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:01.298422 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbc262-833f-4755-953f-29cadfa7c3d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:01.299135 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcbc262-833f-4755-953f-29cadfa7c3d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:01.301085 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcbc262-833f-4755-953f-29cadfa7c3d7 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:01.322632 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1149/2296] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:41:01 2021] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:41:01.326803 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dde42a-0cef-4ade-8077-9ef4e4a6edbb admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:01.336718 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dde42a-0cef-4ade-8077-9ef4e4a6edbb admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:01.341499 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bff45-6823-441c-8ac0-6e7a126aafae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:01.342147 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bff45-6823-441c-8ac0-6e7a126aafae admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:01.342423 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bff45-6823-441c-8ac0-6e7a126aafae admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:01.342693 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bff45-6823-441c-8ac0-6e7a126aafae admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:01.343416 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bff45-6823-441c-8ac0-6e7a126aafae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:01.345062 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bff45-6823-441c-8ac0-6e7a126aafae admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:01.355358 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1148/2297] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:41:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:41:01.359289 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbc262-833f-4755-953f-29cadfa7c3d7 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:01.370070 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbc262-833f-4755-953f-29cadfa7c3d7 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:01.374647 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d905d-9c8a-4650-a071-17957ddfb71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:01.375288 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d905d-9c8a-4650-a071-17957ddfb71d admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:01.375570 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d905d-9c8a-4650-a071-17957ddfb71d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:01.375877 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d905d-9c8a-4650-a071-17957ddfb71d admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:01.376607 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d905d-9c8a-4650-a071-17957ddfb71d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:01.378189 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d905d-9c8a-4650-a071-17957ddfb71d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:01.388656 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1150/2298] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:41:01 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:41:01.392700 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bff45-6823-441c-8ac0-6e7a126aafae admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:01.402481 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bff45-6823-441c-8ac0-6e7a126aafae admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:01.407203 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36576d-270c-4aaf-9a6c-5bcbb2ba9ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:01.408099 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36576d-270c-4aaf-9a6c-5bcbb2ba9ae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:01.408379 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36576d-270c-4aaf-9a6c-5bcbb2ba9ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:01.408651 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36576d-270c-4aaf-9a6c-5bcbb2ba9ae9 admin admin] PATH_INFO: `/v3/projects/d6aa16fd65ca474aaacb76383a3157ce/users/c9319002c1a24b8ab2c7ee86e2533c23/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:01.422438 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36576d-270c-4aaf-9a6c-5bcbb2ba9ae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6aa16fd65ca474aaacb76383a3157ce, user_id=c9319002c1a24b8ab2c7ee86e2533c23, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:01.425117 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36576d-270c-4aaf-9a6c-5bcbb2ba9ae9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:01.437747 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1149/2299] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:41:01 2021] PUT /identity/v3/projects/d6aa16fd65ca474aaacb76383a3157ce/users/c9319002c1a24b8ab2c7ee86e2533c23/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:01.447534 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa287e3-8b63-4c2f-983d-ef888266af28 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:01.447854 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa287e3-8b63-4c2f-983d-ef888266af28 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:01.448665 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa287e3-8b63-4c2f-983d-ef888266af28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:01.475645 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-9fa287e3-8b63-4c2f-983d-ef888266af28 None None] MFA Rules not processed for user `c9319002c1a24b8ab2c7ee86e2533c23`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:01.476994 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-9fa287e3-8b63-4c2f-983d-ef888266af28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:01.540503 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1151/2300] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:01 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:41:01.544962 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36576d-270c-4aaf-9a6c-5bcbb2ba9ae9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:01.608088 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36576d-270c-4aaf-9a6c-5bcbb2ba9ae9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:01.612604 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340eea6-c393-4e59-8c4f-9c11a2e1f0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:01.613248 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340eea6-c393-4e59-8c4f-9c11a2e1f0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:01.613525 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340eea6-c393-4e59-8c4f-9c11a2e1f0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:01.613793 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340eea6-c393-4e59-8c4f-9c11a2e1f0e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:01.614495 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340eea6-c393-4e59-8c4f-9c11a2e1f0e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:01.616421 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340eea6-c393-4e59-8c4f-9c11a2e1f0e4 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:01.641707 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1150/2301] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:41:01 2021] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:41:01.645817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa287e3-8b63-4c2f-983d-ef888266af28 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:01.656078 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa287e3-8b63-4c2f-983d-ef888266af28 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:01.711694 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf65a4-69b1-4699-a14c-548a7bf92ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:01.712379 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf65a4-69b1-4699-a14c-548a7bf92ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:01.712678 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf65a4-69b1-4699-a14c-548a7bf92ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:01.712953 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf65a4-69b1-4699-a14c-548a7bf92ef8 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:01.713914 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf65a4-69b1-4699-a14c-548a7bf92ef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:01.716544 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf65a4-69b1-4699-a14c-548a7bf92ef8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:01.736064 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1152/2302] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:41:01 2021] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:41:01.740174 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340eea6-c393-4e59-8c4f-9c11a2e1f0e4 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:01.750865 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340eea6-c393-4e59-8c4f-9c11a2e1f0e4 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:01.756175 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5ea47-c645-419f-b64e-9d3cc1a401ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:01.756851 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5ea47-c645-419f-b64e-9d3cc1a401ea admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:01.757134 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5ea47-c645-419f-b64e-9d3cc1a401ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:01.757497 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5ea47-c645-419f-b64e-9d3cc1a401ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:01.758236 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5ea47-c645-419f-b64e-9d3cc1a401ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:01.759875 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5ea47-c645-419f-b64e-9d3cc1a401ea admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:01.770304 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1151/2303] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:41:01 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:41:01.774209 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf65a4-69b1-4699-a14c-548a7bf92ef8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:01.783940 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf65a4-69b1-4699-a14c-548a7bf92ef8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:01.788466 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3eb85-ecce-45c7-9009-b50cb0dbb680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:01.790272 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3eb85-ecce-45c7-9009-b50cb0dbb680 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:01.790725 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3eb85-ecce-45c7-9009-b50cb0dbb680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:01.791255 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3eb85-ecce-45c7-9009-b50cb0dbb680 admin admin] PATH_INFO: `/v3/projects/4a8cd845e52e44e1a80f213797673c30/users/e0673fd85d594633b29e48b697f3803b/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:01.807214 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3eb85-ecce-45c7-9009-b50cb0dbb680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a8cd845e52e44e1a80f213797673c30, user_id=e0673fd85d594633b29e48b697f3803b, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:01.809889 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3eb85-ecce-45c7-9009-b50cb0dbb680 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:01.822800 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1153/2304] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:41:01 2021] PUT /identity/v3/projects/4a8cd845e52e44e1a80f213797673c30/users/e0673fd85d594633b29e48b697f3803b/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:01.832160 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5ea47-c645-419f-b64e-9d3cc1a401ea admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:01.842626 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5ea47-c645-419f-b64e-9d3cc1a401ea admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:01.900357 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226882b0-8797-4332-a16e-0b51f9ab269d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:01.900958 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226882b0-8797-4332-a16e-0b51f9ab269d admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:01.901234 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226882b0-8797-4332-a16e-0b51f9ab269d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:01.901503 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226882b0-8797-4332-a16e-0b51f9ab269d admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:01.902234 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226882b0-8797-4332-a16e-0b51f9ab269d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:01.903818 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226882b0-8797-4332-a16e-0b51f9ab269d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:01.913408 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1152/2305] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:41:01 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:41:01.918014 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3eb85-ecce-45c7-9009-b50cb0dbb680 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:01.928009 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3eb85-ecce-45c7-9009-b50cb0dbb680 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:01.934605 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e75d22-be9d-4322-bcc2-7ab3d5a3b8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:01.935965 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e75d22-be9d-4322-bcc2-7ab3d5a3b8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:01.936453 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e75d22-be9d-4322-bcc2-7ab3d5a3b8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:01.936896 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e75d22-be9d-4322-bcc2-7ab3d5a3b8b5 admin admin] PATH_INFO: `/v3/projects/4a8cd845e52e44e1a80f213797673c30/users/e0673fd85d594633b29e48b697f3803b/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:01.939121 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e75d22-be9d-4322-bcc2-7ab3d5a3b8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a8cd845e52e44e1a80f213797673c30, user_id=e0673fd85d594633b29e48b697f3803b, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:01.941874 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e75d22-be9d-4322-bcc2-7ab3d5a3b8b5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:01.954719 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1154/2306] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:41:01 2021] PUT /identity/v3/projects/4a8cd845e52e44e1a80f213797673c30/users/e0673fd85d594633b29e48b697f3803b/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:01.966540 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876eef4-36aa-4b2e-9d7e-596e476bacb4 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:01.966829 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876eef4-36aa-4b2e-9d7e-596e476bacb4 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:01.967107 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876eef4-36aa-4b2e-9d7e-596e476bacb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:01.992874 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-d876eef4-36aa-4b2e-9d7e-596e476bacb4 None None] MFA Rules not processed for user `e0673fd85d594633b29e48b697f3803b`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:01.994058 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d876eef4-36aa-4b2e-9d7e-596e476bacb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:02.072924 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1153/2307] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:01 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:41:02.073525 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e75d22-be9d-4322-bcc2-7ab3d5a3b8b5 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:02.148879 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e75d22-be9d-4322-bcc2-7ab3d5a3b8b5 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:02.158408 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05beb3f9-ff23-4425-bb43-bfb6631387c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:02.159344 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05beb3f9-ff23-4425-bb43-bfb6631387c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:02.159623 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05beb3f9-ff23-4425-bb43-bfb6631387c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:02.159940 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05beb3f9-ff23-4425-bb43-bfb6631387c4 admin admin] PATH_INFO: `/v3/users/c9319002c1a24b8ab2c7ee86e2533c23` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:02.161153 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05beb3f9-ff23-4425-bb43-bfb6631387c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9319002c1a24b8ab2c7ee86e2533c23)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:02.163101 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05beb3f9-ff23-4425-bb43-bfb6631387c4 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:02.211229 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-05beb3f9-ff23-4425-bb43-bfb6631387c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9319002c1a24b8ab2c7ee86e2533c23'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:02.224960 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-05beb3f9-ff23-4425-bb43-bfb6631387c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9319002c1a24b8ab2c7ee86e2533c23'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:02.244091 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-05beb3f9-ff23-4425-bb43-bfb6631387c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9319002c1a24b8ab2c7ee86e2533c23'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:02.244888 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-05beb3f9-ff23-4425-bb43-bfb6631387c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9319002c1a24b8ab2c7ee86e2533c23'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:02.252396 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-05beb3f9-ff23-4425-bb43-bfb6631387c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9319002c1a24b8ab2c7ee86e2533c23'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:02.258157 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1155/2308] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:41:02 2021] DELETE /identity/v3/users/c9319002c1a24b8ab2c7ee86e2533c23 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:02.262663 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4530f-080c-4770-9ebf-c992c02536f5 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:02.262945 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4530f-080c-4770-9ebf-c992c02536f5 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:02.263243 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4530f-080c-4770-9ebf-c992c02536f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:02.280735 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-0db4530f-080c-4770-9ebf-c992c02536f5 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:02.281913 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-0db4530f-080c-4770-9ebf-c992c02536f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:02.337046 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1154/2309] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:41:02.346913 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05beb3f9-ff23-4425-bb43-bfb6631387c4 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:02.348336 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-05beb3f9-ff23-4425-bb43-bfb6631387c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:02.406789 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05beb3f9-ff23-4425-bb43-bfb6631387c4 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:02.410625 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444e714-cabb-4a33-9717-048f8adc3238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:02.411267 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444e714-cabb-4a33-9717-048f8adc3238 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:02.411554 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444e714-cabb-4a33-9717-048f8adc3238 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:02.411855 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444e714-cabb-4a33-9717-048f8adc3238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:02.421119 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444e714-cabb-4a33-9717-048f8adc3238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:02.422841 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444e714-cabb-4a33-9717-048f8adc3238 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:02.432658 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1156/2310] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:41:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:41:02.708297 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4530f-080c-4770-9ebf-c992c02536f5 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:02.709702 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-0db4530f-080c-4770-9ebf-c992c02536f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:02.724092 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4530f-080c-4770-9ebf-c992c02536f5 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:02.730025 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394888aa-4c5d-4109-ab79-ac199c153f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:02.730872 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394888aa-4c5d-4109-ab79-ac199c153f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:02.731154 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394888aa-4c5d-4109-ab79-ac199c153f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:02.731430 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394888aa-4c5d-4109-ab79-ac199c153f5e admin admin] PATH_INFO: `/v3/projects/d6aa16fd65ca474aaacb76383a3157ce` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:02.732754 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394888aa-4c5d-4109-ab79-ac199c153f5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6aa16fd65ca474aaacb76383a3157ce)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:02.734634 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394888aa-4c5d-4109-ab79-ac199c153f5e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:02.779410 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-394888aa-4c5d-4109-ab79-ac199c153f5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6aa16fd65ca474aaacb76383a3157ce', 'request_id': 'req-394888aa-4c5d-4109-ab79-ac199c153f5e'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:02.785253 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-394888aa-4c5d-4109-ab79-ac199c153f5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6aa16fd65ca474aaacb76383a3157ce', 'request_id': 'req-394888aa-4c5d-4109-ab79-ac199c153f5e'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:02.790995 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-394888aa-4c5d-4109-ab79-ac199c153f5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6aa16fd65ca474aaacb76383a3157ce', 'request_id': 'req-394888aa-4c5d-4109-ab79-ac199c153f5e'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:02.805279 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-394888aa-4c5d-4109-ab79-ac199c153f5e admin admin] The token cache is being invalidate because project d6aa16fd65ca474aaacb76383a3157ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:41:02.805573 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-394888aa-4c5d-4109-ab79-ac199c153f5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:02.806188 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-394888aa-4c5d-4109-ab79-ac199c153f5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:02.807739 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1155/2311] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:41:02 2021] DELETE /identity/v3/projects/d6aa16fd65ca474aaacb76383a3157ce => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:41:02.811842 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444e714-cabb-4a33-9717-048f8adc3238 service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:02.822504 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444e714-cabb-4a33-9717-048f8adc3238 service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:02.875673 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f45e4d-8b1d-4ecf-b432-39eb4ddd6efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:02.876553 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f45e4d-8b1d-4ecf-b432-39eb4ddd6efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:02.876834 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f45e4d-8b1d-4ecf-b432-39eb4ddd6efc admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:02.877103 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f45e4d-8b1d-4ecf-b432-39eb4ddd6efc admin admin] PATH_INFO: `/v3/users/e0673fd85d594633b29e48b697f3803b` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:02.878310 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f45e4d-8b1d-4ecf-b432-39eb4ddd6efc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0673fd85d594633b29e48b697f3803b)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:02.880253 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f45e4d-8b1d-4ecf-b432-39eb4ddd6efc admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:02.924089 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-89f45e4d-8b1d-4ecf-b432-39eb4ddd6efc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0673fd85d594633b29e48b697f3803b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:02.936251 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-89f45e4d-8b1d-4ecf-b432-39eb4ddd6efc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0673fd85d594633b29e48b697f3803b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:02.944270 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-89f45e4d-8b1d-4ecf-b432-39eb4ddd6efc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0673fd85d594633b29e48b697f3803b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:02.945749 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-89f45e4d-8b1d-4ecf-b432-39eb4ddd6efc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0673fd85d594633b29e48b697f3803b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:02.953342 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-89f45e4d-8b1d-4ecf-b432-39eb4ddd6efc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0673fd85d594633b29e48b697f3803b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:02.959018 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1157/2312] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:41:02 2021] DELETE /identity/v3/users/e0673fd85d594633b29e48b697f3803b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:03.251382 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394888aa-4c5d-4109-ab79-ac199c153f5e admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:03.252986 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-394888aa-4c5d-4109-ab79-ac199c153f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:03.271899 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394888aa-4c5d-4109-ab79-ac199c153f5e admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:03.345092 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424551f-e498-475d-9614-4c6dfd79c560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:03.345938 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424551f-e498-475d-9614-4c6dfd79c560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:03.346215 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424551f-e498-475d-9614-4c6dfd79c560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:03.346485 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424551f-e498-475d-9614-4c6dfd79c560 admin admin] PATH_INFO: `/v3/projects/4a8cd845e52e44e1a80f213797673c30` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:03.347654 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424551f-e498-475d-9614-4c6dfd79c560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a8cd845e52e44e1a80f213797673c30)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:03.349767 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424551f-e498-475d-9614-4c6dfd79c560 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:03.392838 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-d424551f-e498-475d-9614-4c6dfd79c560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a8cd845e52e44e1a80f213797673c30', 'request_id': 'req-d424551f-e498-475d-9614-4c6dfd79c560'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:03.399271 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-d424551f-e498-475d-9614-4c6dfd79c560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a8cd845e52e44e1a80f213797673c30', 'request_id': 'req-d424551f-e498-475d-9614-4c6dfd79c560'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:03.404552 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-d424551f-e498-475d-9614-4c6dfd79c560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a8cd845e52e44e1a80f213797673c30', 'request_id': 'req-d424551f-e498-475d-9614-4c6dfd79c560'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:03.416335 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-d424551f-e498-475d-9614-4c6dfd79c560 admin admin] The token cache is being invalidate because project 4a8cd845e52e44e1a80f213797673c30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:41:03.416622 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-d424551f-e498-475d-9614-4c6dfd79c560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:03.417232 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-d424551f-e498-475d-9614-4c6dfd79c560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:03.418716 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1156/2313] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:41:03 2021] DELETE /identity/v3/projects/4a8cd845e52e44e1a80f213797673c30 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:03.424733 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa8c35-3857-46d1-af32-a7a0106bf41f None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:03.425293 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa8c35-3857-46d1-af32-a7a0106bf41f None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:03.425293 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa8c35-3857-46d1-af32-a7a0106bf41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:03.444946 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-cfaa8c35-3857-46d1-af32-a7a0106bf41f None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:03.446197 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-cfaa8c35-3857-46d1-af32-a7a0106bf41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:03.507140 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1158/2314] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:41:03.516289 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849ee6c-f1c0-4abc-94c6-263597cee2bd None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:03.516594 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849ee6c-f1c0-4abc-94c6-263597cee2bd None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:03.516873 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849ee6c-f1c0-4abc-94c6-263597cee2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:03.534791 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-e849ee6c-f1c0-4abc-94c6-263597cee2bd None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:03.536042 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e849ee6c-f1c0-4abc-94c6-263597cee2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:03.545492 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1157/2315] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:41:03.548626 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa8c35-3857-46d1-af32-a7a0106bf41f None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:03.558747 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa8c35-3857-46d1-af32-a7a0106bf41f None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:03.563327 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b414046-5661-41c5-806c-6b9c07e39f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:03.564145 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b414046-5661-41c5-806c-6b9c07e39f7e admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:03.564429 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b414046-5661-41c5-806c-6b9c07e39f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:03.564704 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b414046-5661-41c5-806c-6b9c07e39f7e admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:03.565449 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b414046-5661-41c5-806c-6b9c07e39f7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:41:03.565925 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b414046-5661-41c5-806c-6b9c07e39f7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:03.567961 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b414046-5661-41c5-806c-6b9c07e39f7e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:03.581744 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1159/2316] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:41:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:41:03.585984 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849ee6c-f1c0-4abc-94c6-263597cee2bd None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:03.595975 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849ee6c-f1c0-4abc-94c6-263597cee2bd None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:03.600677 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b91cb-3846-4bb0-b630-f66823b611b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:03.601360 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b91cb-3846-4bb0-b630-f66823b611b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:03.601642 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b91cb-3846-4bb0-b630-f66823b611b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:03.601918 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b91cb-3846-4bb0-b630-f66823b611b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:03.602888 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b91cb-3846-4bb0-b630-f66823b611b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:03.604853 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b91cb-3846-4bb0-b630-f66823b611b4 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:03.630560 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1158/2317] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:41:03 2021] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:41:03.634786 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b414046-5661-41c5-806c-6b9c07e39f7e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:03.644788 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b414046-5661-41c5-806c-6b9c07e39f7e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:03.703291 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96933b32-d345-49f9-b375-a06eb913d9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:03.703988 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96933b32-d345-49f9-b375-a06eb913d9ac admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:03.704270 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96933b32-d345-49f9-b375-a06eb913d9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:03.704543 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96933b32-d345-49f9-b375-a06eb913d9ac admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:03.705253 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96933b32-d345-49f9-b375-a06eb913d9ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:03.707211 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96933b32-d345-49f9-b375-a06eb913d9ac admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:03.732616 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1160/2318] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:41:03 2021] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:41:03.736680 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b91cb-3846-4bb0-b630-f66823b611b4 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:03.747249 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b91cb-3846-4bb0-b630-f66823b611b4 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:03.751898 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f611c20-c013-4c7c-ba2a-b3d73f818d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:03.752548 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f611c20-c013-4c7c-ba2a-b3d73f818d15 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:03.752832 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f611c20-c013-4c7c-ba2a-b3d73f818d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:03.753108 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f611c20-c013-4c7c-ba2a-b3d73f818d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:03.753834 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f611c20-c013-4c7c-ba2a-b3d73f818d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:03.755442 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f611c20-c013-4c7c-ba2a-b3d73f818d15 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:03.765723 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1159/2319] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:41:03 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:41:03.769233 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96933b32-d345-49f9-b375-a06eb913d9ac admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:03.779131 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96933b32-d345-49f9-b375-a06eb913d9ac admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:03.783652 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a45c8-9a56-4312-8e64-4aff652b8033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:03.784330 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a45c8-9a56-4312-8e64-4aff652b8033 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:03.784611 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a45c8-9a56-4312-8e64-4aff652b8033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:03.784880 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a45c8-9a56-4312-8e64-4aff652b8033 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:03.785602 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a45c8-9a56-4312-8e64-4aff652b8033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:03.787204 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a45c8-9a56-4312-8e64-4aff652b8033 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:03.797670 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1161/2320] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:41:03 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:41:03.801603 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f611c20-c013-4c7c-ba2a-b3d73f818d15 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:03.811733 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f611c20-c013-4c7c-ba2a-b3d73f818d15 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:03.816472 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b7aa0-c4a2-4dbf-8a04-e2fbd8464ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:03.817420 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b7aa0-c4a2-4dbf-8a04-e2fbd8464ad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:03.817827 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b7aa0-c4a2-4dbf-8a04-e2fbd8464ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:03.818169 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b7aa0-c4a2-4dbf-8a04-e2fbd8464ad8 admin admin] PATH_INFO: `/v3/projects/5f0cfe0b693f4c5abb3f4406f40afc8e/users/b436c98246e840d190b5a8a43b70d832/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:03.832797 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b7aa0-c4a2-4dbf-8a04-e2fbd8464ad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0cfe0b693f4c5abb3f4406f40afc8e, user_id=b436c98246e840d190b5a8a43b70d832, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:03.836493 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b7aa0-c4a2-4dbf-8a04-e2fbd8464ad8 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:03.850446 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1160/2321] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:41:03 2021] PUT /identity/v3/projects/5f0cfe0b693f4c5abb3f4406f40afc8e/users/b436c98246e840d190b5a8a43b70d832/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:03.860965 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b54e19-a178-4827-9235-7ceeceb6da8e None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:03.861461 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b54e19-a178-4827-9235-7ceeceb6da8e None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:03.861560 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b54e19-a178-4827-9235-7ceeceb6da8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:03.888003 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-78b54e19-a178-4827-9235-7ceeceb6da8e None None] MFA Rules not processed for user `b436c98246e840d190b5a8a43b70d832`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:03.889193 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-78b54e19-a178-4827-9235-7ceeceb6da8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:03.952219 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1162/2322] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:03 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:41:03.956661 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b7aa0-c4a2-4dbf-8a04-e2fbd8464ad8 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:04.017337 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b7aa0-c4a2-4dbf-8a04-e2fbd8464ad8 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:04.022000 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4778b-837b-4dfe-b68f-ec75b7e6fedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:04.022646 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4778b-837b-4dfe-b68f-ec75b7e6fedc admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:04.022932 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4778b-837b-4dfe-b68f-ec75b7e6fedc admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:04.023216 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4778b-837b-4dfe-b68f-ec75b7e6fedc admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:04.023979 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4778b-837b-4dfe-b68f-ec75b7e6fedc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:04.025874 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4778b-837b-4dfe-b68f-ec75b7e6fedc admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:04.051527 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1161/2323] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:41:03 2021] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:41:04.056089 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b54e19-a178-4827-9235-7ceeceb6da8e None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:04.066714 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b54e19-a178-4827-9235-7ceeceb6da8e None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:04.123774 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445ac16-cfe2-4455-b641-1e4eb09a28b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:04.124457 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445ac16-cfe2-4455-b641-1e4eb09a28b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:04.124740 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445ac16-cfe2-4455-b641-1e4eb09a28b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:04.125017 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445ac16-cfe2-4455-b641-1e4eb09a28b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:04.125798 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445ac16-cfe2-4455-b641-1e4eb09a28b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:04.127801 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445ac16-cfe2-4455-b641-1e4eb09a28b7 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:04.150869 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1163/2324] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:41:04 2021] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:41:04.152074 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4778b-837b-4dfe-b68f-ec75b7e6fedc admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:04.162907 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4778b-837b-4dfe-b68f-ec75b7e6fedc admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:04.168321 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7146e-e7b6-4370-ac75-7ed695182b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:04.169126 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7146e-e7b6-4370-ac75-7ed695182b36 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:04.169477 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7146e-e7b6-4370-ac75-7ed695182b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:04.169838 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7146e-e7b6-4370-ac75-7ed695182b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:04.170717 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7146e-e7b6-4370-ac75-7ed695182b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:04.172625 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7146e-e7b6-4370-ac75-7ed695182b36 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:04.185247 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1162/2325] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:41:04 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:41:04.198506 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445ac16-cfe2-4455-b641-1e4eb09a28b7 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:04.208986 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445ac16-cfe2-4455-b641-1e4eb09a28b7 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:04.214676 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a46065-2e5e-4da3-8036-7079a49f1c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:04.215589 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a46065-2e5e-4da3-8036-7079a49f1c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:04.217057 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a46065-2e5e-4da3-8036-7079a49f1c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:04.217057 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a46065-2e5e-4da3-8036-7079a49f1c63 admin admin] PATH_INFO: `/v3/projects/42ddce87fba14d84af4aa6c98da59014/users/4e4d006584874da094f0c72e7493c40b/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:04.248508 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a46065-2e5e-4da3-8036-7079a49f1c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42ddce87fba14d84af4aa6c98da59014, user_id=4e4d006584874da094f0c72e7493c40b, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:04.253482 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a46065-2e5e-4da3-8036-7079a49f1c63 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:04.268736 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1164/2326] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:41:04 2021] PUT /identity/v3/projects/42ddce87fba14d84af4aa6c98da59014/users/4e4d006584874da094f0c72e7493c40b/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:04.272558 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7146e-e7b6-4370-ac75-7ed695182b36 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:04.282720 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7146e-e7b6-4370-ac75-7ed695182b36 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:04.349261 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c0979-c26a-4ae3-b900-488dc09cd734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:04.349960 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c0979-c26a-4ae3-b900-488dc09cd734 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:04.350427 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c0979-c26a-4ae3-b900-488dc09cd734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:04.350721 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c0979-c26a-4ae3-b900-488dc09cd734 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:04.352055 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c0979-c26a-4ae3-b900-488dc09cd734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:04.353666 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c0979-c26a-4ae3-b900-488dc09cd734 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:04.363729 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1163/2327] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:41:04 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:41:04.368446 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a46065-2e5e-4da3-8036-7079a49f1c63 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:04.379113 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a46065-2e5e-4da3-8036-7079a49f1c63 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:04.384538 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f4752-366c-4917-b8d7-18769e9b7186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:04.385416 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f4752-366c-4917-b8d7-18769e9b7186 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:04.385702 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f4752-366c-4917-b8d7-18769e9b7186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:04.385978 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f4752-366c-4917-b8d7-18769e9b7186 admin admin] PATH_INFO: `/v3/projects/42ddce87fba14d84af4aa6c98da59014/users/4e4d006584874da094f0c72e7493c40b/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:04.388538 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f4752-366c-4917-b8d7-18769e9b7186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42ddce87fba14d84af4aa6c98da59014, user_id=4e4d006584874da094f0c72e7493c40b, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:04.390958 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f4752-366c-4917-b8d7-18769e9b7186 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:04.402343 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1165/2328] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:41:04 2021] PUT /identity/v3/projects/42ddce87fba14d84af4aa6c98da59014/users/4e4d006584874da094f0c72e7493c40b/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:41:04.414341 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ffe4b-55aa-4dc0-8715-07d494567016 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:04.414724 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ffe4b-55aa-4dc0-8715-07d494567016 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:04.414898 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ffe4b-55aa-4dc0-8715-07d494567016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:04.448815 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-8f2ffe4b-55aa-4dc0-8715-07d494567016 None None] MFA Rules not processed for user `4e4d006584874da094f0c72e7493c40b`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:04.450715 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-8f2ffe4b-55aa-4dc0-8715-07d494567016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:04.524389 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1164/2329] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:04 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:41:04.534953 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f4752-366c-4917-b8d7-18769e9b7186 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:04.536700 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-aa4f4752-366c-4917-b8d7-18769e9b7186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:04.596087 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f4752-366c-4917-b8d7-18769e9b7186 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:04.599993 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e3b89-209b-41d8-a6a1-0cf2177ccef6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:04.600910 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e3b89-209b-41d8-a6a1-0cf2177ccef6 service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:04.601901 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e3b89-209b-41d8-a6a1-0cf2177ccef6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:04.602370 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e3b89-209b-41d8-a6a1-0cf2177ccef6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:04.611692 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e3b89-209b-41d8-a6a1-0cf2177ccef6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:04.613143 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e3b89-209b-41d8-a6a1-0cf2177ccef6 service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:04.622456 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1166/2330] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:41:04 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:41:04.689631 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ffe4b-55aa-4dc0-8715-07d494567016 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:04.759620 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ffe4b-55aa-4dc0-8715-07d494567016 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:04.764402 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb37d0-6d9a-4c77-bbd4-5754dc4a0eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:04.765543 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb37d0-6d9a-4c77-bbd4-5754dc4a0eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:04.765821 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb37d0-6d9a-4c77-bbd4-5754dc4a0eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:04.766099 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb37d0-6d9a-4c77-bbd4-5754dc4a0eb5 admin admin] PATH_INFO: `/v3/users/b436c98246e840d190b5a8a43b70d832` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:04.767395 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb37d0-6d9a-4c77-bbd4-5754dc4a0eb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b436c98246e840d190b5a8a43b70d832)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:04.769579 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb37d0-6d9a-4c77-bbd4-5754dc4a0eb5 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:04.819061 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7fbb37d0-6d9a-4c77-bbd4-5754dc4a0eb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b436c98246e840d190b5a8a43b70d832'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:04.832889 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7fbb37d0-6d9a-4c77-bbd4-5754dc4a0eb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b436c98246e840d190b5a8a43b70d832'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:04.841401 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7fbb37d0-6d9a-4c77-bbd4-5754dc4a0eb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b436c98246e840d190b5a8a43b70d832'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:04.842047 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7fbb37d0-6d9a-4c77-bbd4-5754dc4a0eb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b436c98246e840d190b5a8a43b70d832'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:04.849075 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7fbb37d0-6d9a-4c77-bbd4-5754dc4a0eb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b436c98246e840d190b5a8a43b70d832'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:04.855500 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1165/2331] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:41:04 2021] DELETE /identity/v3/users/b436c98246e840d190b5a8a43b70d832 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:04.860201 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49a720-669a-4ffa-b318-0648b0fcc8f3 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:04.860489 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49a720-669a-4ffa-b318-0648b0fcc8f3 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:04.860974 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49a720-669a-4ffa-b318-0648b0fcc8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:04.880017 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-6d49a720-669a-4ffa-b318-0648b0fcc8f3 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:04.881323 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-6d49a720-669a-4ffa-b318-0648b0fcc8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:04.938908 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1167/2332] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:41:04.949162 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb37d0-6d9a-4c77-bbd4-5754dc4a0eb5 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:04.950557 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7fbb37d0-6d9a-4c77-bbd4-5754dc4a0eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:05.008787 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb37d0-6d9a-4c77-bbd4-5754dc4a0eb5 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:05.012480 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf1ce1-e034-4fbf-a2c2-522511bcf2eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:05.013115 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf1ce1-e034-4fbf-a2c2-522511bcf2eb service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:05.013401 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf1ce1-e034-4fbf-a2c2-522511bcf2eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:05.013678 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf1ce1-e034-4fbf-a2c2-522511bcf2eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:05.022459 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf1ce1-e034-4fbf-a2c2-522511bcf2eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:05.024448 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf1ce1-e034-4fbf-a2c2-522511bcf2eb service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:05.033677 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1166/2333] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:41:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:41:05.290209 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49a720-669a-4ffa-b318-0648b0fcc8f3 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:05.291993 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-6d49a720-669a-4ffa-b318-0648b0fcc8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:05.309634 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49a720-669a-4ffa-b318-0648b0fcc8f3 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:05.326606 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b2a3a-bd43-4bf4-bf03-8fe12b9801a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:05.328054 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b2a3a-bd43-4bf4-bf03-8fe12b9801a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:05.328499 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b2a3a-bd43-4bf4-bf03-8fe12b9801a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:05.328927 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b2a3a-bd43-4bf4-bf03-8fe12b9801a6 admin admin] PATH_INFO: `/v3/projects/5f0cfe0b693f4c5abb3f4406f40afc8e` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:05.330868 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b2a3a-bd43-4bf4-bf03-8fe12b9801a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f0cfe0b693f4c5abb3f4406f40afc8e)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:05.332830 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b2a3a-bd43-4bf4-bf03-8fe12b9801a6 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:05.379910 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d41b2a3a-bd43-4bf4-bf03-8fe12b9801a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f0cfe0b693f4c5abb3f4406f40afc8e', 'request_id': 'req-d41b2a3a-bd43-4bf4-bf03-8fe12b9801a6'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:05.385802 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d41b2a3a-bd43-4bf4-bf03-8fe12b9801a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f0cfe0b693f4c5abb3f4406f40afc8e', 'request_id': 'req-d41b2a3a-bd43-4bf4-bf03-8fe12b9801a6'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:05.391116 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d41b2a3a-bd43-4bf4-bf03-8fe12b9801a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f0cfe0b693f4c5abb3f4406f40afc8e', 'request_id': 'req-d41b2a3a-bd43-4bf4-bf03-8fe12b9801a6'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:05.403103 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d41b2a3a-bd43-4bf4-bf03-8fe12b9801a6 admin admin] The token cache is being invalidate because project 5f0cfe0b693f4c5abb3f4406f40afc8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:41:05.403392 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d41b2a3a-bd43-4bf4-bf03-8fe12b9801a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:05.404096 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d41b2a3a-bd43-4bf4-bf03-8fe12b9801a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:05.405716 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1168/2334] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:41:05 2021] DELETE /identity/v3/projects/5f0cfe0b693f4c5abb3f4406f40afc8e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:05.409634 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf1ce1-e034-4fbf-a2c2-522511bcf2eb service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:05.419537 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf1ce1-e034-4fbf-a2c2-522511bcf2eb service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:05.471666 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2d246-c1a3-4c50-9656-7101b9d357bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:05.472563 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2d246-c1a3-4c50-9656-7101b9d357bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:05.472846 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2d246-c1a3-4c50-9656-7101b9d357bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:05.473122 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2d246-c1a3-4c50-9656-7101b9d357bc admin admin] PATH_INFO: `/v3/users/4e4d006584874da094f0c72e7493c40b` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:05.474304 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2d246-c1a3-4c50-9656-7101b9d357bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e4d006584874da094f0c72e7493c40b)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:05.476837 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2d246-c1a3-4c50-9656-7101b9d357bc admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:05.528318 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-dfd2d246-c1a3-4c50-9656-7101b9d357bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e4d006584874da094f0c72e7493c40b'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:05.541204 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-dfd2d246-c1a3-4c50-9656-7101b9d357bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e4d006584874da094f0c72e7493c40b'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:05.549241 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-dfd2d246-c1a3-4c50-9656-7101b9d357bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e4d006584874da094f0c72e7493c40b'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:05.550009 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-dfd2d246-c1a3-4c50-9656-7101b9d357bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e4d006584874da094f0c72e7493c40b'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:05.557409 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-dfd2d246-c1a3-4c50-9656-7101b9d357bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e4d006584874da094f0c72e7493c40b'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:05.563283 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1167/2335] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:41:05 2021] DELETE /identity/v3/users/4e4d006584874da094f0c72e7493c40b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:05.820758 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b2a3a-bd43-4bf4-bf03-8fe12b9801a6 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:05.822255 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-d41b2a3a-bd43-4bf4-bf03-8fe12b9801a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:05.835175 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b2a3a-bd43-4bf4-bf03-8fe12b9801a6 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:05.889413 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ba4e6-9571-4aa6-91ba-3c268ac0f3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:05.890255 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ba4e6-9571-4aa6-91ba-3c268ac0f3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:05.890531 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ba4e6-9571-4aa6-91ba-3c268ac0f3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:05.890799 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ba4e6-9571-4aa6-91ba-3c268ac0f3c7 admin admin] PATH_INFO: `/v3/projects/42ddce87fba14d84af4aa6c98da59014` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:05.892001 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ba4e6-9571-4aa6-91ba-3c268ac0f3c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42ddce87fba14d84af4aa6c98da59014)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:05.893889 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ba4e6-9571-4aa6-91ba-3c268ac0f3c7 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:05.939515 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d09ba4e6-9571-4aa6-91ba-3c268ac0f3c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42ddce87fba14d84af4aa6c98da59014', 'request_id': 'req-d09ba4e6-9571-4aa6-91ba-3c268ac0f3c7'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:05.946205 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d09ba4e6-9571-4aa6-91ba-3c268ac0f3c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42ddce87fba14d84af4aa6c98da59014', 'request_id': 'req-d09ba4e6-9571-4aa6-91ba-3c268ac0f3c7'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:05.951629 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d09ba4e6-9571-4aa6-91ba-3c268ac0f3c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42ddce87fba14d84af4aa6c98da59014', 'request_id': 'req-d09ba4e6-9571-4aa6-91ba-3c268ac0f3c7'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:05.966886 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d09ba4e6-9571-4aa6-91ba-3c268ac0f3c7 admin admin] The token cache is being invalidate because project 42ddce87fba14d84af4aa6c98da59014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:41:05.967467 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d09ba4e6-9571-4aa6-91ba-3c268ac0f3c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:05.968555 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d09ba4e6-9571-4aa6-91ba-3c268ac0f3c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:05.970066 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1169/2336] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:41:05 2021] DELETE /identity/v3/projects/42ddce87fba14d84af4aa6c98da59014 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:05.975391 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959596d-4671-469f-bd9f-f302a49f194d None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:05.975706 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959596d-4671-469f-bd9f-f302a49f194d None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:05.976047 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959596d-4671-469f-bd9f-f302a49f194d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:05.994771 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-b959596d-4671-469f-bd9f-f302a49f194d None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:05.996037 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-b959596d-4671-469f-bd9f-f302a49f194d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:06.058484 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1168/2337] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:41:06.066488 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459232f-9d53-4f87-80ca-882ef39341bc None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:06.066817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459232f-9d53-4f87-80ca-882ef39341bc None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:06.067104 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459232f-9d53-4f87-80ca-882ef39341bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:06.090379 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-c459232f-9d53-4f87-80ca-882ef39341bc None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:06.091595 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-c459232f-9d53-4f87-80ca-882ef39341bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:06.099499 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1170/2338] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:41:06.103788 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959596d-4671-469f-bd9f-f302a49f194d None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:06.113332 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959596d-4671-469f-bd9f-f302a49f194d None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:06.118395 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e963f-780e-46c8-a398-2c7332c34038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:06.119035 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e963f-780e-46c8-a398-2c7332c34038 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:06.119316 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e963f-780e-46c8-a398-2c7332c34038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:06.119590 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e963f-780e-46c8-a398-2c7332c34038 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:06.120379 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e963f-780e-46c8-a398-2c7332c34038 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:41:06.120682 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e963f-780e-46c8-a398-2c7332c34038 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:06.122309 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e963f-780e-46c8-a398-2c7332c34038 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:06.134244 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1169/2339] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:41:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:41:06.140511 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459232f-9d53-4f87-80ca-882ef39341bc None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:06.152291 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459232f-9d53-4f87-80ca-882ef39341bc None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:06.157005 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f524deb-8245-43fa-821a-5b419ec3da7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:06.157664 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f524deb-8245-43fa-821a-5b419ec3da7c admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:06.157949 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f524deb-8245-43fa-821a-5b419ec3da7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:06.158223 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f524deb-8245-43fa-821a-5b419ec3da7c admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:06.158950 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f524deb-8245-43fa-821a-5b419ec3da7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:06.160896 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f524deb-8245-43fa-821a-5b419ec3da7c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:06.185902 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1171/2340] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:41:06 2021] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:41:06.189889 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e963f-780e-46c8-a398-2c7332c34038 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:06.200741 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e963f-780e-46c8-a398-2c7332c34038 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:06.261459 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcee51-7d5b-455f-9267-6f6bcb83dcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:06.262351 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcee51-7d5b-455f-9267-6f6bcb83dcd1 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:06.262635 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcee51-7d5b-455f-9267-6f6bcb83dcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:06.262967 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcee51-7d5b-455f-9267-6f6bcb83dcd1 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:06.264483 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fcee51-7d5b-455f-9267-6f6bcb83dcd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:06.266621 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fcee51-7d5b-455f-9267-6f6bcb83dcd1 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:06.287583 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1170/2341] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:41:06 2021] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:41:06.292337 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f524deb-8245-43fa-821a-5b419ec3da7c admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:06.310361 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f524deb-8245-43fa-821a-5b419ec3da7c admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:06.318905 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdb666-f57a-42da-8c9a-7fafec41254a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:06.320833 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdb666-f57a-42da-8c9a-7fafec41254a admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:06.321408 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdb666-f57a-42da-8c9a-7fafec41254a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:06.321692 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdb666-f57a-42da-8c9a-7fafec41254a admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:06.323176 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cdb666-f57a-42da-8c9a-7fafec41254a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:06.324609 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cdb666-f57a-42da-8c9a-7fafec41254a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:06.339406 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1172/2342] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:41:06 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:41:06.340505 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcee51-7d5b-455f-9267-6f6bcb83dcd1 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:06.350382 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcee51-7d5b-455f-9267-6f6bcb83dcd1 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:06.355126 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec76ab-f706-4d91-b314-ff8839c1558b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:06.355804 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec76ab-f706-4d91-b314-ff8839c1558b admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:06.356091 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec76ab-f706-4d91-b314-ff8839c1558b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:06.356366 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec76ab-f706-4d91-b314-ff8839c1558b admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:06.357097 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec76ab-f706-4d91-b314-ff8839c1558b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:06.358688 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec76ab-f706-4d91-b314-ff8839c1558b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:06.369262 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1171/2343] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:41:06 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:41:06.373328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdb666-f57a-42da-8c9a-7fafec41254a admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:06.384210 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdb666-f57a-42da-8c9a-7fafec41254a admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:06.389028 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20393f2-616e-4349-873c-a2a5d7c755b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:06.394879 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20393f2-616e-4349-873c-a2a5d7c755b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:06.394879 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20393f2-616e-4349-873c-a2a5d7c755b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:06.394879 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20393f2-616e-4349-873c-a2a5d7c755b2 admin admin] PATH_INFO: `/v3/projects/61761008c6e245f88d74d98ad2351066/users/186d540c83a048a2bb1fa0c6bb1cbeac/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:06.409695 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20393f2-616e-4349-873c-a2a5d7c755b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61761008c6e245f88d74d98ad2351066, user_id=186d540c83a048a2bb1fa0c6bb1cbeac, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:06.412373 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20393f2-616e-4349-873c-a2a5d7c755b2 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:06.428551 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1173/2344] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:41:06 2021] PUT /identity/v3/projects/61761008c6e245f88d74d98ad2351066/users/186d540c83a048a2bb1fa0c6bb1cbeac/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:06.439029 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba535af-b77e-4deb-99e2-3566ed6619c6 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:06.439497 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba535af-b77e-4deb-99e2-3566ed6619c6 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:06.439611 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba535af-b77e-4deb-99e2-3566ed6619c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:06.466920 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-cba535af-b77e-4deb-99e2-3566ed6619c6 None None] MFA Rules not processed for user `186d540c83a048a2bb1fa0c6bb1cbeac`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:06.468161 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-cba535af-b77e-4deb-99e2-3566ed6619c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:06.531018 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1172/2345] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:06 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:41:06.535639 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20393f2-616e-4349-873c-a2a5d7c755b2 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:06.594491 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20393f2-616e-4349-873c-a2a5d7c755b2 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:06.599033 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11169723-1073-43ad-8486-6504703114a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:06.599669 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11169723-1073-43ad-8486-6504703114a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:06.599977 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11169723-1073-43ad-8486-6504703114a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:06.600251 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11169723-1073-43ad-8486-6504703114a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:06.600960 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11169723-1073-43ad-8486-6504703114a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:06.603330 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11169723-1073-43ad-8486-6504703114a5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:06.628549 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1174/2346] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:41:06 2021] POST /identity/v3/projects => generated 389 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:41:06.633212 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba535af-b77e-4deb-99e2-3566ed6619c6 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:06.643490 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba535af-b77e-4deb-99e2-3566ed6619c6 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:06.697826 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f050cb-6ddc-4a84-bdfc-677282ccd7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:06.698302 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f050cb-6ddc-4a84-bdfc-677282ccd7ad admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:06.698589 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f050cb-6ddc-4a84-bdfc-677282ccd7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:06.698941 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f050cb-6ddc-4a84-bdfc-677282ccd7ad admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:06.699632 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f050cb-6ddc-4a84-bdfc-677282ccd7ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:06.702263 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f050cb-6ddc-4a84-bdfc-677282ccd7ad admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:06.736910 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1173/2347] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:41:06 2021] POST /identity/v3/users => generated 301 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:41:06.738411 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11169723-1073-43ad-8486-6504703114a5 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:06.748815 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11169723-1073-43ad-8486-6504703114a5 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:06.753484 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67f43e-be6b-4b68-88af-1bbaef80dd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:06.754137 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67f43e-be6b-4b68-88af-1bbaef80dd8d admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:06.754423 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67f43e-be6b-4b68-88af-1bbaef80dd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:06.754712 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67f43e-be6b-4b68-88af-1bbaef80dd8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:06.755464 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67f43e-be6b-4b68-88af-1bbaef80dd8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:06.757726 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67f43e-be6b-4b68-88af-1bbaef80dd8d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:06.768369 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1175/2348] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:41:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:41:06.772570 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f050cb-6ddc-4a84-bdfc-677282ccd7ad admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:06.783245 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f050cb-6ddc-4a84-bdfc-677282ccd7ad admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:06.787931 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15572ef0-ffc7-40c8-b422-6b4f4960f349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:06.788839 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15572ef0-ffc7-40c8-b422-6b4f4960f349 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:06.789118 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15572ef0-ffc7-40c8-b422-6b4f4960f349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:06.789389 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15572ef0-ffc7-40c8-b422-6b4f4960f349 admin admin] PATH_INFO: `/v3/projects/a4c86a88d1924ec3bd7369073dc44660/users/5c830d9b12bf405aa1e5d873dd4b8674/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:06.805882 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15572ef0-ffc7-40c8-b422-6b4f4960f349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4c86a88d1924ec3bd7369073dc44660, user_id=5c830d9b12bf405aa1e5d873dd4b8674, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:06.808702 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15572ef0-ffc7-40c8-b422-6b4f4960f349 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:06.822059 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1174/2349] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:41:06 2021] PUT /identity/v3/projects/a4c86a88d1924ec3bd7369073dc44660/users/5c830d9b12bf405aa1e5d873dd4b8674/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:06.826108 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67f43e-be6b-4b68-88af-1bbaef80dd8d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:06.836475 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67f43e-be6b-4b68-88af-1bbaef80dd8d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:06.890788 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d39aab-7384-41bc-a007-58b874ef5d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:06.891461 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d39aab-7384-41bc-a007-58b874ef5d06 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:06.891778 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d39aab-7384-41bc-a007-58b874ef5d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:06.892051 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d39aab-7384-41bc-a007-58b874ef5d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:06.892786 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d39aab-7384-41bc-a007-58b874ef5d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:06.894388 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d39aab-7384-41bc-a007-58b874ef5d06 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:06.907834 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1176/2350] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:41:06 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:41:06.909213 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15572ef0-ffc7-40c8-b422-6b4f4960f349 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:06.919395 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15572ef0-ffc7-40c8-b422-6b4f4960f349 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:06.924089 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370957c7-9db1-4b87-a429-e32448c5618e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:06.924969 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370957c7-9db1-4b87-a429-e32448c5618e admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:06.931407 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370957c7-9db1-4b87-a429-e32448c5618e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:06.931722 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370957c7-9db1-4b87-a429-e32448c5618e admin admin] PATH_INFO: `/v3/projects/a4c86a88d1924ec3bd7369073dc44660/users/5c830d9b12bf405aa1e5d873dd4b8674/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:06.933828 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370957c7-9db1-4b87-a429-e32448c5618e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4c86a88d1924ec3bd7369073dc44660, user_id=5c830d9b12bf405aa1e5d873dd4b8674, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:06.936563 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370957c7-9db1-4b87-a429-e32448c5618e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:06.947304 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1175/2351] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:41:06 2021] PUT /identity/v3/projects/a4c86a88d1924ec3bd7369073dc44660/users/5c830d9b12bf405aa1e5d873dd4b8674/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:06.958471 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef41dcb-b138-48f3-9ce1-f399c2d44a29 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:06.958775 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef41dcb-b138-48f3-9ce1-f399c2d44a29 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:06.959124 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef41dcb-b138-48f3-9ce1-f399c2d44a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:06.989302 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-4ef41dcb-b138-48f3-9ce1-f399c2d44a29 None None] MFA Rules not processed for user `5c830d9b12bf405aa1e5d873dd4b8674`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:06.990533 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-4ef41dcb-b138-48f3-9ce1-f399c2d44a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:07.064334 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1177/2352] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:06 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:41:07.074145 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370957c7-9db1-4b87-a429-e32448c5618e admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:07.075895 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-370957c7-9db1-4b87-a429-e32448c5618e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:07.149527 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370957c7-9db1-4b87-a429-e32448c5618e admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:07.153442 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3baf0b-ef6a-4d3f-aff2-4f59081b909a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:07.154150 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3baf0b-ef6a-4d3f-aff2-4f59081b909a service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:07.154431 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3baf0b-ef6a-4d3f-aff2-4f59081b909a service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:07.154733 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3baf0b-ef6a-4d3f-aff2-4f59081b909a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:07.165154 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3baf0b-ef6a-4d3f-aff2-4f59081b909a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:07.166751 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3baf0b-ef6a-4d3f-aff2-4f59081b909a service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:07.190926 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1176/2353] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:41:07 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:41:07.389574 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef41dcb-b138-48f3-9ce1-f399c2d44a29 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:07.536709 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef41dcb-b138-48f3-9ce1-f399c2d44a29 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:07.541261 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7979e9-e550-4c95-8990-0b59dba9935c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:07.542112 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7979e9-e550-4c95-8990-0b59dba9935c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:07.542391 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7979e9-e550-4c95-8990-0b59dba9935c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:07.542665 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7979e9-e550-4c95-8990-0b59dba9935c admin admin] PATH_INFO: `/v3/users/186d540c83a048a2bb1fa0c6bb1cbeac` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:07.543896 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7979e9-e550-4c95-8990-0b59dba9935c admin admin] RBAC: Authorizing `identity:delete_user(user_id=186d540c83a048a2bb1fa0c6bb1cbeac)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:07.545802 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7979e9-e550-4c95-8990-0b59dba9935c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:07.600350 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8d7979e9-e550-4c95-8990-0b59dba9935c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '186d540c83a048a2bb1fa0c6bb1cbeac'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:07.611866 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8d7979e9-e550-4c95-8990-0b59dba9935c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '186d540c83a048a2bb1fa0c6bb1cbeac'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:07.619355 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8d7979e9-e550-4c95-8990-0b59dba9935c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '186d540c83a048a2bb1fa0c6bb1cbeac'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:07.620009 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8d7979e9-e550-4c95-8990-0b59dba9935c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '186d540c83a048a2bb1fa0c6bb1cbeac'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:07.626782 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8d7979e9-e550-4c95-8990-0b59dba9935c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '186d540c83a048a2bb1fa0c6bb1cbeac'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:07.633506 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1178/2354] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:41:07 2021] DELETE /identity/v3/users/186d540c83a048a2bb1fa0c6bb1cbeac => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:07.638294 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186614f-cb7f-4c60-a888-818a94e41bf0 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:07.638755 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186614f-cb7f-4c60-a888-818a94e41bf0 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:07.638849 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186614f-cb7f-4c60-a888-818a94e41bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:07.675301 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-e186614f-cb7f-4c60-a888-818a94e41bf0 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:07.676527 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e186614f-cb7f-4c60-a888-818a94e41bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:07.732602 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1177/2355] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:41:07.742851 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7979e9-e550-4c95-8990-0b59dba9935c admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:07.744532 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-8d7979e9-e550-4c95-8990-0b59dba9935c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:07.837686 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7979e9-e550-4c95-8990-0b59dba9935c admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:07.841846 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bde6a4-1491-4e03-8b1a-3bcbddbf49a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:07.842493 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bde6a4-1491-4e03-8b1a-3bcbddbf49a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:07.842777 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bde6a4-1491-4e03-8b1a-3bcbddbf49a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:07.843051 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bde6a4-1491-4e03-8b1a-3bcbddbf49a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:07.851974 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bde6a4-1491-4e03-8b1a-3bcbddbf49a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:07.853409 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bde6a4-1491-4e03-8b1a-3bcbddbf49a6 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:07.862892 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1179/2356] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:41:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:41:08.133380 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186614f-cb7f-4c60-a888-818a94e41bf0 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:08.134804 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e186614f-cb7f-4c60-a888-818a94e41bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:08.146453 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186614f-cb7f-4c60-a888-818a94e41bf0 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:08.151287 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5cc62d-e192-4e61-9d6e-f1ac76ff9d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:08.152189 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cc62d-e192-4e61-9d6e-f1ac76ff9d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:08.152469 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cc62d-e192-4e61-9d6e-f1ac76ff9d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:08.152739 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cc62d-e192-4e61-9d6e-f1ac76ff9d7e admin admin] PATH_INFO: `/v3/projects/61761008c6e245f88d74d98ad2351066` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:08.153958 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5cc62d-e192-4e61-9d6e-f1ac76ff9d7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=61761008c6e245f88d74d98ad2351066)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:08.155915 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5cc62d-e192-4e61-9d6e-f1ac76ff9d7e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:08.206300 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-6d5cc62d-e192-4e61-9d6e-f1ac76ff9d7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61761008c6e245f88d74d98ad2351066', 'request_id': 'req-6d5cc62d-e192-4e61-9d6e-f1ac76ff9d7e'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:08.212904 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-6d5cc62d-e192-4e61-9d6e-f1ac76ff9d7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61761008c6e245f88d74d98ad2351066', 'request_id': 'req-6d5cc62d-e192-4e61-9d6e-f1ac76ff9d7e'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:08.219059 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-6d5cc62d-e192-4e61-9d6e-f1ac76ff9d7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61761008c6e245f88d74d98ad2351066', 'request_id': 'req-6d5cc62d-e192-4e61-9d6e-f1ac76ff9d7e'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:08.233375 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-6d5cc62d-e192-4e61-9d6e-f1ac76ff9d7e admin admin] The token cache is being invalidate because project 61761008c6e245f88d74d98ad2351066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:41:08.233658 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-6d5cc62d-e192-4e61-9d6e-f1ac76ff9d7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:08.234327 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-6d5cc62d-e192-4e61-9d6e-f1ac76ff9d7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:08.238767 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1178/2357] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:41:08 2021] DELETE /identity/v3/projects/61761008c6e245f88d74d98ad2351066 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:08.240594 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bde6a4-1491-4e03-8b1a-3bcbddbf49a6 service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:08.252915 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bde6a4-1491-4e03-8b1a-3bcbddbf49a6 service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:08.311537 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab61964-85a6-4ef3-bb15-2e3e41086c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:08.312433 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab61964-85a6-4ef3-bb15-2e3e41086c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:08.312715 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab61964-85a6-4ef3-bb15-2e3e41086c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:08.312988 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab61964-85a6-4ef3-bb15-2e3e41086c58 admin admin] PATH_INFO: `/v3/users/5c830d9b12bf405aa1e5d873dd4b8674` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:08.314208 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab61964-85a6-4ef3-bb15-2e3e41086c58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c830d9b12bf405aa1e5d873dd4b8674)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:08.316187 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab61964-85a6-4ef3-bb15-2e3e41086c58 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:08.366203 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-1ab61964-85a6-4ef3-bb15-2e3e41086c58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c830d9b12bf405aa1e5d873dd4b8674'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:08.383063 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-1ab61964-85a6-4ef3-bb15-2e3e41086c58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c830d9b12bf405aa1e5d873dd4b8674'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:08.393641 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-1ab61964-85a6-4ef3-bb15-2e3e41086c58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c830d9b12bf405aa1e5d873dd4b8674'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:08.394504 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-1ab61964-85a6-4ef3-bb15-2e3e41086c58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c830d9b12bf405aa1e5d873dd4b8674'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:08.405823 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-1ab61964-85a6-4ef3-bb15-2e3e41086c58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c830d9b12bf405aa1e5d873dd4b8674'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:08.412515 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1180/2358] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:41:08 2021] DELETE /identity/v3/users/5c830d9b12bf405aa1e5d873dd4b8674 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:09.025954 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5cc62d-e192-4e61-9d6e-f1ac76ff9d7e admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:09.028198 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-6d5cc62d-e192-4e61-9d6e-f1ac76ff9d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:09.047274 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5cc62d-e192-4e61-9d6e-f1ac76ff9d7e admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:09.076381 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdd778-b877-4265-85a9-6cf4235bca38 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:09.076673 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdd778-b877-4265-85a9-6cf4235bca38 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:09.076947 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdd778-b877-4265-85a9-6cf4235bca38 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:09.078737 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1181/2359] 10.222.0.30 () {54 vars in 921 bytes} [Fri Oct 15 03:41:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:41:09.085096 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3c9ca-6d1b-43fc-84f2-0e3b16c6357e None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:09.085960 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3c9ca-6d1b-43fc-84f2-0e3b16c6357e None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:09.086229 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3c9ca-6d1b-43fc-84f2-0e3b16c6357e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:09.105251 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-6fc3c9ca-6d1b-43fc-84f2-0e3b16c6357e None None] MFA Rules not processed for user `3d71a1bd93b04249b2b8e6a054de44c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:09.106444 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-6fc3c9ca-6d1b-43fc-84f2-0e3b16c6357e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:09.121260 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66231da-84b3-43b4-9421-10996341a9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:09.122300 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66231da-84b3-43b4-9421-10996341a9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:09.122674 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66231da-84b3-43b4-9421-10996341a9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:09.123016 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66231da-84b3-43b4-9421-10996341a9e8 admin admin] PATH_INFO: `/v3/projects/a4c86a88d1924ec3bd7369073dc44660` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:09.124377 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66231da-84b3-43b4-9421-10996341a9e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4c86a88d1924ec3bd7369073dc44660)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:09.126437 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66231da-84b3-43b4-9421-10996341a9e8 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:09.189789 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1182/2360] 10.222.0.30 () {58 vars in 1018 bytes} [Fri Oct 15 03:41:09 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:41:09.190638 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a66231da-84b3-43b4-9421-10996341a9e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4c86a88d1924ec3bd7369073dc44660', 'request_id': 'req-a66231da-84b3-43b4-9421-10996341a9e8'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:09.198576 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a66231da-84b3-43b4-9421-10996341a9e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4c86a88d1924ec3bd7369073dc44660', 'request_id': 'req-a66231da-84b3-43b4-9421-10996341a9e8'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:09.203799 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3c9ca-6d1b-43fc-84f2-0e3b16c6357e None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:09.205345 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-6fc3c9ca-6d1b-43fc-84f2-0e3b16c6357e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:09.206323 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a66231da-84b3-43b4-9421-10996341a9e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4c86a88d1924ec3bd7369073dc44660', 'request_id': 'req-a66231da-84b3-43b4-9421-10996341a9e8'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:09.223635 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a66231da-84b3-43b4-9421-10996341a9e8 admin admin] The token cache is being invalidate because project a4c86a88d1924ec3bd7369073dc44660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:41:09.224201 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a66231da-84b3-43b4-9421-10996341a9e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:09.225381 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a66231da-84b3-43b4-9421-10996341a9e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:09.232649 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1179/2361] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:41:09 2021] DELETE /identity/v3/projects/a4c86a88d1924ec3bd7369073dc44660 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:09.234772 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a075e-28b2-4cf6-b980-25410b438538 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:09.235259 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a075e-28b2-4cf6-b980-25410b438538 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:09.235713 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a075e-28b2-4cf6-b980-25410b438538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:09.265982 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3c9ca-6d1b-43fc-84f2-0e3b16c6357e None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:09.281109 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-cb3a075e-28b2-4cf6-b980-25410b438538 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:09.282346 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-cb3a075e-28b2-4cf6-b980-25410b438538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:09.323244 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166331d2-e032-4134-8562-6ac2a5586473 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456c83b8619847279927251ca48fca37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:09.324221 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166331d2-e032-4134-8562-6ac2a5586473 service glance] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:09.324510 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166331d2-e032-4134-8562-6ac2a5586473 service glance] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:09.324791 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166331d2-e032-4134-8562-6ac2a5586473 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:09.326865 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-166331d2-e032-4134-8562-6ac2a5586473 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:09.364606 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1180/2362] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:41:09.374448 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf18d5b-4d6a-4b21-9151-273dc6786c9b None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:09.374817 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf18d5b-4d6a-4b21-9151-273dc6786c9b None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:09.375174 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf18d5b-4d6a-4b21-9151-273dc6786c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:09.396032 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-7bf18d5b-4d6a-4b21-9151-273dc6786c9b None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:09.397257 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7bf18d5b-4d6a-4b21-9151-273dc6786c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:09.407298 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1181/2363] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:41:09.410952 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166331d2-e032-4134-8562-6ac2a5586473 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:09.411830 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf18d5b-4d6a-4b21-9151-273dc6786c9b None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:09.412333 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166331d2-e032-4134-8562-6ac2a5586473 service glance] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:09.421683 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf18d5b-4d6a-4b21-9151-273dc6786c9b None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:09.423437 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1183/2364] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:41:09 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:41:09.426857 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63eb3b-8482-4aca-a174-c89b2098f2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:09.427511 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63eb3b-8482-4aca-a174-c89b2098f2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:09.427821 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63eb3b-8482-4aca-a174-c89b2098f2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:09.428095 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63eb3b-8482-4aca-a174-c89b2098f2f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:09.428860 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63eb3b-8482-4aca-a174-c89b2098f2f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:41:09.429715 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63eb3b-8482-4aca-a174-c89b2098f2f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:09.431461 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63eb3b-8482-4aca-a174-c89b2098f2f4 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:09.443852 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1182/2365] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:41:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:41:09.449038 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166331d2-e032-4134-8562-6ac2a5586473 service glance] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:09.460561 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166331d2-e032-4134-8562-6ac2a5586473 service glance] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:09.466519 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe800c3-4e7e-4afc-a5d1-1ae096d0a802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:09.467204 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe800c3-4e7e-4afc-a5d1-1ae096d0a802 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:09.467478 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe800c3-4e7e-4afc-a5d1-1ae096d0a802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:09.467787 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe800c3-4e7e-4afc-a5d1-1ae096d0a802 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:09.468492 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe800c3-4e7e-4afc-a5d1-1ae096d0a802 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:09.470394 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe800c3-4e7e-4afc-a5d1-1ae096d0a802 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:09.499764 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94817f-4ba8-4ac5-a36a-f61928d64f79 None None] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:09.500092 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94817f-4ba8-4ac5-a36a-f61928d64f79 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:09.500326 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94817f-4ba8-4ac5-a36a-f61928d64f79 None None] PATH_INFO: `/` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:09.501240 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1184/2366] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:41:09 2021] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:41:09.502150 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe800c3-4e7e-4afc-a5d1-1ae096d0a802 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:09.502987 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1183/2367] 10.222.0.30 () {54 vars in 921 bytes} [Fri Oct 15 03:41:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 15 03:41:09.508237 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f770e-8439-4cac-b00e-4075c888861e None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:09.508608 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f770e-8439-4cac-b00e-4075c888861e None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:09.509089 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f770e-8439-4cac-b00e-4075c888861e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:09.530333 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-2b8f770e-8439-4cac-b00e-4075c888861e None None] MFA Rules not processed for user `3ea75b4f9132494388b223a309a40640`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:09.531578 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-2b8f770e-8439-4cac-b00e-4075c888861e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:09.576300 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe800c3-4e7e-4afc-a5d1-1ae096d0a802 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:09.586880 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f24a0-0661-494e-b6fb-cbe0c9c6869b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:09.587648 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f24a0-0661-494e-b6fb-cbe0c9c6869b admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:09.587966 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f24a0-0661-494e-b6fb-cbe0c9c6869b admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:09.588530 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f24a0-0661-494e-b6fb-cbe0c9c6869b admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:09.589361 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f24a0-0661-494e-b6fb-cbe0c9c6869b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:09.591068 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1184/2368] 10.222.0.30 () {58 vars in 1018 bytes} [Fri Oct 15 03:41:09 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:41:09.591320 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f24a0-0661-494e-b6fb-cbe0c9c6869b admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:09.604812 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f770e-8439-4cac-b00e-4075c888861e None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:09.606105 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-2b8f770e-8439-4cac-b00e-4075c888861e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:09.615155 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1185/2369] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:41:09 2021] POST /identity/v3/users => generated 285 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:41:09.616452 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f770e-8439-4cac-b00e-4075c888861e None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:09.619903 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f24a0-0661-494e-b6fb-cbe0c9c6869b admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:09.620952 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d519d7e-02db-4471-a74a-0af308df150e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:09.621619 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d519d7e-02db-4471-a74a-0af308df150e service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:09.621900 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d519d7e-02db-4471-a74a-0af308df150e service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:09.622173 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d519d7e-02db-4471-a74a-0af308df150e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:09.629344 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f24a0-0661-494e-b6fb-cbe0c9c6869b admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:09.629505 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d519d7e-02db-4471-a74a-0af308df150e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:09.630886 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d519d7e-02db-4471-a74a-0af308df150e service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:09.634180 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad3814-92cf-4d1c-85a6-1cbd1b62112a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:09.634829 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad3814-92cf-4d1c-85a6-1cbd1b62112a admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:09.635184 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad3814-92cf-4d1c-85a6-1cbd1b62112a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:09.635372 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad3814-92cf-4d1c-85a6-1cbd1b62112a admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:09.636309 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad3814-92cf-4d1c-85a6-1cbd1b62112a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:09.637915 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad3814-92cf-4d1c-85a6-1cbd1b62112a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:09.640493 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1185/2370] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:41:09 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:41:09.648551 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1186/2371] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:41:09 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:41:09.652419 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d519d7e-02db-4471-a74a-0af308df150e service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:09.664134 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d519d7e-02db-4471-a74a-0af308df150e service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:09.669157 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03545f5-9bea-4270-902f-d8631a87b13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:09.669818 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03545f5-9bea-4270-902f-d8631a87b13c admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:09.670101 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03545f5-9bea-4270-902f-d8631a87b13c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:09.670382 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03545f5-9bea-4270-902f-d8631a87b13c admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:09.671119 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03545f5-9bea-4270-902f-d8631a87b13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:09.672759 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03545f5-9bea-4270-902f-d8631a87b13c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:09.683745 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1186/2372] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:41:09 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:41:09.688477 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad3814-92cf-4d1c-85a6-1cbd1b62112a admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:09.700330 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad3814-92cf-4d1c-85a6-1cbd1b62112a admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:09.706249 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a0cff-7b3a-43df-a527-84616b79dbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:09.707279 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a0cff-7b3a-43df-a527-84616b79dbd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:09.707636 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a0cff-7b3a-43df-a527-84616b79dbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:09.708019 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a0cff-7b3a-43df-a527-84616b79dbd6 admin admin] PATH_INFO: `/v3/projects/b95044ccce904c4998f4a6527dcf9e93/users/3adce2c12fa648b08e311fc8c68f5acd/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:09.725677 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a0cff-7b3a-43df-a527-84616b79dbd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95044ccce904c4998f4a6527dcf9e93, user_id=3adce2c12fa648b08e311fc8c68f5acd, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:09.729140 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a0cff-7b3a-43df-a527-84616b79dbd6 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:09.744067 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1187/2373] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:41:09 2021] PUT /identity/v3/projects/b95044ccce904c4998f4a6527dcf9e93/users/3adce2c12fa648b08e311fc8c68f5acd/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:09.754399 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38999c0-5a0a-4e05-87f1-9aa055fb8a5e None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:09.754724 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38999c0-5a0a-4e05-87f1-9aa055fb8a5e None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:09.754969 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38999c0-5a0a-4e05-87f1-9aa055fb8a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:09.782922 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-b38999c0-5a0a-4e05-87f1-9aa055fb8a5e None None] MFA Rules not processed for user `3adce2c12fa648b08e311fc8c68f5acd`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:09.784223 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-b38999c0-5a0a-4e05-87f1-9aa055fb8a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:09.855013 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1187/2374] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:09 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:41:09.865144 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a0cff-7b3a-43df-a527-84616b79dbd6 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:09.866956 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-786a0cff-7b3a-43df-a527-84616b79dbd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:09.931166 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a0cff-7b3a-43df-a527-84616b79dbd6 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:09.936535 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa290b5-9eaa-41b9-b142-497ded75481c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:09.937195 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa290b5-9eaa-41b9-b142-497ded75481c service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:09.937472 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa290b5-9eaa-41b9-b142-497ded75481c service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:09.937741 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa290b5-9eaa-41b9-b142-497ded75481c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:09.947373 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa290b5-9eaa-41b9-b142-497ded75481c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:09.948852 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa290b5-9eaa-41b9-b142-497ded75481c service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:09.958204 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1188/2375] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:41:09 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:41:09.979353 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38999c0-5a0a-4e05-87f1-9aa055fb8a5e None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:10.047135 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38999c0-5a0a-4e05-87f1-9aa055fb8a5e None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:10.052361 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324869e7-c8b8-4ab9-9f93-0b0c1e3eff89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:10.053778 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324869e7-c8b8-4ab9-9f93-0b0c1e3eff89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:10.054422 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324869e7-c8b8-4ab9-9f93-0b0c1e3eff89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:10.054993 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324869e7-c8b8-4ab9-9f93-0b0c1e3eff89 admin admin] PATH_INFO: `/v3/users/3adce2c12fa648b08e311fc8c68f5acd` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:10.056219 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324869e7-c8b8-4ab9-9f93-0b0c1e3eff89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3adce2c12fa648b08e311fc8c68f5acd)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:10.058154 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324869e7-c8b8-4ab9-9f93-0b0c1e3eff89 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:10.106812 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-324869e7-c8b8-4ab9-9f93-0b0c1e3eff89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3adce2c12fa648b08e311fc8c68f5acd'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:10.119289 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-324869e7-c8b8-4ab9-9f93-0b0c1e3eff89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3adce2c12fa648b08e311fc8c68f5acd'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:10.128266 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-324869e7-c8b8-4ab9-9f93-0b0c1e3eff89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3adce2c12fa648b08e311fc8c68f5acd'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:10.129182 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-324869e7-c8b8-4ab9-9f93-0b0c1e3eff89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3adce2c12fa648b08e311fc8c68f5acd'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:10.136957 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-324869e7-c8b8-4ab9-9f93-0b0c1e3eff89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3adce2c12fa648b08e311fc8c68f5acd'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:10.143406 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1188/2376] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:41:09 2021] DELETE /identity/v3/users/3adce2c12fa648b08e311fc8c68f5acd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:10.148639 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f01902-c3a9-4f9d-8e0e-9cd628677273 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:10.148931 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f01902-c3a9-4f9d-8e0e-9cd628677273 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:10.149210 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f01902-c3a9-4f9d-8e0e-9cd628677273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:10.167238 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-98f01902-c3a9-4f9d-8e0e-9cd628677273 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:10.168552 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-98f01902-c3a9-4f9d-8e0e-9cd628677273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:10.228440 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1189/2377] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:41:10.238419 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324869e7-c8b8-4ab9-9f93-0b0c1e3eff89 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:10.239894 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-324869e7-c8b8-4ab9-9f93-0b0c1e3eff89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:10.298895 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324869e7-c8b8-4ab9-9f93-0b0c1e3eff89 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:10.302929 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a77308-db53-4630-80aa-ea03fa1ad3bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:10.304161 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a77308-db53-4630-80aa-ea03fa1ad3bb service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:10.304511 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a77308-db53-4630-80aa-ea03fa1ad3bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:10.304850 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a77308-db53-4630-80aa-ea03fa1ad3bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:10.315621 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a77308-db53-4630-80aa-ea03fa1ad3bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:10.317113 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a77308-db53-4630-80aa-ea03fa1ad3bb service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:10.327187 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1189/2378] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:41:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:41:10.624220 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f01902-c3a9-4f9d-8e0e-9cd628677273 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:10.625748 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-98f01902-c3a9-4f9d-8e0e-9cd628677273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:10.639967 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f01902-c3a9-4f9d-8e0e-9cd628677273 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:10.651966 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e4445-e9af-4ce7-9128-e4844e05200b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:10.652789 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e4445-e9af-4ce7-9128-e4844e05200b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:10.653065 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e4445-e9af-4ce7-9128-e4844e05200b admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:10.653338 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e4445-e9af-4ce7-9128-e4844e05200b admin admin] PATH_INFO: `/v3/projects/b95044ccce904c4998f4a6527dcf9e93` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:10.654538 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e4445-e9af-4ce7-9128-e4844e05200b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b95044ccce904c4998f4a6527dcf9e93)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:10.656469 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e4445-e9af-4ce7-9128-e4844e05200b admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:10.704817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-986e4445-e9af-4ce7-9128-e4844e05200b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b95044ccce904c4998f4a6527dcf9e93', 'request_id': 'req-986e4445-e9af-4ce7-9128-e4844e05200b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:10.711257 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-986e4445-e9af-4ce7-9128-e4844e05200b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b95044ccce904c4998f4a6527dcf9e93', 'request_id': 'req-986e4445-e9af-4ce7-9128-e4844e05200b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:10.716845 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-986e4445-e9af-4ce7-9128-e4844e05200b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b95044ccce904c4998f4a6527dcf9e93', 'request_id': 'req-986e4445-e9af-4ce7-9128-e4844e05200b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:10.730059 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-986e4445-e9af-4ce7-9128-e4844e05200b admin admin] The token cache is being invalidate because project b95044ccce904c4998f4a6527dcf9e93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:41:10.730349 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-986e4445-e9af-4ce7-9128-e4844e05200b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:10.731016 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-986e4445-e9af-4ce7-9128-e4844e05200b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:10.732656 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1190/2379] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:41:10 2021] DELETE /identity/v3/projects/b95044ccce904c4998f4a6527dcf9e93 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:10.740419 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fabbab-714f-4afb-83f5-31b679cd8625 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:10.740716 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fabbab-714f-4afb-83f5-31b679cd8625 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:10.741072 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fabbab-714f-4afb-83f5-31b679cd8625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:10.760094 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154a311-9c19-4f4c-8a20-0ba3efd6e512 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:10.760317 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154a311-9c19-4f4c-8a20-0ba3efd6e512 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:10.760598 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154a311-9c19-4f4c-8a20-0ba3efd6e512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:10.760916 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-24fabbab-714f-4afb-83f5-31b679cd8625 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:10.762138 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-24fabbab-714f-4afb-83f5-31b679cd8625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:10.779273 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-c154a311-9c19-4f4c-8a20-0ba3efd6e512 None None] MFA Rules not processed for user `d1bb22a3461a47e5afeb229038cb4a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:10.780536 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-c154a311-9c19-4f4c-8a20-0ba3efd6e512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:10.821081 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1190/2380] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:41:10.830046 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c302fe5-8a38-4d97-a0a0-4f939ad4b320 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:10.830338 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c302fe5-8a38-4d97-a0a0-4f939ad4b320 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:10.830614 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c302fe5-8a38-4d97-a0a0-4f939ad4b320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:10.837149 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1191/2381] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:10 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:41:10.850246 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-6c302fe5-8a38-4d97-a0a0-4f939ad4b320 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:10.851501 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-6c302fe5-8a38-4d97-a0a0-4f939ad4b320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:10.859893 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1191/2382] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:41:10.864430 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154a311-9c19-4f4c-8a20-0ba3efd6e512 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:10.876707 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154a311-9c19-4f4c-8a20-0ba3efd6e512 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:10.881534 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed8e4d-e4ca-4400-b072-2c030db8eed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:10.882761 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed8e4d-e4ca-4400-b072-2c030db8eed8 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:10.883174 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed8e4d-e4ca-4400-b072-2c030db8eed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:10.883453 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed8e4d-e4ca-4400-b072-2c030db8eed8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:10.884228 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed8e4d-e4ca-4400-b072-2c030db8eed8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:41:10.884534 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed8e4d-e4ca-4400-b072-2c030db8eed8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:10.886143 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed8e4d-e4ca-4400-b072-2c030db8eed8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:10.898226 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1192/2383] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:41:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:41:10.902765 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c302fe5-8a38-4d97-a0a0-4f939ad4b320 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:10.912231 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c302fe5-8a38-4d97-a0a0-4f939ad4b320 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:10.917377 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cb8dc-839e-4f46-aaa7-83e75fb0705c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:10.918037 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cb8dc-839e-4f46-aaa7-83e75fb0705c admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:10.918326 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cb8dc-839e-4f46-aaa7-83e75fb0705c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:10.918602 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cb8dc-839e-4f46-aaa7-83e75fb0705c admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:10.919447 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cb8dc-839e-4f46-aaa7-83e75fb0705c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:10.921507 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cb8dc-839e-4f46-aaa7-83e75fb0705c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:10.954792 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1192/2384] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:41:10 2021] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:41:10.959453 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed8e4d-e4ca-4400-b072-2c030db8eed8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:10.970206 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed8e4d-e4ca-4400-b072-2c030db8eed8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:11.030064 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b0aea-680b-4a40-846a-560e02ad1560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:11.031013 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b0aea-680b-4a40-846a-560e02ad1560 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:11.031299 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b0aea-680b-4a40-846a-560e02ad1560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:11.031584 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b0aea-680b-4a40-846a-560e02ad1560 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:11.032382 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b0aea-680b-4a40-846a-560e02ad1560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:11.034323 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b0aea-680b-4a40-846a-560e02ad1560 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:11.062180 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1193/2385] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:41:10 2021] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:41:11.066147 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cb8dc-839e-4f46-aaa7-83e75fb0705c admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:11.079109 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cb8dc-839e-4f46-aaa7-83e75fb0705c admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:11.088868 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c0dbc-2bd0-4038-88b6-22b9bdeacdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:11.089979 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c0dbc-2bd0-4038-88b6-22b9bdeacdc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:11.089979 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c0dbc-2bd0-4038-88b6-22b9bdeacdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:11.090269 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c0dbc-2bd0-4038-88b6-22b9bdeacdc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:11.091011 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c0dbc-2bd0-4038-88b6-22b9bdeacdc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:11.093347 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c0dbc-2bd0-4038-88b6-22b9bdeacdc6 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:11.117190 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1193/2386] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:41:11 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:41:11.120934 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b0aea-680b-4a40-846a-560e02ad1560 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:11.134366 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b0aea-680b-4a40-846a-560e02ad1560 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:11.143627 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bf3be-32c3-4325-bc94-4201f88c6ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:11.144387 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bf3be-32c3-4325-bc94-4201f88c6ffc admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:11.144679 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bf3be-32c3-4325-bc94-4201f88c6ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:11.144959 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bf3be-32c3-4325-bc94-4201f88c6ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:11.146166 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5bf3be-32c3-4325-bc94-4201f88c6ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:11.148168 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5bf3be-32c3-4325-bc94-4201f88c6ffc admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:11.160097 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1194/2387] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:41:11 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:41:11.165302 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c0dbc-2bd0-4038-88b6-22b9bdeacdc6 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:11.177834 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c0dbc-2bd0-4038-88b6-22b9bdeacdc6 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:11.184565 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce970b3-fa2e-466f-bc34-64d948ca4349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:11.186247 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce970b3-fa2e-466f-bc34-64d948ca4349 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:11.186553 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce970b3-fa2e-466f-bc34-64d948ca4349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:11.187175 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce970b3-fa2e-466f-bc34-64d948ca4349 admin admin] PATH_INFO: `/v3/projects/7e52e7e5315b4276b8de0956a1e6e1ab/users/2ca38b76149840afb33c7f47cc643869/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:11.204583 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce970b3-fa2e-466f-bc34-64d948ca4349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e52e7e5315b4276b8de0956a1e6e1ab, user_id=2ca38b76149840afb33c7f47cc643869, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:11.207470 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce970b3-fa2e-466f-bc34-64d948ca4349 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:11.225070 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1194/2388] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:41:11 2021] PUT /identity/v3/projects/7e52e7e5315b4276b8de0956a1e6e1ab/users/2ca38b76149840afb33c7f47cc643869/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:41:11.235818 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688e9f3-d721-4c8b-a41e-69714da09911 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:11.236110 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688e9f3-d721-4c8b-a41e-69714da09911 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:11.236390 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688e9f3-d721-4c8b-a41e-69714da09911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:11.264192 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-b688e9f3-d721-4c8b-a41e-69714da09911 None None] MFA Rules not processed for user `2ca38b76149840afb33c7f47cc643869`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:11.265405 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-b688e9f3-d721-4c8b-a41e-69714da09911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:11.329208 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1195/2389] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:11 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:41:11.340516 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce970b3-fa2e-466f-bc34-64d948ca4349 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:11.342292 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-2ce970b3-fa2e-466f-bc34-64d948ca4349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:11.398727 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce970b3-fa2e-466f-bc34-64d948ca4349 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:11.402225 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f6564-6efd-4f26-a9c9-09e27bb46e09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:11.402862 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f6564-6efd-4f26-a9c9-09e27bb46e09 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:11.403142 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f6564-6efd-4f26-a9c9-09e27bb46e09 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:11.403412 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f6564-6efd-4f26-a9c9-09e27bb46e09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:11.411663 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f6564-6efd-4f26-a9c9-09e27bb46e09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:11.413115 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f6564-6efd-4f26-a9c9-09e27bb46e09 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:11.425121 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1195/2390] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:41:11 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:41:12.527358 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb8601-01b7-462f-8b67-f969c2570ff4 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:12.527844 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb8601-01b7-462f-8b67-f969c2570ff4 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:12.527937 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb8601-01b7-462f-8b67-f969c2570ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:12.545689 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-26bb8601-01b7-462f-8b67-f969c2570ff4 None None] MFA Rules not processed for user `3f598b94a850413494da575188706cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:12.546865 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-26bb8601-01b7-462f-8b67-f969c2570ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:12.600510 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1196/2391] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Oct 15 03:41:12 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:41:12.613859 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f6564-6efd-4f26-a9c9-09e27bb46e09 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:12.615278 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-002f6564-6efd-4f26-a9c9-09e27bb46e09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:12.685932 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f6564-6efd-4f26-a9c9-09e27bb46e09 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:12.691087 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e0501-0533-4d5a-9726-bd4068268457 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfdf0fb38dd04c75a1c874913ea1bf98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:12.692000 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e0501-0533-4d5a-9726-bd4068268457 service swift] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:12.692359 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e0501-0533-4d5a-9726-bd4068268457 service swift] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:12.692707 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e0501-0533-4d5a-9726-bd4068268457 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:12.703064 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e0501-0533-4d5a-9726-bd4068268457 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:12.704825 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e0501-0533-4d5a-9726-bd4068268457 service swift] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:12.714011 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1196/2392] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Oct 15 03:41:12 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 15 03:41:27.649303 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d47cb-f2c9-45b1-bd78-686586b55e97 None None] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:27.649941 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d47cb-f2c9-45b1-bd78-686586b55e97 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:27.650036 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d47cb-f2c9-45b1-bd78-686586b55e97 None None] PATH_INFO: `/` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:27.652914 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1197/2393] 10.222.0.30 () {54 vars in 960 bytes} [Fri Oct 15 03:41:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 15 03:41:27.667823 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b10529-63e7-4e65-8f49-6867f0615e6b None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:27.668373 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b10529-63e7-4e65-8f49-6867f0615e6b None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:27.668373 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b10529-63e7-4e65-8f49-6867f0615e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:27.776845 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-10b10529-63e7-4e65-8f49-6867f0615e6b None None] MFA Rules not processed for user `bffc0480ffb942cdad426195eca0529e`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:27.778687 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-10b10529-63e7-4e65-8f49-6867f0615e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:27.913531 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1197/2394] 10.222.0.30 () {58 vars in 1057 bytes} [Fri Oct 15 03:41:27 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:41:27.921505 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d47cb-f2c9-45b1-bd78-686586b55e97 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:27.935487 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d47cb-f2c9-45b1-bd78-686586b55e97 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:27.940954 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09e564-562e-454d-a8a8-816b54a40ee7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bffc0480ffb942cdad426195eca0529e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:27.941622 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09e564-562e-454d-a8a8-816b54a40ee7 service placement] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:27.941904 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09e564-562e-454d-a8a8-816b54a40ee7 service placement] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:27.942187 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09e564-562e-454d-a8a8-816b54a40ee7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:27.945564 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-ff09e564-562e-454d-a8a8-816b54a40ee7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:27.957879 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09e564-562e-454d-a8a8-816b54a40ee7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:27.959458 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09e564-562e-454d-a8a8-816b54a40ee7 service placement] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:27.970187 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1198/2395] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:41:27 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:41:34.477235 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b10529-63e7-4e65-8f49-6867f0615e6b None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:34.580956 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b10529-63e7-4e65-8f49-6867f0615e6b None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:34.586341 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71134f46-c58c-4df1-a4c7-d248853a29cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:34.587215 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71134f46-c58c-4df1-a4c7-d248853a29cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:34.587503 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71134f46-c58c-4df1-a4c7-d248853a29cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:34.588106 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71134f46-c58c-4df1-a4c7-d248853a29cf admin admin] PATH_INFO: `/v3/users/2ca38b76149840afb33c7f47cc643869` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:34.589329 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71134f46-c58c-4df1-a4c7-d248853a29cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca38b76149840afb33c7f47cc643869)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:34.591278 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71134f46-c58c-4df1-a4c7-d248853a29cf admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:34.661721 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-71134f46-c58c-4df1-a4c7-d248853a29cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca38b76149840afb33c7f47cc643869'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:34.678217 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-71134f46-c58c-4df1-a4c7-d248853a29cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca38b76149840afb33c7f47cc643869'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:34.688686 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-71134f46-c58c-4df1-a4c7-d248853a29cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca38b76149840afb33c7f47cc643869'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:34.689654 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-71134f46-c58c-4df1-a4c7-d248853a29cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca38b76149840afb33c7f47cc643869'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:34.700791 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-71134f46-c58c-4df1-a4c7-d248853a29cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca38b76149840afb33c7f47cc643869'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:34.720181 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1198/2396] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:41:34 2021] DELETE /identity/v3/users/2ca38b76149840afb33c7f47cc643869 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:34.724988 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca58c73-68c3-41f9-b4b0-9419cf68dcd5 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:34.726013 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca58c73-68c3-41f9-b4b0-9419cf68dcd5 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:34.726570 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca58c73-68c3-41f9-b4b0-9419cf68dcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:34.749277 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-5ca58c73-68c3-41f9-b4b0-9419cf68dcd5 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:34.750871 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-5ca58c73-68c3-41f9-b4b0-9419cf68dcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:34.847201 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1199/2397] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:41:34.857406 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71134f46-c58c-4df1-a4c7-d248853a29cf admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:34.858931 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-71134f46-c58c-4df1-a4c7-d248853a29cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:34.925684 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71134f46-c58c-4df1-a4c7-d248853a29cf admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:34.931225 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febcfab-2653-4626-9c83-545dd0a8d49a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:34.931908 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febcfab-2653-4626-9c83-545dd0a8d49a service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:34.932189 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febcfab-2653-4626-9c83-545dd0a8d49a service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:34.932462 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febcfab-2653-4626-9c83-545dd0a8d49a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:34.943411 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febcfab-2653-4626-9c83-545dd0a8d49a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:34.945521 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febcfab-2653-4626-9c83-545dd0a8d49a service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:34.955600 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1199/2398] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:41:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:41:35.328800 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca58c73-68c3-41f9-b4b0-9419cf68dcd5 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:35.330457 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-5ca58c73-68c3-41f9-b4b0-9419cf68dcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:35.351049 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca58c73-68c3-41f9-b4b0-9419cf68dcd5 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:35.356575 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc5160-984c-4035-b02b-3ddbab81092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:35.357537 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc5160-984c-4035-b02b-3ddbab81092b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:35.357952 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc5160-984c-4035-b02b-3ddbab81092b admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:35.358329 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc5160-984c-4035-b02b-3ddbab81092b admin admin] PATH_INFO: `/v3/projects/7e52e7e5315b4276b8de0956a1e6e1ab` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:35.359748 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc5160-984c-4035-b02b-3ddbab81092b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e52e7e5315b4276b8de0956a1e6e1ab)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:35.361765 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc5160-984c-4035-b02b-3ddbab81092b admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:35.414961 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a8bc5160-984c-4035-b02b-3ddbab81092b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e52e7e5315b4276b8de0956a1e6e1ab', 'request_id': 'req-a8bc5160-984c-4035-b02b-3ddbab81092b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:35.420914 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a8bc5160-984c-4035-b02b-3ddbab81092b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e52e7e5315b4276b8de0956a1e6e1ab', 'request_id': 'req-a8bc5160-984c-4035-b02b-3ddbab81092b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:35.427742 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a8bc5160-984c-4035-b02b-3ddbab81092b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e52e7e5315b4276b8de0956a1e6e1ab', 'request_id': 'req-a8bc5160-984c-4035-b02b-3ddbab81092b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:35.439915 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a8bc5160-984c-4035-b02b-3ddbab81092b admin admin] The token cache is being invalidate because project 7e52e7e5315b4276b8de0956a1e6e1ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:41:35.440206 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a8bc5160-984c-4035-b02b-3ddbab81092b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:35.440828 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a8bc5160-984c-4035-b02b-3ddbab81092b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:35.442359 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1200/2399] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:41:35 2021] DELETE /identity/v3/projects/7e52e7e5315b4276b8de0956a1e6e1ab => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:35.872091 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febcfab-2653-4626-9c83-545dd0a8d49a service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:35.873587 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-5febcfab-2653-4626-9c83-545dd0a8d49a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:35.886533 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febcfab-2653-4626-9c83-545dd0a8d49a service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:35.951584 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67012138-9665-4fdb-92a9-6f091e93ca46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:35.952629 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67012138-9665-4fdb-92a9-6f091e93ca46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:35.952915 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67012138-9665-4fdb-92a9-6f091e93ca46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:35.953189 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67012138-9665-4fdb-92a9-6f091e93ca46 admin admin] PATH_INFO: `/v3/users/8a36bca064284ac296d0af7310065acf` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:35.954421 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67012138-9665-4fdb-92a9-6f091e93ca46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a36bca064284ac296d0af7310065acf)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:35.956563 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67012138-9665-4fdb-92a9-6f091e93ca46 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:36.038749 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-67012138-9665-4fdb-92a9-6f091e93ca46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a36bca064284ac296d0af7310065acf'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:36.052958 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-67012138-9665-4fdb-92a9-6f091e93ca46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a36bca064284ac296d0af7310065acf'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:36.062488 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-67012138-9665-4fdb-92a9-6f091e93ca46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a36bca064284ac296d0af7310065acf'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:36.063178 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-67012138-9665-4fdb-92a9-6f091e93ca46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a36bca064284ac296d0af7310065acf'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:36.072726 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-67012138-9665-4fdb-92a9-6f091e93ca46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a36bca064284ac296d0af7310065acf'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:36.081206 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1200/2400] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:41:35 2021] DELETE /identity/v3/users/8a36bca064284ac296d0af7310065acf => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:41:36.086291 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73b6ec-8896-4b49-8d6b-ef7441863e27 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:36.086802 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73b6ec-8896-4b49-8d6b-ef7441863e27 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:36.086884 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73b6ec-8896-4b49-8d6b-ef7441863e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:36.109282 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-dd73b6ec-8896-4b49-8d6b-ef7441863e27 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:36.110493 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-dd73b6ec-8896-4b49-8d6b-ef7441863e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:36.169948 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1201/2401] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:41:36.180614 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67012138-9665-4fdb-92a9-6f091e93ca46 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:36.182287 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-67012138-9665-4fdb-92a9-6f091e93ca46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:36.265461 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67012138-9665-4fdb-92a9-6f091e93ca46 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:36.269072 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3744a-2e4f-46d2-bc74-06badefef50d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:36.269708 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3744a-2e4f-46d2-bc74-06badefef50d service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:36.269985 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3744a-2e4f-46d2-bc74-06badefef50d service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:36.270254 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3744a-2e4f-46d2-bc74-06badefef50d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:36.279556 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3744a-2e4f-46d2-bc74-06badefef50d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:36.281610 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3744a-2e4f-46d2-bc74-06badefef50d service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:36.291425 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1201/2402] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:41:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:41:36.554278 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73b6ec-8896-4b49-8d6b-ef7441863e27 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:36.555885 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-dd73b6ec-8896-4b49-8d6b-ef7441863e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:36.569188 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73b6ec-8896-4b49-8d6b-ef7441863e27 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:36.574020 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8fc2cb-6b24-4986-8601-ec9c647cb71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:36.575007 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fc2cb-6b24-4986-8601-ec9c647cb71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:36.575381 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fc2cb-6b24-4986-8601-ec9c647cb71c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:36.575807 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8fc2cb-6b24-4986-8601-ec9c647cb71c admin admin] PATH_INFO: `/v3/projects/6e4248e1344b4eea906aa29ac26625f3` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:36.577072 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8fc2cb-6b24-4986-8601-ec9c647cb71c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e4248e1344b4eea906aa29ac26625f3)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:36.579456 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8fc2cb-6b24-4986-8601-ec9c647cb71c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:36.630814 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8f8fc2cb-6b24-4986-8601-ec9c647cb71c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e4248e1344b4eea906aa29ac26625f3', 'request_id': 'req-8f8fc2cb-6b24-4986-8601-ec9c647cb71c'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:36.637524 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8f8fc2cb-6b24-4986-8601-ec9c647cb71c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e4248e1344b4eea906aa29ac26625f3', 'request_id': 'req-8f8fc2cb-6b24-4986-8601-ec9c647cb71c'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:36.642846 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8f8fc2cb-6b24-4986-8601-ec9c647cb71c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e4248e1344b4eea906aa29ac26625f3', 'request_id': 'req-8f8fc2cb-6b24-4986-8601-ec9c647cb71c'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:36.657126 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8f8fc2cb-6b24-4986-8601-ec9c647cb71c admin admin] The token cache is being invalidate because project 6e4248e1344b4eea906aa29ac26625f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:41:36.657533 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8f8fc2cb-6b24-4986-8601-ec9c647cb71c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:36.658158 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8f8fc2cb-6b24-4986-8601-ec9c647cb71c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:41:36.659876 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1202/2403] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:41:36 2021] DELETE /identity/v3/projects/6e4248e1344b4eea906aa29ac26625f3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:41:36.666148 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c070f1-70dd-4f4a-80b1-1e70dadca88d None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:36.666610 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c070f1-70dd-4f4a-80b1-1e70dadca88d None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:36.667046 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c070f1-70dd-4f4a-80b1-1e70dadca88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:36.685601 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-d5c070f1-70dd-4f4a-80b1-1e70dadca88d None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:36.686731 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d5c070f1-70dd-4f4a-80b1-1e70dadca88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:36.744664 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1202/2404] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 03:41:36.752136 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733b21a-7545-4888-9327-e7a1893a7d89 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:36.752429 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733b21a-7545-4888-9327-e7a1893a7d89 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:36.752737 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733b21a-7545-4888-9327-e7a1893a7d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:36.770843 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-d733b21a-7545-4888-9327-e7a1893a7d89 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:36.772092 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-d733b21a-7545-4888-9327-e7a1893a7d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:36.780246 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1203/2405] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:41:36.784359 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c070f1-70dd-4f4a-80b1-1e70dadca88d None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:36.794197 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c070f1-70dd-4f4a-80b1-1e70dadca88d None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:36.798675 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efd43d-5939-42e2-a284-76fd8c758ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:36.799308 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efd43d-5939-42e2-a284-76fd8c758ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:36.799586 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efd43d-5939-42e2-a284-76fd8c758ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:36.799884 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efd43d-5939-42e2-a284-76fd8c758ff0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:36.800597 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efd43d-5939-42e2-a284-76fd8c758ff0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:41:36.800894 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efd43d-5939-42e2-a284-76fd8c758ff0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:36.802465 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efd43d-5939-42e2-a284-76fd8c758ff0 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:36.814999 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1203/2406] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:41:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 03:41:36.819486 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733b21a-7545-4888-9327-e7a1893a7d89 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:36.828373 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733b21a-7545-4888-9327-e7a1893a7d89 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:36.834379 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e8395-167a-4260-a44d-8a746675eba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:36.835662 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e8395-167a-4260-a44d-8a746675eba1 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:36.835976 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e8395-167a-4260-a44d-8a746675eba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:36.836254 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e8395-167a-4260-a44d-8a746675eba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:36.837049 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e8395-167a-4260-a44d-8a746675eba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:36.840253 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e8395-167a-4260-a44d-8a746675eba1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:36.867855 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1204/2407] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:41:36 2021] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:41:36.872099 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efd43d-5939-42e2-a284-76fd8c758ff0 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:36.881891 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efd43d-5939-42e2-a284-76fd8c758ff0 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:36.939812 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e900c-9ace-4264-8637-88f38f285702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:36.940510 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e900c-9ace-4264-8637-88f38f285702 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:36.940851 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e900c-9ace-4264-8637-88f38f285702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:36.941189 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e900c-9ace-4264-8637-88f38f285702 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:36.941967 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e900c-9ace-4264-8637-88f38f285702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:36.944166 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e900c-9ace-4264-8637-88f38f285702 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:36.964265 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1204/2408] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:41:36 2021] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:41:36.968403 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e8395-167a-4260-a44d-8a746675eba1 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:36.979311 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e8395-167a-4260-a44d-8a746675eba1 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:36.984014 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46874c9b-e36e-4ae1-b1c7-39975ed4ae99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:36.984675 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46874c9b-e36e-4ae1-b1c7-39975ed4ae99 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:36.984958 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46874c9b-e36e-4ae1-b1c7-39975ed4ae99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:36.985230 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46874c9b-e36e-4ae1-b1c7-39975ed4ae99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:36.985987 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46874c9b-e36e-4ae1-b1c7-39975ed4ae99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:36.987569 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46874c9b-e36e-4ae1-b1c7-39975ed4ae99 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:37.000756 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1205/2409] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:41:36 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:41:37.001917 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e900c-9ace-4264-8637-88f38f285702 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:37.011486 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e900c-9ace-4264-8637-88f38f285702 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:37.016020 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e02e6-4736-47e6-aa01-6a4eb8cc8334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:37.016657 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e02e6-4736-47e6-aa01-6a4eb8cc8334 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:37.016939 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e02e6-4736-47e6-aa01-6a4eb8cc8334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:37.017214 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e02e6-4736-47e6-aa01-6a4eb8cc8334 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:37.017934 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e02e6-4736-47e6-aa01-6a4eb8cc8334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:37.019514 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e02e6-4736-47e6-aa01-6a4eb8cc8334 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:37.029517 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1205/2410] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:41:37 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 03:41:37.033269 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46874c9b-e36e-4ae1-b1c7-39975ed4ae99 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:37.043162 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46874c9b-e36e-4ae1-b1c7-39975ed4ae99 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:37.047692 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cf9ee-f099-4f72-804a-2473c3b95872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:37.048548 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cf9ee-f099-4f72-804a-2473c3b95872 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:37.048829 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cf9ee-f099-4f72-804a-2473c3b95872 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:37.049099 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cf9ee-f099-4f72-804a-2473c3b95872 admin admin] PATH_INFO: `/v3/projects/e361efb4da2949b0af447c5239c102c8/users/4c12dd821c58420195e0de839688893c/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:37.062826 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7cf9ee-f099-4f72-804a-2473c3b95872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e361efb4da2949b0af447c5239c102c8, user_id=4c12dd821c58420195e0de839688893c, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:37.065478 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7cf9ee-f099-4f72-804a-2473c3b95872 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:37.077745 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1206/2411] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:41:37 2021] PUT /identity/v3/projects/e361efb4da2949b0af447c5239c102c8/users/4c12dd821c58420195e0de839688893c/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:41:37.088644 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c1ca7-d165-4262-b262-9e45bfa96025 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:37.088933 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c1ca7-d165-4262-b262-9e45bfa96025 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:37.089214 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c1ca7-d165-4262-b262-9e45bfa96025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:37.115331 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-7b9c1ca7-d165-4262-b262-9e45bfa96025 None None] MFA Rules not processed for user `4c12dd821c58420195e0de839688893c`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:37.116607 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7b9c1ca7-d165-4262-b262-9e45bfa96025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:37.179441 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1206/2412] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:41:37 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:41:37.190007 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cf9ee-f099-4f72-804a-2473c3b95872 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:37.191641 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-3e7cf9ee-f099-4f72-804a-2473c3b95872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:37.253301 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cf9ee-f099-4f72-804a-2473c3b95872 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:37.256040 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc47b52-96e8-4a4d-bb11-bc145e4dd6c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:37.257296 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc47b52-96e8-4a4d-bb11-bc145e4dd6c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:37.257634 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc47b52-96e8-4a4d-bb11-bc145e4dd6c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:37.257963 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc47b52-96e8-4a4d-bb11-bc145e4dd6c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:37.266899 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc47b52-96e8-4a4d-bb11-bc145e4dd6c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:37.268161 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc47b52-96e8-4a4d-bb11-bc145e4dd6c9 service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:37.277535 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1207/2413] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:41:37 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:41:54.550602 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c1ca7-d165-4262-b262-9e45bfa96025 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:54.552080 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7b9c1ca7-d165-4262-b262-9e45bfa96025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:54.607773 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c1ca7-d165-4262-b262-9e45bfa96025 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:54.611266 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e230fde-ed66-411b-ab17-cedb0b68a3e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:54.611929 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e230fde-ed66-411b-ab17-cedb0b68a3e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:54.612214 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e230fde-ed66-411b-ab17-cedb0b68a3e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:54.612485 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e230fde-ed66-411b-ab17-cedb0b68a3e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:54.614201 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-4e230fde-ed66-411b-ab17-cedb0b68a3e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:54.675648 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e230fde-ed66-411b-ab17-cedb0b68a3e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:54.677160 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e230fde-ed66-411b-ab17-cedb0b68a3e6 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:54.687883 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1207/2414] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:41:54 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:41:56.098405 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc9130-19db-405d-be66-14542a243a0e None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:56.098900 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc9130-19db-405d-be66-14542a243a0e None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:56.099014 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc9130-19db-405d-be66-14542a243a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:56.110179 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e230fde-ed66-411b-ab17-cedb0b68a3e6 service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:56.112761 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-4e230fde-ed66-411b-ab17-cedb0b68a3e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:56.118294 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-53dc9130-19db-405d-be66-14542a243a0e None None] MFA Rules not processed for user `3f598b94a850413494da575188706cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:41:56.119401 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-53dc9130-19db-405d-be66-14542a243a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:56.124383 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e230fde-ed66-411b-ab17-cedb0b68a3e6 service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:56.129420 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c3ea2-24ea-4d02-b42d-d233834998fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:56.129703 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c3ea2-24ea-4d02-b42d-d233834998fd service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:56.129979 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c3ea2-24ea-4d02-b42d-d233834998fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:56.130247 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c3ea2-24ea-4d02-b42d-d233834998fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:56.132123 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-3f0c3ea2-24ea-4d02-b42d-d233834998fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:56.190208 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1208/2415] 10.222.0.30 () {58 vars in 967 bytes} [Fri Oct 15 03:41:56 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:41:56.208595 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc9130-19db-405d-be66-14542a243a0e None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:41:56.210643 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-53dc9130-19db-405d-be66-14542a243a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:41:56.232899 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c3ea2-24ea-4d02-b42d-d233834998fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:56.234825 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c3ea2-24ea-4d02-b42d-d233834998fd service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:56.251515 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1208/2416] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:41:56 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:41:56.305771 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc9130-19db-405d-be66-14542a243a0e None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:41:56.310930 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b939b-3bc9-4ce0-af9a-7c70e0a36d57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfdf0fb38dd04c75a1c874913ea1bf98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:41:56.311550 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b939b-3bc9-4ce0-af9a-7c70e0a36d57 service swift] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:41:56.311932 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b939b-3bc9-4ce0-af9a-7c70e0a36d57 service swift] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:41:56.312211 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b939b-3bc9-4ce0-af9a-7c70e0a36d57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:41:56.322627 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b939b-3bc9-4ce0-af9a-7c70e0a36d57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:41:56.324689 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b939b-3bc9-4ce0-af9a-7c70e0a36d57 service swift] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:41:56.337303 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1209/2417] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Oct 15 03:41:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 15 03:43:25.350511 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c3ea2-24ea-4d02-b42d-d233834998fd service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:43:25.351925 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-3f0c3ea2-24ea-4d02-b42d-d233834998fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:43:25.441734 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c3ea2-24ea-4d02-b42d-d233834998fd service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:43:25.447821 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb6d83-fe0a-4513-8fc5-71c70b279702 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:43:25.448453 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb6d83-fe0a-4513-8fc5-71c70b279702 service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:43:25.448737 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb6d83-fe0a-4513-8fc5-71c70b279702 service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:43:25.449030 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb6d83-fe0a-4513-8fc5-71c70b279702 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:43:25.450750 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-44bb6d83-fe0a-4513-8fc5-71c70b279702 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:43:25.507637 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb6d83-fe0a-4513-8fc5-71c70b279702 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:43:25.509978 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb6d83-fe0a-4513-8fc5-71c70b279702 service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:43:25.519172 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1209/2418] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:43:25 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:43:28.762326 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b939b-3bc9-4ce0-af9a-7c70e0a36d57 service swift] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:43:28.771503 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b939b-3bc9-4ce0-af9a-7c70e0a36d57 service swift] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:43:28.775161 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502eef2-cdcc-4adc-be35-3e1c36751875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:43:28.775824 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502eef2-cdcc-4adc-be35-3e1c36751875 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:43:28.776112 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502eef2-cdcc-4adc-be35-3e1c36751875 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:43:28.776388 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502eef2-cdcc-4adc-be35-3e1c36751875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:43:28.778174 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-9502eef2-cdcc-4adc-be35-3e1c36751875 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:43:28.787418 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502eef2-cdcc-4adc-be35-3e1c36751875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:43:28.788874 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502eef2-cdcc-4adc-be35-3e1c36751875 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:43:28.796577 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1210/2419] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:43:28 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:44:03.967200 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb6d83-fe0a-4513-8fc5-71c70b279702 service nova] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:44:03.976219 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb6d83-fe0a-4513-8fc5-71c70b279702 service nova] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:44:03.980436 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea870b6f-4690-44d5-b531-23ea46c59fe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:44:03.981088 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea870b6f-4690-44d5-b531-23ea46c59fe6 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:44:03.981369 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea870b6f-4690-44d5-b531-23ea46c59fe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:44:03.981643 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea870b6f-4690-44d5-b531-23ea46c59fe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:44:03.983388 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-ea870b6f-4690-44d5-b531-23ea46c59fe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:44:03.996196 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea870b6f-4690-44d5-b531-23ea46c59fe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:44:03.997610 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea870b6f-4690-44d5-b531-23ea46c59fe6 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:44:04.008171 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1210/2420] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:44:03 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:44:04.985741 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502eef2-cdcc-4adc-be35-3e1c36751875 service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:44:04.995452 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502eef2-cdcc-4adc-be35-3e1c36751875 service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:44:04.999160 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52d4d2-80b2-423c-a158-48094a965fb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:44:04.999817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52d4d2-80b2-423c-a158-48094a965fb8 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:44:05.000102 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52d4d2-80b2-423c-a158-48094a965fb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:44:05.000379 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52d4d2-80b2-423c-a158-48094a965fb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:44:05.002137 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-2f52d4d2-80b2-423c-a158-48094a965fb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:44:05.016890 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52d4d2-80b2-423c-a158-48094a965fb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:44:05.018819 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52d4d2-80b2-423c-a158-48094a965fb8 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:44:05.029542 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1211/2421] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:44:04 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:44:06.470179 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea870b6f-4690-44d5-b531-23ea46c59fe6 service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:44:06.471846 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-ea870b6f-4690-44d5-b531-23ea46c59fe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:44:06.487924 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea870b6f-4690-44d5-b531-23ea46c59fe6 service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:44:06.494338 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a467225-332a-4f56-ac71-37c3c53b0263 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:44:06.494992 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a467225-332a-4f56-ac71-37c3c53b0263 service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:44:06.495277 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a467225-332a-4f56-ac71-37c3c53b0263 service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:44:06.495554 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a467225-332a-4f56-ac71-37c3c53b0263 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:44:06.497665 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-0a467225-332a-4f56-ac71-37c3c53b0263 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:44:06.513332 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a467225-332a-4f56-ac71-37c3c53b0263 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:44:06.514939 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a467225-332a-4f56-ac71-37c3c53b0263 service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:44:06.527178 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1211/2422] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:44:06 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:44:20.075871 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52d4d2-80b2-423c-a158-48094a965fb8 service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:44:20.089107 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52d4d2-80b2-423c-a158-48094a965fb8 service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:44:20.094764 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c2a12-823b-48f5-83bc-2ea39eef6f92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:44:20.095434 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c2a12-823b-48f5-83bc-2ea39eef6f92 service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:44:20.095746 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c2a12-823b-48f5-83bc-2ea39eef6f92 service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:44:20.096020 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c2a12-823b-48f5-83bc-2ea39eef6f92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:44:20.097777 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-729c2a12-823b-48f5-83bc-2ea39eef6f92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:44:20.110264 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c2a12-823b-48f5-83bc-2ea39eef6f92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:44:20.111861 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c2a12-823b-48f5-83bc-2ea39eef6f92 service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:44:20.124743 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1212/2423] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:44:20 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:44:44.795204 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a467225-332a-4f56-ac71-37c3c53b0263 service nova] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:44:44.806068 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a467225-332a-4f56-ac71-37c3c53b0263 service nova] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:44:44.811486 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56a533-1ebd-400f-84d9-de1e620aaa7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:44:44.812140 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56a533-1ebd-400f-84d9-de1e620aaa7e service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:44:44.812423 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56a533-1ebd-400f-84d9-de1e620aaa7e service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:44:44.812697 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56a533-1ebd-400f-84d9-de1e620aaa7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:44:44.814445 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-1a56a533-1ebd-400f-84d9-de1e620aaa7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:44:44.869474 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56a533-1ebd-400f-84d9-de1e620aaa7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:44:44.871052 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56a533-1ebd-400f-84d9-de1e620aaa7e service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:44:44.879635 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1212/2424] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:44:44 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:45:09.692506 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c2a12-823b-48f5-83bc-2ea39eef6f92 service nova] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:45:09.703515 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c2a12-823b-48f5-83bc-2ea39eef6f92 service nova] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:45:09.708946 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51838c4-5920-441c-8349-7a1efb9f117c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:45:09.709570 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51838c4-5920-441c-8349-7a1efb9f117c service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:45:09.709852 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51838c4-5920-441c-8349-7a1efb9f117c service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:45:09.710395 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51838c4-5920-441c-8349-7a1efb9f117c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:45:09.712163 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-a51838c4-5920-441c-8349-7a1efb9f117c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:45:09.767472 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51838c4-5920-441c-8349-7a1efb9f117c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:45:09.769086 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51838c4-5920-441c-8349-7a1efb9f117c service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:45:09.778631 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1213/2425] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:45:09 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:45:20.154472 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56a533-1ebd-400f-84d9-de1e620aaa7e service nova] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:45:20.163627 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56a533-1ebd-400f-84d9-de1e620aaa7e service nova] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:45:20.167766 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8d111-114d-42ac-84d5-6e1709c9ea8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:45:20.168387 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8d111-114d-42ac-84d5-6e1709c9ea8d service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:45:20.168662 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8d111-114d-42ac-84d5-6e1709c9ea8d service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:45:20.168928 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8d111-114d-42ac-84d5-6e1709c9ea8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:45:20.170782 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-a6d8d111-114d-42ac-84d5-6e1709c9ea8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:45:20.226041 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8d111-114d-42ac-84d5-6e1709c9ea8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:45:20.227491 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8d111-114d-42ac-84d5-6e1709c9ea8d service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:45:20.237031 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1213/2426] 10.222.0.30 () {60 vars in 1396 bytes} [Fri Oct 15 03:45:20 2021] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3391 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:46:07.714914 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcc033-53bf-4e40-a76f-514e7e7b289d None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:46:07.715458 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcc033-53bf-4e40-a76f-514e7e7b289d None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:46:07.715612 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcc033-53bf-4e40-a76f-514e7e7b289d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:46:07.734567 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-fbbcc033-53bf-4e40-a76f-514e7e7b289d None None] MFA Rules not processed for user `d1bb22a3461a47e5afeb229038cb4a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:46:07.736078 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-fbbcc033-53bf-4e40-a76f-514e7e7b289d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:46:07.743549 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1214/2427] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:46:07 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:46:35.056864 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8d111-114d-42ac-84d5-6e1709c9ea8d service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:46:35.058242 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-a6d8d111-114d-42ac-84d5-6e1709c9ea8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:46:35.122796 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8d111-114d-42ac-84d5-6e1709c9ea8d service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:46:35.127565 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76d758-7915-4fb2-b06a-0157d7471bef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bffc0480ffb942cdad426195eca0529e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:46:35.128220 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76d758-7915-4fb2-b06a-0157d7471bef service placement] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:46:35.128498 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76d758-7915-4fb2-b06a-0157d7471bef service placement] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:46:35.128767 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76d758-7915-4fb2-b06a-0157d7471bef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:46:35.130450 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-9d76d758-7915-4fb2-b06a-0157d7471bef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:46:35.141808 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76d758-7915-4fb2-b06a-0157d7471bef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:46:35.143362 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76d758-7915-4fb2-b06a-0157d7471bef service placement] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:46:35.152763 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1214/2428] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:46:35 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:46:42.281602 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbcc033-53bf-4e40-a76f-514e7e7b289d None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:46:42.307190 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbcc033-53bf-4e40-a76f-514e7e7b289d None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:46:42.312354 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913099c6-71d6-438e-b034-e2c7556c0f3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:46:42.313073 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913099c6-71d6-438e-b034-e2c7556c0f3d service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:46:42.313358 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913099c6-71d6-438e-b034-e2c7556c0f3d service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:46:42.313659 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913099c6-71d6-438e-b034-e2c7556c0f3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:46:42.324194 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913099c6-71d6-438e-b034-e2c7556c0f3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:46:42.325979 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913099c6-71d6-438e-b034-e2c7556c0f3d service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:46:42.338062 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1215/2429] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:46:42 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:46:42.386043 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76d758-7915-4fb2-b06a-0157d7471bef service placement] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:46:42.395351 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76d758-7915-4fb2-b06a-0157d7471bef service placement] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:46:42.398886 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c81a1a-1cd9-4447-aa26-0f15529e23ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:46:42.399519 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c81a1a-1cd9-4447-aa26-0f15529e23ed service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:46:42.399842 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c81a1a-1cd9-4447-aa26-0f15529e23ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:46:42.400120 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c81a1a-1cd9-4447-aa26-0f15529e23ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:46:42.401996 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-55c81a1a-1cd9-4447-aa26-0f15529e23ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:46:42.458180 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c81a1a-1cd9-4447-aa26-0f15529e23ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:46:42.459890 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c81a1a-1cd9-4447-aa26-0f15529e23ed service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:46:42.468540 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1215/2430] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:46:42 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:46:42.803943 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913099c6-71d6-438e-b034-e2c7556c0f3d service cinder] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:46:42.812966 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913099c6-71d6-438e-b034-e2c7556c0f3d service cinder] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:46:42.816523 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a748184-9e14-4f4b-ad8e-0c018d3eb0d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:46:42.817142 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a748184-9e14-4f4b-ad8e-0c018d3eb0d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:46:42.817422 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a748184-9e14-4f4b-ad8e-0c018d3eb0d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:46:42.817697 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a748184-9e14-4f4b-ad8e-0c018d3eb0d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:46:42.819454 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-5a748184-9e14-4f4b-ad8e-0c018d3eb0d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:46:42.828655 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a748184-9e14-4f4b-ad8e-0c018d3eb0d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:46:42.830067 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a748184-9e14-4f4b-ad8e-0c018d3eb0d9 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:46:42.838012 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1216/2431] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:46:42 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:48:25.133405 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c81a1a-1cd9-4447-aa26-0f15529e23ed service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:48:25.145466 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c81a1a-1cd9-4447-aa26-0f15529e23ed service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:48:25.150858 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5d2f3-f4fa-4e8d-862b-0f6d2856a396 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:48:25.151490 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5d2f3-f4fa-4e8d-862b-0f6d2856a396 service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:48:25.151801 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5d2f3-f4fa-4e8d-862b-0f6d2856a396 service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:48:25.152581 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5d2f3-f4fa-4e8d-862b-0f6d2856a396 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:48:25.160236 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5d2f3-f4fa-4e8d-862b-0f6d2856a396 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:48:25.161805 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5d2f3-f4fa-4e8d-862b-0f6d2856a396 service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:48:25.188406 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1216/2432] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:48:25 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:48:33.754825 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a748184-9e14-4f4b-ad8e-0c018d3eb0d9 service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:48:33.763639 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a748184-9e14-4f4b-ad8e-0c018d3eb0d9 service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:48:33.767176 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6dd58-855c-4039-b8a8-18fda8812fdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:48:33.767824 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6dd58-855c-4039-b8a8-18fda8812fdb service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:48:33.768107 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6dd58-855c-4039-b8a8-18fda8812fdb service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:48:33.768381 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6dd58-855c-4039-b8a8-18fda8812fdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:48:33.775803 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6dd58-855c-4039-b8a8-18fda8812fdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:48:33.777127 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6dd58-855c-4039-b8a8-18fda8812fdb service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:48:33.785087 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1217/2433] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:48:33 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 03:49:05.318627 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5d2f3-f4fa-4e8d-862b-0f6d2856a396 service nova] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:49:05.328038 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5d2f3-f4fa-4e8d-862b-0f6d2856a396 service nova] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:49:05.331548 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edc336-83b8-40ad-a7f4-8014c18af325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:49:05.332462 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edc336-83b8-40ad-a7f4-8014c18af325 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:49:05.332731 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edc336-83b8-40ad-a7f4-8014c18af325 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:49:05.333000 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edc336-83b8-40ad-a7f4-8014c18af325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:49:05.343344 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edc336-83b8-40ad-a7f4-8014c18af325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:49:05.344793 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edc336-83b8-40ad-a7f4-8014c18af325 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:49:05.355128 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1217/2434] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:49:05 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:49:06.508935 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6dd58-855c-4039-b8a8-18fda8812fdb service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:49:06.517141 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6dd58-855c-4039-b8a8-18fda8812fdb service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:49:06.520757 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4018b-19f4-4051-b568-b30515e31e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:49:06.521374 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4018b-19f4-4051-b568-b30515e31e5f service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:49:06.521653 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4018b-19f4-4051-b568-b30515e31e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:49:06.521929 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4018b-19f4-4051-b568-b30515e31e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:49:06.535358 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4018b-19f4-4051-b568-b30515e31e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:49:06.536891 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4018b-19f4-4051-b568-b30515e31e5f service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:49:06.548233 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1218/2435] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:49:06 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:49:43.829677 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edc336-83b8-40ad-a7f4-8014c18af325 service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:49:43.831084 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-b9edc336-83b8-40ad-a7f4-8014c18af325 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:49:43.855292 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edc336-83b8-40ad-a7f4-8014c18af325 service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:49:43.858848 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679ed0a-78c9-488c-98c1-589b0b06d081 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:49:43.859469 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679ed0a-78c9-488c-98c1-589b0b06d081 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:49:43.859780 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679ed0a-78c9-488c-98c1-589b0b06d081 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:49:43.860055 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679ed0a-78c9-488c-98c1-589b0b06d081 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:49:43.868093 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679ed0a-78c9-488c-98c1-589b0b06d081 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:49:43.869506 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679ed0a-78c9-488c-98c1-589b0b06d081 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:49:43.895448 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1218/2436] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:49:43 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:50:06.432339 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4018b-19f4-4051-b568-b30515e31e5f service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:50:06.443384 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4018b-19f4-4051-b568-b30515e31e5f service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:50:06.449665 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0be1fd-a47c-4bba-a720-e792caa2d16f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:50:06.450877 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0be1fd-a47c-4bba-a720-e792caa2d16f service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:50:06.451391 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0be1fd-a47c-4bba-a720-e792caa2d16f service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:50:06.451957 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0be1fd-a47c-4bba-a720-e792caa2d16f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:50:06.464315 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0be1fd-a47c-4bba-a720-e792caa2d16f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:50:06.466168 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0be1fd-a47c-4bba-a720-e792caa2d16f service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:50:06.490443 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1219/2437] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:50:06 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:50:09.615262 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679ed0a-78c9-488c-98c1-589b0b06d081 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:50:09.624435 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679ed0a-78c9-488c-98c1-589b0b06d081 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:50:09.628055 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dac9a4-87ec-4118-bfb5-5c5b80cec9da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:50:09.628683 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dac9a4-87ec-4118-bfb5-5c5b80cec9da service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:50:09.628965 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dac9a4-87ec-4118-bfb5-5c5b80cec9da service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:50:09.629237 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dac9a4-87ec-4118-bfb5-5c5b80cec9da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:50:09.637318 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dac9a4-87ec-4118-bfb5-5c5b80cec9da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:50:09.638738 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dac9a4-87ec-4118-bfb5-5c5b80cec9da service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:50:09.664706 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1219/2438] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:50:09 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:50:20.924843 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0be1fd-a47c-4bba-a720-e792caa2d16f service nova] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:50:20.935740 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0be1fd-a47c-4bba-a720-e792caa2d16f service nova] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:50:20.941167 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff726da-ac79-4b2d-a226-926cdedc9bf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:50:20.941816 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff726da-ac79-4b2d-a226-926cdedc9bf0 service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:50:20.942100 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff726da-ac79-4b2d-a226-926cdedc9bf0 service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:50:20.942402 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff726da-ac79-4b2d-a226-926cdedc9bf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:50:20.950035 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff726da-ac79-4b2d-a226-926cdedc9bf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:50:20.951589 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff726da-ac79-4b2d-a226-926cdedc9bf0 service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:50:20.978278 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1220/2439] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:50:20 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:51:42.631627 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dac9a4-87ec-4118-bfb5-5c5b80cec9da service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:51:42.699280 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dac9a4-87ec-4118-bfb5-5c5b80cec9da service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:51:42.702816 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e61f97-a094-438c-9757-f5e6d2edc758 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:51:42.703442 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e61f97-a094-438c-9757-f5e6d2edc758 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:51:42.703749 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e61f97-a094-438c-9757-f5e6d2edc758 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:51:42.704028 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e61f97-a094-438c-9757-f5e6d2edc758 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:51:42.706635 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-04e61f97-a094-438c-9757-f5e6d2edc758 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:51:42.806119 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e61f97-a094-438c-9757-f5e6d2edc758 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:51:42.807546 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e61f97-a094-438c-9757-f5e6d2edc758 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:51:42.824729 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1220/2440] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:51:42 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:51:43.039408 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff726da-ac79-4b2d-a226-926cdedc9bf0 service nova] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:51:43.040822 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-7ff726da-ac79-4b2d-a226-926cdedc9bf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:51:43.105138 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff726da-ac79-4b2d-a226-926cdedc9bf0 service nova] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:51:43.110243 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb566f-9461-47bb-b2c2-fb8cec3b1132 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bffc0480ffb942cdad426195eca0529e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:51:43.110876 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb566f-9461-47bb-b2c2-fb8cec3b1132 service placement] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:51:43.111153 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb566f-9461-47bb-b2c2-fb8cec3b1132 service placement] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:51:43.111426 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb566f-9461-47bb-b2c2-fb8cec3b1132 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:51:43.119942 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb566f-9461-47bb-b2c2-fb8cec3b1132 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:51:43.121538 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb566f-9461-47bb-b2c2-fb8cec3b1132 service placement] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:51:43.131816 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1221/2441] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:51:43 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:51:43.642728 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e61f97-a094-438c-9757-f5e6d2edc758 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:51:43.651784 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e61f97-a094-438c-9757-f5e6d2edc758 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:51:43.655595 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce7536-6a22-42a3-bbb1-a7d5f12145d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:51:43.659897 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce7536-6a22-42a3-bbb1-a7d5f12145d9 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:51:43.660183 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce7536-6a22-42a3-bbb1-a7d5f12145d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:51:43.660455 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce7536-6a22-42a3-bbb1-a7d5f12145d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:51:43.668867 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce7536-6a22-42a3-bbb1-a7d5f12145d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:51:43.670278 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce7536-6a22-42a3-bbb1-a7d5f12145d9 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:51:43.701663 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1221/2442] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:51:43 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:52:09.387847 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb566f-9461-47bb-b2c2-fb8cec3b1132 service placement] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:52:09.389644 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-4ecb566f-9461-47bb-b2c2-fb8cec3b1132 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:52:09.465799 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb566f-9461-47bb-b2c2-fb8cec3b1132 service placement] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:52:09.469332 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846aa84-3311-4f8f-bd8c-e92adee9fa62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:52:09.469959 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846aa84-3311-4f8f-bd8c-e92adee9fa62 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:52:09.470235 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846aa84-3311-4f8f-bd8c-e92adee9fa62 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:52:09.470508 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846aa84-3311-4f8f-bd8c-e92adee9fa62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:52:09.472315 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-c846aa84-3311-4f8f-bd8c-e92adee9fa62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:52:09.549474 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846aa84-3311-4f8f-bd8c-e92adee9fa62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:52:09.550882 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846aa84-3311-4f8f-bd8c-e92adee9fa62 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:52:09.568921 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1222/2443] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:52:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:52:16.113076 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce7536-6a22-42a3-bbb1-a7d5f12145d9 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:52:16.114466 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-a7ce7536-6a22-42a3-bbb1-a7d5f12145d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:52:16.128511 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce7536-6a22-42a3-bbb1-a7d5f12145d9 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:52:16.133219 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a14ed-f33f-4531-a561-096c550c06b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:52:16.134071 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a14ed-f33f-4531-a561-096c550c06b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:52:16.134353 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a14ed-f33f-4531-a561-096c550c06b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:52:16.134627 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a14ed-f33f-4531-a561-096c550c06b6 admin admin] PATH_INFO: `/v3/users/8eb29072473e4c198148b0059eb1bc3e` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:52:16.148716 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a14ed-f33f-4531-a561-096c550c06b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eb29072473e4c198148b0059eb1bc3e)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:52:16.150643 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a14ed-f33f-4531-a561-096c550c06b6 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:52:16.194236 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-3c7a14ed-f33f-4531-a561-096c550c06b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eb29072473e4c198148b0059eb1bc3e'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:16.206244 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-3c7a14ed-f33f-4531-a561-096c550c06b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eb29072473e4c198148b0059eb1bc3e'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:16.214015 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-3c7a14ed-f33f-4531-a561-096c550c06b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eb29072473e4c198148b0059eb1bc3e'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:16.214621 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-3c7a14ed-f33f-4531-a561-096c550c06b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eb29072473e4c198148b0059eb1bc3e'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:16.221392 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-3c7a14ed-f33f-4531-a561-096c550c06b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eb29072473e4c198148b0059eb1bc3e'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:16.227091 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1222/2444] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:52:16 2021] DELETE /identity/v3/users/8eb29072473e4c198148b0059eb1bc3e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:52:16.404126 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846aa84-3311-4f8f-bd8c-e92adee9fa62 service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:52:16.414529 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846aa84-3311-4f8f-bd8c-e92adee9fa62 service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:52:16.472417 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5edc48-4dbf-40d5-9bc6-611b37df6792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:52:16.473384 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5edc48-4dbf-40d5-9bc6-611b37df6792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:52:16.473664 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5edc48-4dbf-40d5-9bc6-611b37df6792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:52:16.473964 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5edc48-4dbf-40d5-9bc6-611b37df6792 admin admin] PATH_INFO: `/v3/projects/2e70b7afa65b45d19294e3a06917a51d` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:52:16.475324 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5edc48-4dbf-40d5-9bc6-611b37df6792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e70b7afa65b45d19294e3a06917a51d)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:52:16.477303 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5edc48-4dbf-40d5-9bc6-611b37df6792 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:52:16.521782 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2b5edc48-4dbf-40d5-9bc6-611b37df6792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e70b7afa65b45d19294e3a06917a51d', 'request_id': 'req-2b5edc48-4dbf-40d5-9bc6-611b37df6792'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:16.528015 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2b5edc48-4dbf-40d5-9bc6-611b37df6792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e70b7afa65b45d19294e3a06917a51d', 'request_id': 'req-2b5edc48-4dbf-40d5-9bc6-611b37df6792'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:16.533247 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2b5edc48-4dbf-40d5-9bc6-611b37df6792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e70b7afa65b45d19294e3a06917a51d', 'request_id': 'req-2b5edc48-4dbf-40d5-9bc6-611b37df6792'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:16.544727 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2b5edc48-4dbf-40d5-9bc6-611b37df6792 admin admin] The token cache is being invalidate because project 2e70b7afa65b45d19294e3a06917a51d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:52:16.545049 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2b5edc48-4dbf-40d5-9bc6-611b37df6792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:16.545673 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2b5edc48-4dbf-40d5-9bc6-611b37df6792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:16.547535 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1223/2445] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:52:16 2021] DELETE /identity/v3/projects/2e70b7afa65b45d19294e3a06917a51d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:52:16.552215 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a14ed-f33f-4531-a561-096c550c06b6 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:52:16.553698 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-3c7a14ed-f33f-4531-a561-096c550c06b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:52:16.567189 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a14ed-f33f-4531-a561-096c550c06b6 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:52:16.620206 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6abc34-8b18-45ab-a6b9-84716dd4cd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:52:16.621087 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6abc34-8b18-45ab-a6b9-84716dd4cd0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:52:16.621372 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6abc34-8b18-45ab-a6b9-84716dd4cd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:52:16.621649 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6abc34-8b18-45ab-a6b9-84716dd4cd0f admin admin] PATH_INFO: `/v3/users/e54d3715292b4eed888e8343437fcd6f` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:52:16.634738 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6abc34-8b18-45ab-a6b9-84716dd4cd0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e54d3715292b4eed888e8343437fcd6f)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:52:16.636710 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6abc34-8b18-45ab-a6b9-84716dd4cd0f admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:52:16.677873 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-2a6abc34-8b18-45ab-a6b9-84716dd4cd0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e54d3715292b4eed888e8343437fcd6f'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:16.688782 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-2a6abc34-8b18-45ab-a6b9-84716dd4cd0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e54d3715292b4eed888e8343437fcd6f'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:16.696113 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-2a6abc34-8b18-45ab-a6b9-84716dd4cd0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e54d3715292b4eed888e8343437fcd6f'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:16.696797 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-2a6abc34-8b18-45ab-a6b9-84716dd4cd0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e54d3715292b4eed888e8343437fcd6f'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:16.703390 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-2a6abc34-8b18-45ab-a6b9-84716dd4cd0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e54d3715292b4eed888e8343437fcd6f'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:16.709351 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1223/2446] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:52:16 2021] DELETE /identity/v3/users/e54d3715292b4eed888e8343437fcd6f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:52:16.880511 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5edc48-4dbf-40d5-9bc6-611b37df6792 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:52:16.881925 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-2b5edc48-4dbf-40d5-9bc6-611b37df6792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:52:16.895166 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5edc48-4dbf-40d5-9bc6-611b37df6792 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:52:16.949616 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b16340-dee9-4d34-9362-ae3f200a319d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:52:16.950492 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b16340-dee9-4d34-9362-ae3f200a319d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:52:16.950810 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b16340-dee9-4d34-9362-ae3f200a319d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:52:16.951082 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b16340-dee9-4d34-9362-ae3f200a319d admin admin] PATH_INFO: `/v3/projects/78920fdeaa5545bf8fa0473c9149aef3` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:52:16.961609 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b16340-dee9-4d34-9362-ae3f200a319d admin admin] RBAC: Authorizing `identity:delete_project(project_id=78920fdeaa5545bf8fa0473c9149aef3)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:52:16.963576 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b16340-dee9-4d34-9362-ae3f200a319d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:52:17.008155 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d5b16340-dee9-4d34-9362-ae3f200a319d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78920fdeaa5545bf8fa0473c9149aef3', 'request_id': 'req-d5b16340-dee9-4d34-9362-ae3f200a319d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:17.014371 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d5b16340-dee9-4d34-9362-ae3f200a319d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78920fdeaa5545bf8fa0473c9149aef3', 'request_id': 'req-d5b16340-dee9-4d34-9362-ae3f200a319d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:17.019819 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d5b16340-dee9-4d34-9362-ae3f200a319d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78920fdeaa5545bf8fa0473c9149aef3', 'request_id': 'req-d5b16340-dee9-4d34-9362-ae3f200a319d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:17.031670 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d5b16340-dee9-4d34-9362-ae3f200a319d admin admin] The token cache is being invalidate because project 78920fdeaa5545bf8fa0473c9149aef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:52:17.032001 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d5b16340-dee9-4d34-9362-ae3f200a319d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:17.032605 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d5b16340-dee9-4d34-9362-ae3f200a319d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:17.034977 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1224/2447] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:52:16 2021] DELETE /identity/v3/projects/78920fdeaa5545bf8fa0473c9149aef3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:52:43.371193 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6abc34-8b18-45ab-a6b9-84716dd4cd0f admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:52:43.372621 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-2a6abc34-8b18-45ab-a6b9-84716dd4cd0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:52:43.426898 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6abc34-8b18-45ab-a6b9-84716dd4cd0f admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:52:43.472809 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b170124-ee25-42e1-b622-3d2afe6eba2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:52:43.473448 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b170124-ee25-42e1-b622-3d2afe6eba2b service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:52:43.474295 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b170124-ee25-42e1-b622-3d2afe6eba2b service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:52:43.474572 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b170124-ee25-42e1-b622-3d2afe6eba2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:52:43.476358 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7b170124-ee25-42e1-b622-3d2afe6eba2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:52:43.535271 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b170124-ee25-42e1-b622-3d2afe6eba2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:52:43.537312 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b170124-ee25-42e1-b622-3d2afe6eba2b service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:52:43.546580 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1224/2448] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:52:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:52:49.790962 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b16340-dee9-4d34-9362-ae3f200a319d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:52:49.792504 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-d5b16340-dee9-4d34-9362-ae3f200a319d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:52:49.808182 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b16340-dee9-4d34-9362-ae3f200a319d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:52:49.812793 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47017a69-b3bf-45b3-8c5c-cf91437ddb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:52:49.813645 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47017a69-b3bf-45b3-8c5c-cf91437ddb9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:52:49.813923 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47017a69-b3bf-45b3-8c5c-cf91437ddb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:52:49.814198 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47017a69-b3bf-45b3-8c5c-cf91437ddb9e admin admin] PATH_INFO: `/v3/users/d1bb22a3461a47e5afeb229038cb4a8d` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:52:49.827988 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47017a69-b3bf-45b3-8c5c-cf91437ddb9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1bb22a3461a47e5afeb229038cb4a8d)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:52:49.830144 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47017a69-b3bf-45b3-8c5c-cf91437ddb9e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:52:49.871616 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-47017a69-b3bf-45b3-8c5c-cf91437ddb9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1bb22a3461a47e5afeb229038cb4a8d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:49.883276 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-47017a69-b3bf-45b3-8c5c-cf91437ddb9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1bb22a3461a47e5afeb229038cb4a8d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:49.889915 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-47017a69-b3bf-45b3-8c5c-cf91437ddb9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1bb22a3461a47e5afeb229038cb4a8d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:49.890670 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-47017a69-b3bf-45b3-8c5c-cf91437ddb9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1bb22a3461a47e5afeb229038cb4a8d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:49.897924 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-47017a69-b3bf-45b3-8c5c-cf91437ddb9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1bb22a3461a47e5afeb229038cb4a8d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:49.903642 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1225/2449] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:52:49 2021] DELETE /identity/v3/users/d1bb22a3461a47e5afeb229038cb4a8d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:52:50.071477 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b170124-ee25-42e1-b622-3d2afe6eba2b service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:52:50.082978 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b170124-ee25-42e1-b622-3d2afe6eba2b service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:52:50.137563 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faab73d-82fe-444e-8264-1a8bb3ac5c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:52:50.138430 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faab73d-82fe-444e-8264-1a8bb3ac5c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:52:50.138712 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faab73d-82fe-444e-8264-1a8bb3ac5c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:52:50.138986 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faab73d-82fe-444e-8264-1a8bb3ac5c2d admin admin] PATH_INFO: `/v3/projects/de088af04e804d909ae6daa141302d4c` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:52:50.140201 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faab73d-82fe-444e-8264-1a8bb3ac5c2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=de088af04e804d909ae6daa141302d4c)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:52:50.142121 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faab73d-82fe-444e-8264-1a8bb3ac5c2d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:52:50.186424 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7faab73d-82fe-444e-8264-1a8bb3ac5c2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de088af04e804d909ae6daa141302d4c', 'request_id': 'req-7faab73d-82fe-444e-8264-1a8bb3ac5c2d'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:50.192850 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7faab73d-82fe-444e-8264-1a8bb3ac5c2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de088af04e804d909ae6daa141302d4c', 'request_id': 'req-7faab73d-82fe-444e-8264-1a8bb3ac5c2d'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:50.198086 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7faab73d-82fe-444e-8264-1a8bb3ac5c2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de088af04e804d909ae6daa141302d4c', 'request_id': 'req-7faab73d-82fe-444e-8264-1a8bb3ac5c2d'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:50.209669 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7faab73d-82fe-444e-8264-1a8bb3ac5c2d admin admin] The token cache is being invalidate because project de088af04e804d909ae6daa141302d4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:52:50.209958 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7faab73d-82fe-444e-8264-1a8bb3ac5c2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:50.210575 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7faab73d-82fe-444e-8264-1a8bb3ac5c2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:50.212109 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1225/2450] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:52:50 2021] DELETE /identity/v3/projects/de088af04e804d909ae6daa141302d4c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 03:52:50.216054 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47017a69-b3bf-45b3-8c5c-cf91437ddb9e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:52:50.217429 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-47017a69-b3bf-45b3-8c5c-cf91437ddb9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:52:50.230041 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47017a69-b3bf-45b3-8c5c-cf91437ddb9e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:52:50.284274 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22d1ac-fc6c-4a0e-87ca-d79b145d141e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:52:50.285057 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22d1ac-fc6c-4a0e-87ca-d79b145d141e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:52:50.285335 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22d1ac-fc6c-4a0e-87ca-d79b145d141e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:52:50.285605 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22d1ac-fc6c-4a0e-87ca-d79b145d141e admin admin] PATH_INFO: `/v3/users/1a77645ba4534892a7ee7d5f44e391f7` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:52:50.299231 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22d1ac-fc6c-4a0e-87ca-d79b145d141e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a77645ba4534892a7ee7d5f44e391f7)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:52:50.301211 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22d1ac-fc6c-4a0e-87ca-d79b145d141e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:52:50.343629 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-fc22d1ac-fc6c-4a0e-87ca-d79b145d141e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a77645ba4534892a7ee7d5f44e391f7'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:50.354641 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-fc22d1ac-fc6c-4a0e-87ca-d79b145d141e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a77645ba4534892a7ee7d5f44e391f7'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:50.361370 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-fc22d1ac-fc6c-4a0e-87ca-d79b145d141e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a77645ba4534892a7ee7d5f44e391f7'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:50.362005 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-fc22d1ac-fc6c-4a0e-87ca-d79b145d141e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a77645ba4534892a7ee7d5f44e391f7'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:50.369064 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-fc22d1ac-fc6c-4a0e-87ca-d79b145d141e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a77645ba4534892a7ee7d5f44e391f7'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:50.374751 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1226/2451] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:52:50 2021] DELETE /identity/v3/users/1a77645ba4534892a7ee7d5f44e391f7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:52:50.543312 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faab73d-82fe-444e-8264-1a8bb3ac5c2d admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:52:50.544833 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7faab73d-82fe-444e-8264-1a8bb3ac5c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:52:50.561206 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faab73d-82fe-444e-8264-1a8bb3ac5c2d admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:52:50.620672 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5695eb-28b2-46be-8fd5-fa1895018f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:52:50.621512 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5695eb-28b2-46be-8fd5-fa1895018f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:52:50.621789 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5695eb-28b2-46be-8fd5-fa1895018f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:52:50.622058 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5695eb-28b2-46be-8fd5-fa1895018f24 admin admin] PATH_INFO: `/v3/projects/d4337b1475c94aa98b10e013f36b3ce0` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:52:50.631903 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5695eb-28b2-46be-8fd5-fa1895018f24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4337b1475c94aa98b10e013f36b3ce0)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:52:50.633814 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5695eb-28b2-46be-8fd5-fa1895018f24 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:52:50.676453 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-ae5695eb-28b2-46be-8fd5-fa1895018f24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4337b1475c94aa98b10e013f36b3ce0', 'request_id': 'req-ae5695eb-28b2-46be-8fd5-fa1895018f24'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:50.683191 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-ae5695eb-28b2-46be-8fd5-fa1895018f24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4337b1475c94aa98b10e013f36b3ce0', 'request_id': 'req-ae5695eb-28b2-46be-8fd5-fa1895018f24'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:50.689639 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-ae5695eb-28b2-46be-8fd5-fa1895018f24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4337b1475c94aa98b10e013f36b3ce0', 'request_id': 'req-ae5695eb-28b2-46be-8fd5-fa1895018f24'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:50.702317 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-ae5695eb-28b2-46be-8fd5-fa1895018f24 admin admin] The token cache is being invalidate because project d4337b1475c94aa98b10e013f36b3ce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:52:50.702608 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-ae5695eb-28b2-46be-8fd5-fa1895018f24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:50.703361 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-ae5695eb-28b2-46be-8fd5-fa1895018f24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:52:50.705370 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1226/2452] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:52:50 2021] DELETE /identity/v3/projects/d4337b1475c94aa98b10e013f36b3ce0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:53:24.319182 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22d1ac-fc6c-4a0e-87ca-d79b145d141e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:53:24.320706 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-fc22d1ac-fc6c-4a0e-87ca-d79b145d141e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:53:24.375668 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22d1ac-fc6c-4a0e-87ca-d79b145d141e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:53:24.420008 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ef99e-ccaf-4ec9-adf9-2cc42bf60f3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:53:24.420643 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ef99e-ccaf-4ec9-adf9-2cc42bf60f3c service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:53:24.420922 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ef99e-ccaf-4ec9-adf9-2cc42bf60f3c service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:53:24.421189 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ef99e-ccaf-4ec9-adf9-2cc42bf60f3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:53:24.422973 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-762ef99e-ccaf-4ec9-adf9-2cc42bf60f3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:53:24.489633 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ef99e-ccaf-4ec9-adf9-2cc42bf60f3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:53:24.491049 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ef99e-ccaf-4ec9-adf9-2cc42bf60f3c service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:53:24.499956 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1227/2453] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:53:24 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:53:36.744554 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5695eb-28b2-46be-8fd5-fa1895018f24 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:53:36.745995 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-ae5695eb-28b2-46be-8fd5-fa1895018f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:53:36.799523 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5695eb-28b2-46be-8fd5-fa1895018f24 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:53:36.803553 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbb85c-85b7-4c51-848a-43af8856bf7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:53:36.804208 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbb85c-85b7-4c51-848a-43af8856bf7d service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:53:36.804489 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbb85c-85b7-4c51-848a-43af8856bf7d service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:53:36.804764 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbb85c-85b7-4c51-848a-43af8856bf7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:53:36.806471 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-71bbb85c-85b7-4c51-848a-43af8856bf7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:53:36.815500 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbb85c-85b7-4c51-848a-43af8856bf7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:53:36.816950 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbb85c-85b7-4c51-848a-43af8856bf7d service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:53:36.825295 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1227/2454] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:53:36 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:54:05.569395 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ef99e-ccaf-4ec9-adf9-2cc42bf60f3c service cinder] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:54:05.578652 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ef99e-ccaf-4ec9-adf9-2cc42bf60f3c service cinder] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:54:05.582487 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aed3b6-d56e-4ae6-8f71-8e0a7e7bcb5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:54:05.583116 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aed3b6-d56e-4ae6-8f71-8e0a7e7bcb5d service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:54:05.583392 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aed3b6-d56e-4ae6-8f71-8e0a7e7bcb5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:54:05.583658 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aed3b6-d56e-4ae6-8f71-8e0a7e7bcb5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:54:05.585407 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-e7aed3b6-d56e-4ae6-8f71-8e0a7e7bcb5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:54:05.670235 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aed3b6-d56e-4ae6-8f71-8e0a7e7bcb5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:54:05.671668 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aed3b6-d56e-4ae6-8f71-8e0a7e7bcb5d service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:54:05.691757 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1228/2455] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:54:05 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:54:06.789487 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbb85c-85b7-4c51-848a-43af8856bf7d service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:54:06.797748 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbb85c-85b7-4c51-848a-43af8856bf7d service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:54:06.801343 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf0b4e-4eaa-4c3e-a171-8bcabe4d4e66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:54:06.802468 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf0b4e-4eaa-4c3e-a171-8bcabe4d4e66 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:54:06.802745 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf0b4e-4eaa-4c3e-a171-8bcabe4d4e66 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:54:06.803012 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf0b4e-4eaa-4c3e-a171-8bcabe4d4e66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:54:06.804750 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c0cf0b4e-4eaa-4c3e-a171-8bcabe4d4e66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:54:06.817995 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf0b4e-4eaa-4c3e-a171-8bcabe4d4e66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:54:06.819402 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf0b4e-4eaa-4c3e-a171-8bcabe4d4e66 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:54:06.830189 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1228/2456] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:54:06 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:55:49.092055 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aed3b6-d56e-4ae6-8f71-8e0a7e7bcb5d service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:55:49.093414 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-e7aed3b6-d56e-4ae6-8f71-8e0a7e7bcb5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:55:49.104792 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aed3b6-d56e-4ae6-8f71-8e0a7e7bcb5d service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:55:49.108360 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3bae2-db7c-4cc9-8127-eb6e127e7a9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:55:49.108998 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3bae2-db7c-4cc9-8127-eb6e127e7a9f service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:55:49.109277 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3bae2-db7c-4cc9-8127-eb6e127e7a9f service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:55:49.109550 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3bae2-db7c-4cc9-8127-eb6e127e7a9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:55:49.111360 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-8bb3bae2-db7c-4cc9-8127-eb6e127e7a9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:55:49.188105 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3bae2-db7c-4cc9-8127-eb6e127e7a9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:55:49.189540 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3bae2-db7c-4cc9-8127-eb6e127e7a9f service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:55:49.199577 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1229/2457] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:55:49 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:56:43.645191 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf0b4e-4eaa-4c3e-a171-8bcabe4d4e66 service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:56:43.664511 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf0b4e-4eaa-4c3e-a171-8bcabe4d4e66 service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:56:43.668183 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c1da1-7158-4aa6-9e89-1c713734fa04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:56:43.668815 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c1da1-7158-4aa6-9e89-1c713734fa04 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:56:43.669098 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c1da1-7158-4aa6-9e89-1c713734fa04 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:56:43.669375 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c1da1-7158-4aa6-9e89-1c713734fa04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:56:43.671130 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-541c1da1-7158-4aa6-9e89-1c713734fa04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:56:43.726735 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c1da1-7158-4aa6-9e89-1c713734fa04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:56:43.728213 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c1da1-7158-4aa6-9e89-1c713734fa04 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:56:43.737184 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1229/2458] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:56:43 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:56:43.818664 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3bae2-db7c-4cc9-8127-eb6e127e7a9f service cinder] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:56:43.820073 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-8bb3bae2-db7c-4cc9-8127-eb6e127e7a9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:56:43.885626 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3bae2-db7c-4cc9-8127-eb6e127e7a9f service cinder] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:56:43.890600 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d569e-c6dd-4002-9e9c-91dd8a0d164d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bffc0480ffb942cdad426195eca0529e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:56:43.891225 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d569e-c6dd-4002-9e9c-91dd8a0d164d service placement] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:56:43.891502 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d569e-c6dd-4002-9e9c-91dd8a0d164d service placement] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:56:43.891805 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d569e-c6dd-4002-9e9c-91dd8a0d164d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:56:43.893530 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-372d569e-c6dd-4002-9e9c-91dd8a0d164d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:56:43.904985 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d569e-c6dd-4002-9e9c-91dd8a0d164d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:56:43.906518 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d569e-c6dd-4002-9e9c-91dd8a0d164d service placement] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:56:43.915974 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1230/2459] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:56:43 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:56:44.056688 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c1da1-7158-4aa6-9e89-1c713734fa04 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:56:44.065027 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c1da1-7158-4aa6-9e89-1c713734fa04 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:56:44.069475 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17ae06-96e1-4b8e-8882-09b841349f25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:56:44.070109 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17ae06-96e1-4b8e-8882-09b841349f25 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:56:44.070391 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17ae06-96e1-4b8e-8882-09b841349f25 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:56:44.070661 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17ae06-96e1-4b8e-8882-09b841349f25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:56:44.072434 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-9b17ae06-96e1-4b8e-8882-09b841349f25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:56:44.142255 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17ae06-96e1-4b8e-8882-09b841349f25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:56:44.143746 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17ae06-96e1-4b8e-8882-09b841349f25 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:56:44.154425 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1230/2460] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:56:44 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:56:47.440586 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c56afa-4115-405e-a7c4-28d1c6c9f3be None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:56:47.441054 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c56afa-4115-405e-a7c4-28d1c6c9f3be None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:56:47.441170 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c56afa-4115-405e-a7c4-28d1c6c9f3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:56:47.467058 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-d0c56afa-4115-405e-a7c4-28d1c6c9f3be None None] MFA Rules not processed for user `d795b4264cbe4aff82f5a2b0275ca972`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:56:47.468287 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-d0c56afa-4115-405e-a7c4-28d1c6c9f3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:56:47.475728 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1231/2461] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:56:47 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:56:47.769531 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17ae06-96e1-4b8e-8882-09b841349f25 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:56:47.779039 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17ae06-96e1-4b8e-8882-09b841349f25 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:56:47.782546 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991872ba-6e80-4c3d-a017-a6df39359439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:56:47.783175 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991872ba-6e80-4c3d-a017-a6df39359439 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:56:47.783456 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991872ba-6e80-4c3d-a017-a6df39359439 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:56:47.783766 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991872ba-6e80-4c3d-a017-a6df39359439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:56:47.786018 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-991872ba-6e80-4c3d-a017-a6df39359439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:56:47.798130 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991872ba-6e80-4c3d-a017-a6df39359439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:56:47.799560 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991872ba-6e80-4c3d-a017-a6df39359439 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:56:47.808199 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1231/2462] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:56:47 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:56:48.129106 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c56afa-4115-405e-a7c4-28d1c6c9f3be None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:56:48.130582 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-d0c56afa-4115-405e-a7c4-28d1c6c9f3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:56:48.145436 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c56afa-4115-405e-a7c4-28d1c6c9f3be None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:56:48.151220 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8724b-0971-4dd1-bc4b-578ca4fcf808 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bffc0480ffb942cdad426195eca0529e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:56:48.151920 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8724b-0971-4dd1-bc4b-578ca4fcf808 service placement] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:56:48.152207 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8724b-0971-4dd1-bc4b-578ca4fcf808 service placement] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:56:48.152480 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8724b-0971-4dd1-bc4b-578ca4fcf808 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:56:48.154316 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-e8f8724b-0971-4dd1-bc4b-578ca4fcf808 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:56:48.166801 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8724b-0971-4dd1-bc4b-578ca4fcf808 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:56:48.168503 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8724b-0971-4dd1-bc4b-578ca4fcf808 service placement] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:56:48.178341 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1232/2463] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:56:48 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:56:50.381890 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991872ba-6e80-4c3d-a017-a6df39359439 service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:56:50.383500 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-991872ba-6e80-4c3d-a017-a6df39359439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:56:50.416689 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991872ba-6e80-4c3d-a017-a6df39359439 service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:56:50.424199 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a08f3-1818-4501-a9c7-849ab8a45879 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:56:50.424956 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a08f3-1818-4501-a9c7-849ab8a45879 service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:56:50.425314 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a08f3-1818-4501-a9c7-849ab8a45879 service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:56:50.425664 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a08f3-1818-4501-a9c7-849ab8a45879 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:56:50.429196 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-102a08f3-1818-4501-a9c7-849ab8a45879 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:56:50.443349 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a08f3-1818-4501-a9c7-849ab8a45879 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:56:50.445299 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a08f3-1818-4501-a9c7-849ab8a45879 service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:56:50.462189 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1232/2464] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:56:50 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:56:55.460835 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8724b-0971-4dd1-bc4b-578ca4fcf808 service placement] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:56:55.477232 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8724b-0971-4dd1-bc4b-578ca4fcf808 service placement] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:56:55.482762 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1db72-6731-48b9-bb11-6d648aad6b3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:56:55.483406 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1db72-6731-48b9-bb11-6d648aad6b3e service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:56:55.483709 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1db72-6731-48b9-bb11-6d648aad6b3e service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:56:55.483991 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1db72-6731-48b9-bb11-6d648aad6b3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:56:55.485748 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-94d1db72-6731-48b9-bb11-6d648aad6b3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:56:55.498641 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1db72-6731-48b9-bb11-6d648aad6b3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:56:55.500244 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1db72-6731-48b9-bb11-6d648aad6b3e service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:56:55.510835 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1233/2465] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:56:55 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:58:25.274432 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a08f3-1818-4501-a9c7-849ab8a45879 service nova] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:58:25.276432 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-102a08f3-1818-4501-a9c7-849ab8a45879 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:58:25.287428 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a08f3-1818-4501-a9c7-849ab8a45879 service nova] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:58:25.291080 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069bc3c-b4b7-41fb-85d5-eb70073a2fc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:58:25.291728 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069bc3c-b4b7-41fb-85d5-eb70073a2fc7 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:58:25.292002 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069bc3c-b4b7-41fb-85d5-eb70073a2fc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:58:25.292273 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069bc3c-b4b7-41fb-85d5-eb70073a2fc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:58:25.300452 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069bc3c-b4b7-41fb-85d5-eb70073a2fc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:58:25.301864 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069bc3c-b4b7-41fb-85d5-eb70073a2fc7 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:58:25.328090 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1233/2466] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:58:25 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:58:38.734111 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1db72-6731-48b9-bb11-6d648aad6b3e service nova] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:58:38.743128 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1db72-6731-48b9-bb11-6d648aad6b3e service nova] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:58:38.746692 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7f480-22c2-49dd-b9a8-7217f72bf13f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:58:38.747314 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7f480-22c2-49dd-b9a8-7217f72bf13f service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:58:38.747594 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7f480-22c2-49dd-b9a8-7217f72bf13f service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:58:38.747897 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7f480-22c2-49dd-b9a8-7217f72bf13f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:58:38.754727 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7f480-22c2-49dd-b9a8-7217f72bf13f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:58:38.756180 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7f480-22c2-49dd-b9a8-7217f72bf13f service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:58:38.764532 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1234/2467] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:58:38 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:59:44.546217 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069bc3c-b4b7-41fb-85d5-eb70073a2fc7 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:59:44.547619 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-8069bc3c-b4b7-41fb-85d5-eb70073a2fc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:59:44.610574 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069bc3c-b4b7-41fb-85d5-eb70073a2fc7 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:59:44.615125 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711bb4f-54ac-4b98-a968-20bc7c65b504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:59:44.616000 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711bb4f-54ac-4b98-a968-20bc7c65b504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:59:44.616289 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711bb4f-54ac-4b98-a968-20bc7c65b504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:59:44.616562 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711bb4f-54ac-4b98-a968-20bc7c65b504 admin admin] PATH_INFO: `/v3/users/4c12dd821c58420195e0de839688893c` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:59:44.617741 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711bb4f-54ac-4b98-a968-20bc7c65b504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c12dd821c58420195e0de839688893c)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:59:44.619638 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711bb4f-54ac-4b98-a968-20bc7c65b504 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:59:44.663778 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a711bb4f-54ac-4b98-a968-20bc7c65b504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c12dd821c58420195e0de839688893c'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:59:44.674674 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a711bb4f-54ac-4b98-a968-20bc7c65b504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c12dd821c58420195e0de839688893c'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:59:44.680838 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a711bb4f-54ac-4b98-a968-20bc7c65b504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c12dd821c58420195e0de839688893c'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:59:44.681514 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a711bb4f-54ac-4b98-a968-20bc7c65b504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c12dd821c58420195e0de839688893c'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:59:44.688511 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a711bb4f-54ac-4b98-a968-20bc7c65b504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c12dd821c58420195e0de839688893c'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:59:44.694127 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1234/2468] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 03:59:44 2021] DELETE /identity/v3/users/4c12dd821c58420195e0de839688893c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:59:44.699208 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b2ca0-9744-4a91-8842-e08fe3736f88 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:59:44.699725 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b2ca0-9744-4a91-8842-e08fe3736f88 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:59:44.699834 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b2ca0-9744-4a91-8842-e08fe3736f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:59:44.725861 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-bf6b2ca0-9744-4a91-8842-e08fe3736f88 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:59:44.726487 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-bf6b2ca0-9744-4a91-8842-e08fe3736f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:59:44.783355 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1235/2469] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:59:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:59:44.795311 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711bb4f-54ac-4b98-a968-20bc7c65b504 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:59:44.796803 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-a711bb4f-54ac-4b98-a968-20bc7c65b504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:59:44.852309 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711bb4f-54ac-4b98-a968-20bc7c65b504 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:59:44.856474 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358ece2-5cea-47c0-a3f0-9ff8127b468c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:59:44.857116 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358ece2-5cea-47c0-a3f0-9ff8127b468c service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:59:44.857397 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358ece2-5cea-47c0-a3f0-9ff8127b468c service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:59:44.857670 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358ece2-5cea-47c0-a3f0-9ff8127b468c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:59:44.866420 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358ece2-5cea-47c0-a3f0-9ff8127b468c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:59:44.867879 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358ece2-5cea-47c0-a3f0-9ff8127b468c service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:59:44.877590 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1235/2470] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:59:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 03:59:45.130564 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b2ca0-9744-4a91-8842-e08fe3736f88 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:59:45.132375 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-bf6b2ca0-9744-4a91-8842-e08fe3736f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:59:45.144794 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b2ca0-9744-4a91-8842-e08fe3736f88 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:59:45.150037 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b146c7-ce80-4b36-9a92-060d4aa0128b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:59:45.150891 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b146c7-ce80-4b36-9a92-060d4aa0128b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:59:45.151159 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b146c7-ce80-4b36-9a92-060d4aa0128b admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:59:45.151560 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b146c7-ce80-4b36-9a92-060d4aa0128b admin admin] PATH_INFO: `/v3/projects/e361efb4da2949b0af447c5239c102c8` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:59:45.152790 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b146c7-ce80-4b36-9a92-060d4aa0128b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e361efb4da2949b0af447c5239c102c8)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:59:45.154755 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b146c7-ce80-4b36-9a92-060d4aa0128b admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:59:45.199904 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-55b146c7-ce80-4b36-9a92-060d4aa0128b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e361efb4da2949b0af447c5239c102c8', 'request_id': 'req-55b146c7-ce80-4b36-9a92-060d4aa0128b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:59:45.206066 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-55b146c7-ce80-4b36-9a92-060d4aa0128b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e361efb4da2949b0af447c5239c102c8', 'request_id': 'req-55b146c7-ce80-4b36-9a92-060d4aa0128b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:59:45.211330 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-55b146c7-ce80-4b36-9a92-060d4aa0128b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e361efb4da2949b0af447c5239c102c8', 'request_id': 'req-55b146c7-ce80-4b36-9a92-060d4aa0128b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:59:45.223405 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-55b146c7-ce80-4b36-9a92-060d4aa0128b admin admin] The token cache is being invalidate because project e361efb4da2949b0af447c5239c102c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 03:59:45.223793 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-55b146c7-ce80-4b36-9a92-060d4aa0128b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:59:45.224511 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-55b146c7-ce80-4b36-9a92-060d4aa0128b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 03:59:45.226017 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1236/2471] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 03:59:45 2021] DELETE /identity/v3/projects/e361efb4da2949b0af447c5239c102c8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:59:45.233583 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09216c-24a1-48a5-af75-8004babd63e9 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:59:45.233868 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09216c-24a1-48a5-af75-8004babd63e9 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:59:45.234146 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09216c-24a1-48a5-af75-8004babd63e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:59:45.280070 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-7b09216c-24a1-48a5-af75-8004babd63e9 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:59:45.281195 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7b09216c-24a1-48a5-af75-8004babd63e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:59:45.335442 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1236/2472] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:59:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:59:45.343864 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f151a-8b09-4653-ae23-6c56efe2c53b None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:59:45.344154 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f151a-8b09-4653-ae23-6c56efe2c53b None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:59:45.344433 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f151a-8b09-4653-ae23-6c56efe2c53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:59:45.363007 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-ef4f151a-8b09-4653-ae23-6c56efe2c53b None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:59:45.364240 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-ef4f151a-8b09-4653-ae23-6c56efe2c53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:59:45.372052 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1237/2473] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:59:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:59:45.376021 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09216c-24a1-48a5-af75-8004babd63e9 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:59:45.385249 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09216c-24a1-48a5-af75-8004babd63e9 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:59:45.390040 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b0c28-2f10-4412-9331-427faa478111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:59:45.390685 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b0c28-2f10-4412-9331-427faa478111 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:59:45.390973 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b0c28-2f10-4412-9331-427faa478111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:59:45.391250 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b0c28-2f10-4412-9331-427faa478111 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:59:45.392012 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b0c28-2f10-4412-9331-427faa478111 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 03:59:45.392322 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b0c28-2f10-4412-9331-427faa478111 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:59:45.393929 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b0c28-2f10-4412-9331-427faa478111 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:59:45.405618 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1237/2474] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 03:59:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 03:59:45.409539 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f151a-8b09-4653-ae23-6c56efe2c53b None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:59:45.418972 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f151a-8b09-4653-ae23-6c56efe2c53b None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:59:45.423604 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a2ff9-7c7e-435f-a7db-9381813b7de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:59:45.424289 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a2ff9-7c7e-435f-a7db-9381813b7de8 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:59:45.424578 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a2ff9-7c7e-435f-a7db-9381813b7de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:59:45.424845 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a2ff9-7c7e-435f-a7db-9381813b7de8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:59:45.425544 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a2ff9-7c7e-435f-a7db-9381813b7de8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:59:45.427411 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a2ff9-7c7e-435f-a7db-9381813b7de8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:59:45.460595 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1238/2475] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 03:59:45 2021] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 03:59:45.465003 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b0c28-2f10-4412-9331-427faa478111 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:59:45.474507 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b0c28-2f10-4412-9331-427faa478111 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:59:45.527871 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1128e8-817b-41fa-b009-7ae8037a35ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:59:45.528535 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1128e8-817b-41fa-b009-7ae8037a35ea admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:59:45.528814 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1128e8-817b-41fa-b009-7ae8037a35ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:59:45.529088 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1128e8-817b-41fa-b009-7ae8037a35ea admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:59:45.529777 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1128e8-817b-41fa-b009-7ae8037a35ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:59:45.531968 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1128e8-817b-41fa-b009-7ae8037a35ea admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:59:45.558225 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1238/2476] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 03:59:45 2021] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 03:59:45.562733 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a2ff9-7c7e-435f-a7db-9381813b7de8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:59:45.573115 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a2ff9-7c7e-435f-a7db-9381813b7de8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:59:45.578603 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add8d21-ee01-47a2-a966-8aad4bb76b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:59:45.579255 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add8d21-ee01-47a2-a966-8aad4bb76b5d admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:59:45.579536 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add8d21-ee01-47a2-a966-8aad4bb76b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:59:45.579843 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add8d21-ee01-47a2-a966-8aad4bb76b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:59:45.580598 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add8d21-ee01-47a2-a966-8aad4bb76b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:59:45.582216 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add8d21-ee01-47a2-a966-8aad4bb76b5d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:59:45.592427 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1239/2477] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:59:45 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:59:45.596133 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1128e8-817b-41fa-b009-7ae8037a35ea admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:59:45.606215 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1128e8-817b-41fa-b009-7ae8037a35ea admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:59:45.610887 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a567a-01a4-4e0a-99d2-2d49923b31e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:59:45.611535 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a567a-01a4-4e0a-99d2-2d49923b31e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:59:45.611847 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a567a-01a4-4e0a-99d2-2d49923b31e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:59:45.612124 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a567a-01a4-4e0a-99d2-2d49923b31e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:59:45.612850 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a567a-01a4-4e0a-99d2-2d49923b31e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:59:45.614430 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a567a-01a4-4e0a-99d2-2d49923b31e3 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:59:45.624238 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1239/2478] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 03:59:45 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 03:59:45.628376 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add8d21-ee01-47a2-a966-8aad4bb76b5d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:59:45.638756 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add8d21-ee01-47a2-a966-8aad4bb76b5d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:59:45.643428 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c216cf-344b-49f4-9203-0d77507caafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:59:45.644271 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c216cf-344b-49f4-9203-0d77507caafa admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:59:45.644554 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c216cf-344b-49f4-9203-0d77507caafa admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:59:45.644830 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c216cf-344b-49f4-9203-0d77507caafa admin admin] PATH_INFO: `/v3/projects/8e5b6c5cb46e4a50b8c6ed9ca9dd9297/users/185b5670a99947a6baebb4d252e7722f/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:59:45.659788 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c216cf-344b-49f4-9203-0d77507caafa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5b6c5cb46e4a50b8c6ed9ca9dd9297, user_id=185b5670a99947a6baebb4d252e7722f, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:59:45.662465 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c216cf-344b-49f4-9203-0d77507caafa admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:59:45.674674 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1240/2479] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 03:59:45 2021] PUT /identity/v3/projects/8e5b6c5cb46e4a50b8c6ed9ca9dd9297/users/185b5670a99947a6baebb4d252e7722f/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 03:59:45.685486 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d8af2-7a97-4887-becf-8aad972701d9 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:59:45.685776 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d8af2-7a97-4887-becf-8aad972701d9 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:59:45.686052 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d8af2-7a97-4887-becf-8aad972701d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:59:45.711662 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-753d8af2-7a97-4887-becf-8aad972701d9 None None] MFA Rules not processed for user `185b5670a99947a6baebb4d252e7722f`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 03:59:45.712860 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-753d8af2-7a97-4887-becf-8aad972701d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:59:45.772951 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1240/2480] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 03:59:45 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 03:59:45.783287 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c216cf-344b-49f4-9203-0d77507caafa admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 03:59:45.784885 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-98c216cf-344b-49f4-9203-0d77507caafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 03:59:45.850455 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c216cf-344b-49f4-9203-0d77507caafa admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 03:59:45.854118 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a847ee-ef3e-4d77-84a5-7dc490d64912 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 03:59:45.854773 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a847ee-ef3e-4d77-84a5-7dc490d64912 service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 03:59:45.855058 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a847ee-ef3e-4d77-84a5-7dc490d64912 service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 03:59:45.855339 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a847ee-ef3e-4d77-84a5-7dc490d64912 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 03:59:45.865234 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a847ee-ef3e-4d77-84a5-7dc490d64912 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 03:59:45.866664 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a847ee-ef3e-4d77-84a5-7dc490d64912 service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 03:59:45.875278 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1241/2481] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 03:59:45 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:00:49.503892 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d8af2-7a97-4887-becf-8aad972701d9 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:00:49.513388 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d8af2-7a97-4887-becf-8aad972701d9 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:00:49.517114 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac2637-db96-4ddb-9739-dd5f7b179ac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:00:49.517745 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac2637-db96-4ddb-9739-dd5f7b179ac3 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:00:49.518030 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac2637-db96-4ddb-9739-dd5f7b179ac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:00:49.518302 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac2637-db96-4ddb-9739-dd5f7b179ac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:00:49.520077 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c5ac2637-db96-4ddb-9739-dd5f7b179ac3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:00:49.585131 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac2637-db96-4ddb-9739-dd5f7b179ac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:00:49.586556 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac2637-db96-4ddb-9739-dd5f7b179ac3 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:00:49.604364 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1241/2482] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:00:49 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:01:43.499720 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a847ee-ef3e-4d77-84a5-7dc490d64912 service cinder] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:01:43.517900 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a847ee-ef3e-4d77-84a5-7dc490d64912 service cinder] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:01:43.521493 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df114d-912c-4ccf-9f68-097c9617ef1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:01:43.522123 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df114d-912c-4ccf-9f68-097c9617ef1b service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:01:43.522401 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df114d-912c-4ccf-9f68-097c9617ef1b service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:01:43.522674 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df114d-912c-4ccf-9f68-097c9617ef1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:01:43.524431 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-d0df114d-912c-4ccf-9f68-097c9617ef1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:01:43.603118 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df114d-912c-4ccf-9f68-097c9617ef1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:01:43.604578 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df114d-912c-4ccf-9f68-097c9617ef1b service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:01:43.613836 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1242/2483] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:01:43 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:01:55.987273 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac2637-db96-4ddb-9739-dd5f7b179ac3 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:01:55.988713 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c5ac2637-db96-4ddb-9739-dd5f7b179ac3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:01:56.123134 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac2637-db96-4ddb-9739-dd5f7b179ac3 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:01:56.128732 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dd1fb-340f-4f2e-82c6-8304f2ae7423 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bffc0480ffb942cdad426195eca0529e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:01:56.129360 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dd1fb-340f-4f2e-82c6-8304f2ae7423 service placement] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:01:56.129639 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dd1fb-340f-4f2e-82c6-8304f2ae7423 service placement] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:01:56.129908 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dd1fb-340f-4f2e-82c6-8304f2ae7423 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:01:56.131674 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-941dd1fb-340f-4f2e-82c6-8304f2ae7423 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:01:56.143509 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941dd1fb-340f-4f2e-82c6-8304f2ae7423 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:01:56.145098 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941dd1fb-340f-4f2e-82c6-8304f2ae7423 service placement] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:01:56.154451 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1242/2484] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:01:55 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:03:26.155657 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df114d-912c-4ccf-9f68-097c9617ef1b service cinder] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:03:26.164627 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df114d-912c-4ccf-9f68-097c9617ef1b service cinder] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:03:26.168173 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5977b71-9dc6-4a4a-848a-d13660660dca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:03:26.168790 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5977b71-9dc6-4a4a-848a-d13660660dca service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:03:26.169067 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5977b71-9dc6-4a4a-848a-d13660660dca service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:03:26.169336 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5977b71-9dc6-4a4a-848a-d13660660dca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:03:26.171065 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-c5977b71-9dc6-4a4a-848a-d13660660dca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:03:26.239791 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5977b71-9dc6-4a4a-848a-d13660660dca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:03:26.241225 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5977b71-9dc6-4a4a-848a-d13660660dca service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:03:26.250300 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1243/2485] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:03:26 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:03:36.903434 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dd1fb-340f-4f2e-82c6-8304f2ae7423 service placement] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:03:36.904849 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-941dd1fb-340f-4f2e-82c6-8304f2ae7423 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:03:36.978841 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dd1fb-340f-4f2e-82c6-8304f2ae7423 service placement] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:03:36.982480 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce43f96-9dfe-4181-be38-ea7657beb929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:03:36.983110 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce43f96-9dfe-4181-be38-ea7657beb929 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:03:36.983390 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce43f96-9dfe-4181-be38-ea7657beb929 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:03:36.983662 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce43f96-9dfe-4181-be38-ea7657beb929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:03:36.986066 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-0ce43f96-9dfe-4181-be38-ea7657beb929 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:03:37.053470 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce43f96-9dfe-4181-be38-ea7657beb929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:03:37.054916 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce43f96-9dfe-4181-be38-ea7657beb929 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:03:37.067668 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1243/2486] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:03:36 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:03:38.088649 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5977b71-9dc6-4a4a-848a-d13660660dca service cinder] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:03:38.090130 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-c5977b71-9dc6-4a4a-848a-d13660660dca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:03:38.107927 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5977b71-9dc6-4a4a-848a-d13660660dca service cinder] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:03:38.114309 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed273412-aa80-4f96-8794-88a55f8efeb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:03:38.114984 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed273412-aa80-4f96-8794-88a55f8efeb6 service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:03:38.115252 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed273412-aa80-4f96-8794-88a55f8efeb6 service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:03:38.115536 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed273412-aa80-4f96-8794-88a55f8efeb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:03:38.117455 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-ed273412-aa80-4f96-8794-88a55f8efeb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:03:38.131785 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed273412-aa80-4f96-8794-88a55f8efeb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:03:38.134007 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed273412-aa80-4f96-8794-88a55f8efeb6 service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:03:38.148691 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1244/2487] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:03:38 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:04:44.713375 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce43f96-9dfe-4181-be38-ea7657beb929 service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:04:44.721550 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce43f96-9dfe-4181-be38-ea7657beb929 service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:04:44.725681 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2ea91-79f6-48a1-b04b-d9678a40adf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:04:44.726301 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2ea91-79f6-48a1-b04b-d9678a40adf0 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:04:44.726578 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2ea91-79f6-48a1-b04b-d9678a40adf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:04:44.726849 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2ea91-79f6-48a1-b04b-d9678a40adf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:04:44.728575 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-49c2ea91-79f6-48a1-b04b-d9678a40adf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:04:44.737675 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2ea91-79f6-48a1-b04b-d9678a40adf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:04:44.739080 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2ea91-79f6-48a1-b04b-d9678a40adf0 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:04:44.746631 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1244/2488] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:04:44 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:04:46.116108 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed273412-aa80-4f96-8794-88a55f8efeb6 service nova] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:04:46.125085 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed273412-aa80-4f96-8794-88a55f8efeb6 service nova] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:04:46.128687 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27c196-8a9f-497c-aa49-1e4c7426aad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:04:46.129318 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27c196-8a9f-497c-aa49-1e4c7426aad7 service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:04:46.129598 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27c196-8a9f-497c-aa49-1e4c7426aad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:04:46.129875 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27c196-8a9f-497c-aa49-1e4c7426aad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:04:46.138633 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27c196-8a9f-497c-aa49-1e4c7426aad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:04:46.140084 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27c196-8a9f-497c-aa49-1e4c7426aad7 service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:04:46.148976 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1245/2489] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:04:46 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:05:46.828855 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2ea91-79f6-48a1-b04b-d9678a40adf0 service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:05:46.905994 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2ea91-79f6-48a1-b04b-d9678a40adf0 service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:05:46.910357 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e160e8-169b-4b4a-82f6-862d0a13f597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:05:46.911198 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e160e8-169b-4b4a-82f6-862d0a13f597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:05:46.911476 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e160e8-169b-4b4a-82f6-862d0a13f597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:05:46.911774 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e160e8-169b-4b4a-82f6-862d0a13f597 admin admin] PATH_INFO: `/v3/users/185b5670a99947a6baebb4d252e7722f` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:05:46.913531 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e160e8-169b-4b4a-82f6-862d0a13f597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=185b5670a99947a6baebb4d252e7722f)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:05:46.915419 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e160e8-169b-4b4a-82f6-862d0a13f597 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:05:46.959006 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a9e160e8-169b-4b4a-82f6-862d0a13f597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '185b5670a99947a6baebb4d252e7722f'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:05:46.970653 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a9e160e8-169b-4b4a-82f6-862d0a13f597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '185b5670a99947a6baebb4d252e7722f'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:05:46.977994 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a9e160e8-169b-4b4a-82f6-862d0a13f597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '185b5670a99947a6baebb4d252e7722f'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:05:46.978678 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a9e160e8-169b-4b4a-82f6-862d0a13f597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '185b5670a99947a6baebb4d252e7722f'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:05:46.985207 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a9e160e8-169b-4b4a-82f6-862d0a13f597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '185b5670a99947a6baebb4d252e7722f'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:05:46.990933 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1245/2490] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:05:46 2021] DELETE /identity/v3/users/185b5670a99947a6baebb4d252e7722f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:05:47.001733 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c1be7-5ef8-40f7-89d1-1a0607afb6a7 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:05:47.002268 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c1be7-5ef8-40f7-89d1-1a0607afb6a7 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:05:47.002268 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c1be7-5ef8-40f7-89d1-1a0607afb6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:05:47.040616 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-e73c1be7-5ef8-40f7-89d1-1a0607afb6a7 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:05:47.041824 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-e73c1be7-5ef8-40f7-89d1-1a0607afb6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:05:47.098250 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1246/2491] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:05:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:05:47.109529 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e160e8-169b-4b4a-82f6-862d0a13f597 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:05:47.110902 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-a9e160e8-169b-4b4a-82f6-862d0a13f597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:05:47.164707 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e160e8-169b-4b4a-82f6-862d0a13f597 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:05:47.168429 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcbaba-aa76-4252-b590-a2e263d3b84e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:05:47.169063 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcbaba-aa76-4252-b590-a2e263d3b84e service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:05:47.169348 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcbaba-aa76-4252-b590-a2e263d3b84e service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:05:47.169626 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcbaba-aa76-4252-b590-a2e263d3b84e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:05:47.178650 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bcbaba-aa76-4252-b590-a2e263d3b84e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:05:47.180126 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bcbaba-aa76-4252-b590-a2e263d3b84e service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:05:47.189304 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1246/2492] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:05:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:05:47.445191 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c1be7-5ef8-40f7-89d1-1a0607afb6a7 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:05:47.446995 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-e73c1be7-5ef8-40f7-89d1-1a0607afb6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:05:47.458833 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c1be7-5ef8-40f7-89d1-1a0607afb6a7 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:05:47.464403 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafbd52-4797-4591-b943-f82c095a53bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:05:47.465267 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafbd52-4797-4591-b943-f82c095a53bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:05:47.465546 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafbd52-4797-4591-b943-f82c095a53bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:05:47.465815 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafbd52-4797-4591-b943-f82c095a53bf admin admin] PATH_INFO: `/v3/projects/8e5b6c5cb46e4a50b8c6ed9ca9dd9297` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:05:47.467010 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bafbd52-4797-4591-b943-f82c095a53bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e5b6c5cb46e4a50b8c6ed9ca9dd9297)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:05:47.469834 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bafbd52-4797-4591-b943-f82c095a53bf admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:05:47.515691 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-0bafbd52-4797-4591-b943-f82c095a53bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e5b6c5cb46e4a50b8c6ed9ca9dd9297', 'request_id': 'req-0bafbd52-4797-4591-b943-f82c095a53bf'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:05:47.521521 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-0bafbd52-4797-4591-b943-f82c095a53bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e5b6c5cb46e4a50b8c6ed9ca9dd9297', 'request_id': 'req-0bafbd52-4797-4591-b943-f82c095a53bf'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:05:47.526729 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-0bafbd52-4797-4591-b943-f82c095a53bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e5b6c5cb46e4a50b8c6ed9ca9dd9297', 'request_id': 'req-0bafbd52-4797-4591-b943-f82c095a53bf'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:05:47.538815 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-0bafbd52-4797-4591-b943-f82c095a53bf admin admin] The token cache is being invalidate because project 8e5b6c5cb46e4a50b8c6ed9ca9dd9297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:05:47.539104 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-0bafbd52-4797-4591-b943-f82c095a53bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:05:47.539746 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-0bafbd52-4797-4591-b943-f82c095a53bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:05:47.541261 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1247/2493] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:05:47 2021] DELETE /identity/v3/projects/8e5b6c5cb46e4a50b8c6ed9ca9dd9297 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:05:48.704539 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcbaba-aa76-4252-b590-a2e263d3b84e service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:05:48.705906 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-f1bcbaba-aa76-4252-b590-a2e263d3b84e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:05:48.760173 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcbaba-aa76-4252-b590-a2e263d3b84e service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:05:48.805072 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f70dc-de3a-40e2-b270-2675e37242de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:05:48.805708 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f70dc-de3a-40e2-b270-2675e37242de service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:05:48.805986 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f70dc-de3a-40e2-b270-2675e37242de service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:05:48.806376 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f70dc-de3a-40e2-b270-2675e37242de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:05:48.808023 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d20f70dc-de3a-40e2-b270-2675e37242de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:05:48.864040 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f70dc-de3a-40e2-b270-2675e37242de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:05:48.865502 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f70dc-de3a-40e2-b270-2675e37242de service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:05:48.874826 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1247/2494] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:05:48 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:06:43.993654 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafbd52-4797-4591-b943-f82c095a53bf admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:06:43.995050 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-0bafbd52-4797-4591-b943-f82c095a53bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:06:44.016446 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafbd52-4797-4591-b943-f82c095a53bf admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:06:44.020053 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf38148-6f2d-4e54-a4d9-3b282c0cb6c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:06:44.020679 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf38148-6f2d-4e54-a4d9-3b282c0cb6c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:06:44.020967 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf38148-6f2d-4e54-a4d9-3b282c0cb6c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:06:44.021236 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf38148-6f2d-4e54-a4d9-3b282c0cb6c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:06:44.022962 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-7cf38148-6f2d-4e54-a4d9-3b282c0cb6c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:06:44.088693 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf38148-6f2d-4e54-a4d9-3b282c0cb6c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:06:44.090118 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf38148-6f2d-4e54-a4d9-3b282c0cb6c7 service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:06:44.107805 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1248/2495] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:06:43 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:07:03.007660 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f70dc-de3a-40e2-b270-2675e37242de service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:07:03.009059 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d20f70dc-de3a-40e2-b270-2675e37242de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:07:03.076668 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f70dc-de3a-40e2-b270-2675e37242de service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:07:03.081639 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645fcc2-5057-432d-8551-b81baffe5ab6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bffc0480ffb942cdad426195eca0529e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:07:03.082302 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645fcc2-5057-432d-8551-b81baffe5ab6 service placement] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:07:03.082585 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645fcc2-5057-432d-8551-b81baffe5ab6 service placement] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:07:03.082861 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645fcc2-5057-432d-8551-b81baffe5ab6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:07:03.084646 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d645fcc2-5057-432d-8551-b81baffe5ab6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:07:03.096188 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645fcc2-5057-432d-8551-b81baffe5ab6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:07:03.097747 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645fcc2-5057-432d-8551-b81baffe5ab6 service placement] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:07:03.107196 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1248/2496] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:07:03 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:07:51.612426 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf38148-6f2d-4e54-a4d9-3b282c0cb6c7 service cinder] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:07:51.613889 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-7cf38148-6f2d-4e54-a4d9-3b282c0cb6c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:07:51.670262 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf38148-6f2d-4e54-a4d9-3b282c0cb6c7 service cinder] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:07:51.673859 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbd50b-d32a-4a76-9b4d-508bcd4d24a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:07:51.674499 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbd50b-d32a-4a76-9b4d-508bcd4d24a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:07:51.674780 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbd50b-d32a-4a76-9b4d-508bcd4d24a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:07:51.675057 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbd50b-d32a-4a76-9b4d-508bcd4d24a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:07:51.676829 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-40fbd50b-d32a-4a76-9b4d-508bcd4d24a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:07:51.763645 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbd50b-d32a-4a76-9b4d-508bcd4d24a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:07:51.765159 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbd50b-d32a-4a76-9b4d-508bcd4d24a6 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:07:51.785472 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1249/2497] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:07:51 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:08:26.555066 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645fcc2-5057-432d-8551-b81baffe5ab6 service placement] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:08:26.556534 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d645fcc2-5057-432d-8551-b81baffe5ab6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:08:26.570818 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645fcc2-5057-432d-8551-b81baffe5ab6 service placement] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:08:26.574529 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5fc71-125c-455c-9e6b-529b3da6f156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:08:26.575328 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5fc71-125c-455c-9e6b-529b3da6f156 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:08:26.575459 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5fc71-125c-455c-9e6b-529b3da6f156 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:08:26.575742 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5fc71-125c-455c-9e6b-529b3da6f156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:08:26.578575 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-f0c5fc71-125c-455c-9e6b-529b3da6f156 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:08:26.645392 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c5fc71-125c-455c-9e6b-529b3da6f156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:08:26.646822 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c5fc71-125c-455c-9e6b-529b3da6f156 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:08:26.664200 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1249/2498] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:08:26 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:08:37.688485 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbd50b-d32a-4a76-9b4d-508bcd4d24a6 service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:08:37.697017 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbd50b-d32a-4a76-9b4d-508bcd4d24a6 service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:08:37.701188 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b56005-6b12-4715-83bd-ccf9dbff6002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:08:37.701817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b56005-6b12-4715-83bd-ccf9dbff6002 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:08:37.702103 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b56005-6b12-4715-83bd-ccf9dbff6002 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:08:37.702375 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b56005-6b12-4715-83bd-ccf9dbff6002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:08:37.704237 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-66b56005-6b12-4715-83bd-ccf9dbff6002 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:08:37.718857 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b56005-6b12-4715-83bd-ccf9dbff6002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:08:37.720336 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b56005-6b12-4715-83bd-ccf9dbff6002 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:08:37.731246 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1250/2499] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:08:37 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:09:53.256520 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5fc71-125c-455c-9e6b-529b3da6f156 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:09:53.265968 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5fc71-125c-455c-9e6b-529b3da6f156 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:09:53.269556 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c87be-1a10-40ca-b219-2c0950511f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:09:53.270187 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c87be-1a10-40ca-b219-2c0950511f15 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:09:53.270470 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c87be-1a10-40ca-b219-2c0950511f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:09:53.270744 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c87be-1a10-40ca-b219-2c0950511f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:09:53.272520 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c39c87be-1a10-40ca-b219-2c0950511f15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:09:53.334079 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c87be-1a10-40ca-b219-2c0950511f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:09:53.335517 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c87be-1a10-40ca-b219-2c0950511f15 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:09:53.345542 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1250/2500] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:09:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:09:56.155003 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b56005-6b12-4715-83bd-ccf9dbff6002 service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:09:56.156497 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-66b56005-6b12-4715-83bd-ccf9dbff6002 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:09:56.170230 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b56005-6b12-4715-83bd-ccf9dbff6002 service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:09:56.174827 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ae48e-6e70-4f96-8677-7ac30b7e42b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:09:56.175706 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ae48e-6e70-4f96-8677-7ac30b7e42b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:09:56.175989 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ae48e-6e70-4f96-8677-7ac30b7e42b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:09:56.176262 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ae48e-6e70-4f96-8677-7ac30b7e42b6 admin admin] PATH_INFO: `/v3/users/1e012909f2e14c9c9e8c93d76aead42d` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:09:56.190170 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ae48e-6e70-4f96-8677-7ac30b7e42b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e012909f2e14c9c9e8c93d76aead42d)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:09:56.192141 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ae48e-6e70-4f96-8677-7ac30b7e42b6 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:09:56.236566 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-c48ae48e-6e70-4f96-8677-7ac30b7e42b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e012909f2e14c9c9e8c93d76aead42d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:09:56.248087 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-c48ae48e-6e70-4f96-8677-7ac30b7e42b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e012909f2e14c9c9e8c93d76aead42d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:09:56.256704 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-c48ae48e-6e70-4f96-8677-7ac30b7e42b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e012909f2e14c9c9e8c93d76aead42d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:09:56.257322 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-c48ae48e-6e70-4f96-8677-7ac30b7e42b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e012909f2e14c9c9e8c93d76aead42d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:09:56.264078 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-c48ae48e-6e70-4f96-8677-7ac30b7e42b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e012909f2e14c9c9e8c93d76aead42d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:09:56.270129 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1251/2501] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:09:56 2021] DELETE /identity/v3/users/1e012909f2e14c9c9e8c93d76aead42d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:09:56.436700 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c87be-1a10-40ca-b219-2c0950511f15 service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:09:56.449074 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c87be-1a10-40ca-b219-2c0950511f15 service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:09:56.505677 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c60466-9486-4da6-9a21-4997ecdf4dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:09:56.506553 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c60466-9486-4da6-9a21-4997ecdf4dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:09:56.506859 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c60466-9486-4da6-9a21-4997ecdf4dae admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:09:56.507135 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c60466-9486-4da6-9a21-4997ecdf4dae admin admin] PATH_INFO: `/v3/projects/4687122800414ea6b0203e53a18a54ff` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:09:56.508337 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c60466-9486-4da6-9a21-4997ecdf4dae admin admin] RBAC: Authorizing `identity:delete_project(project_id=4687122800414ea6b0203e53a18a54ff)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:09:56.510239 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c60466-9486-4da6-9a21-4997ecdf4dae admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:09:56.553777 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-39c60466-9486-4da6-9a21-4997ecdf4dae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4687122800414ea6b0203e53a18a54ff', 'request_id': 'req-39c60466-9486-4da6-9a21-4997ecdf4dae'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:09:56.559839 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-39c60466-9486-4da6-9a21-4997ecdf4dae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4687122800414ea6b0203e53a18a54ff', 'request_id': 'req-39c60466-9486-4da6-9a21-4997ecdf4dae'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:09:56.565748 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-39c60466-9486-4da6-9a21-4997ecdf4dae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4687122800414ea6b0203e53a18a54ff', 'request_id': 'req-39c60466-9486-4da6-9a21-4997ecdf4dae'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:09:56.577612 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-39c60466-9486-4da6-9a21-4997ecdf4dae admin admin] The token cache is being invalidate because project 4687122800414ea6b0203e53a18a54ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:09:56.577897 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-39c60466-9486-4da6-9a21-4997ecdf4dae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:09:56.578511 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-39c60466-9486-4da6-9a21-4997ecdf4dae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:09:56.580090 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1251/2502] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:09:56 2021] DELETE /identity/v3/projects/4687122800414ea6b0203e53a18a54ff => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:09:56.586620 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f7719-8f65-4f86-85df-be6584ed1c00 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:09:56.586908 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f7719-8f65-4f86-85df-be6584ed1c00 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:09:56.587185 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f7719-8f65-4f86-85df-be6584ed1c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:09:56.641385 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-fa7f7719-8f65-4f86-85df-be6584ed1c00 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:09:56.642594 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-fa7f7719-8f65-4f86-85df-be6584ed1c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:09:56.699388 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1252/2503] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:09:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:09:56.707945 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5d068-2076-41eb-9bc1-5bb8ffc8a7a4 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:09:56.708237 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5d068-2076-41eb-9bc1-5bb8ffc8a7a4 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:09:56.708574 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5d068-2076-41eb-9bc1-5bb8ffc8a7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:09:56.729009 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-71d5d068-2076-41eb-9bc1-5bb8ffc8a7a4 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:09:56.730219 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-71d5d068-2076-41eb-9bc1-5bb8ffc8a7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:09:56.738608 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1252/2504] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:09:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:09:56.742730 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f7719-8f65-4f86-85df-be6584ed1c00 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:09:56.752726 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f7719-8f65-4f86-85df-be6584ed1c00 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:09:56.757225 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a1634-05e8-4df0-9bc5-f7ce7ee37e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:09:56.757914 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a1634-05e8-4df0-9bc5-f7ce7ee37e75 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:09:56.758177 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a1634-05e8-4df0-9bc5-f7ce7ee37e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:09:56.758453 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a1634-05e8-4df0-9bc5-f7ce7ee37e75 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:09:56.759181 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a1634-05e8-4df0-9bc5-f7ce7ee37e75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 04:09:56.759484 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a1634-05e8-4df0-9bc5-f7ce7ee37e75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:09:56.761147 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a1634-05e8-4df0-9bc5-f7ce7ee37e75 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:09:56.772278 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1253/2505] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 04:09:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 04:09:56.776598 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5d068-2076-41eb-9bc1-5bb8ffc8a7a4 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:09:56.787200 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5d068-2076-41eb-9bc1-5bb8ffc8a7a4 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:09:56.791938 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4234fb-52c5-43a4-8630-beb285ba41e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:09:56.792582 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4234fb-52c5-43a4-8630-beb285ba41e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:09:56.792865 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4234fb-52c5-43a4-8630-beb285ba41e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:09:56.793138 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4234fb-52c5-43a4-8630-beb285ba41e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:09:56.793844 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4234fb-52c5-43a4-8630-beb285ba41e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:09:56.796382 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4234fb-52c5-43a4-8630-beb285ba41e5 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:09:56.831913 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1253/2506] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:09:56 2021] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 04:09:56.835691 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a1634-05e8-4df0-9bc5-f7ce7ee37e75 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:09:56.847276 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a1634-05e8-4df0-9bc5-f7ce7ee37e75 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:09:56.904124 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309d1c6-5867-4937-ab49-988f1fbd9b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:09:56.904814 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309d1c6-5867-4937-ab49-988f1fbd9b24 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:09:56.905090 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309d1c6-5867-4937-ab49-988f1fbd9b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:09:56.905363 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309d1c6-5867-4937-ab49-988f1fbd9b24 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:09:56.906070 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309d1c6-5867-4937-ab49-988f1fbd9b24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:09:56.907984 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309d1c6-5867-4937-ab49-988f1fbd9b24 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:09:56.927580 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1254/2507] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:09:56 2021] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:09:56.931821 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4234fb-52c5-43a4-8630-beb285ba41e5 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:09:56.942846 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4234fb-52c5-43a4-8630-beb285ba41e5 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:09:56.947591 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c80ed2-bc40-4a05-bd3e-18cb6b043271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:09:56.948294 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c80ed2-bc40-4a05-bd3e-18cb6b043271 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:09:56.948578 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c80ed2-bc40-4a05-bd3e-18cb6b043271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:09:56.948852 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c80ed2-bc40-4a05-bd3e-18cb6b043271 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:09:56.949588 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c80ed2-bc40-4a05-bd3e-18cb6b043271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:09:56.951247 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c80ed2-bc40-4a05-bd3e-18cb6b043271 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:09:56.961798 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1254/2508] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:09:56 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:09:56.965723 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309d1c6-5867-4937-ab49-988f1fbd9b24 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:09:56.975900 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309d1c6-5867-4937-ab49-988f1fbd9b24 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:09:56.982488 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99e65a-ab30-4b2b-b272-6c4b93bfe595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:09:56.984210 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99e65a-ab30-4b2b-b272-6c4b93bfe595 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:09:56.984733 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99e65a-ab30-4b2b-b272-6c4b93bfe595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:09:56.985107 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99e65a-ab30-4b2b-b272-6c4b93bfe595 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:09:56.986085 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99e65a-ab30-4b2b-b272-6c4b93bfe595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:09:56.987963 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99e65a-ab30-4b2b-b272-6c4b93bfe595 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:09:57.001030 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1255/2509] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:09:56 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:09:57.005270 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c80ed2-bc40-4a05-bd3e-18cb6b043271 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:09:57.015290 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c80ed2-bc40-4a05-bd3e-18cb6b043271 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:09:57.020373 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a7948-018c-4999-aa9b-293843a4d6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:09:57.021240 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a7948-018c-4999-aa9b-293843a4d6f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:09:57.021526 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a7948-018c-4999-aa9b-293843a4d6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:09:57.021802 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a7948-018c-4999-aa9b-293843a4d6f4 admin admin] PATH_INFO: `/v3/projects/8a2f64c8564f447d84849db55e0b0573/users/987993288a1a42dfa808e39eab41c82c/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:09:57.038721 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a7948-018c-4999-aa9b-293843a4d6f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a2f64c8564f447d84849db55e0b0573, user_id=987993288a1a42dfa808e39eab41c82c, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:09:57.041419 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a7948-018c-4999-aa9b-293843a4d6f4 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:09:57.055214 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1255/2510] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:09:57 2021] PUT /identity/v3/projects/8a2f64c8564f447d84849db55e0b0573/users/987993288a1a42dfa808e39eab41c82c/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 04:09:57.060243 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefceece-14a8-4b1b-aca3-6a0958ca1810 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:09:57.060671 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefceece-14a8-4b1b-aca3-6a0958ca1810 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:09:57.061528 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefceece-14a8-4b1b-aca3-6a0958ca1810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:09:57.079424 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-aefceece-14a8-4b1b-aca3-6a0958ca1810 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:09:57.080898 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-aefceece-14a8-4b1b-aca3-6a0958ca1810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:09:57.136086 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1256/2511] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:09:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:09:57.145782 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a7948-018c-4999-aa9b-293843a4d6f4 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:09:57.147451 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-b98a7948-018c-4999-aa9b-293843a4d6f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:09:57.201760 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a7948-018c-4999-aa9b-293843a4d6f4 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:09:57.205466 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcc153-5581-472d-9861-d2a8d747bbb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:09:57.206131 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcc153-5581-472d-9861-d2a8d747bbb1 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:09:57.206412 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcc153-5581-472d-9861-d2a8d747bbb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:09:57.206688 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcc153-5581-472d-9861-d2a8d747bbb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:09:57.215508 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dcc153-5581-472d-9861-d2a8d747bbb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:09:57.216977 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dcc153-5581-472d-9861-d2a8d747bbb1 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:09:57.226209 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1256/2512] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:09:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:10:01.070390 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dc2e0-c2f8-4c0f-b07d-74b8c302d48d None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:10:01.070872 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dc2e0-c2f8-4c0f-b07d-74b8c302d48d None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:10:01.070994 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dc2e0-c2f8-4c0f-b07d-74b8c302d48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:10:01.135837 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-c16dc2e0-c2f8-4c0f-b07d-74b8c302d48d None None] MFA Rules not processed for user `987993288a1a42dfa808e39eab41c82c`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:10:01.137064 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-c16dc2e0-c2f8-4c0f-b07d-74b8c302d48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:10:01.219828 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1257/2513] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:10:01 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:10:01.234641 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcc153-5581-472d-9861-d2a8d747bbb1 service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:10:01.239779 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c4dcc153-5581-472d-9861-d2a8d747bbb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:10:01.320422 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcc153-5581-472d-9861-d2a8d747bbb1 service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:10:01.325980 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f205f-74f4-465b-8474-16c82d655571 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:10:01.327216 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f205f-74f4-465b-8474-16c82d655571 service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:10:01.327496 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f205f-74f4-465b-8474-16c82d655571 service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:10:01.327802 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f205f-74f4-465b-8474-16c82d655571 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:10:01.336153 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f205f-74f4-465b-8474-16c82d655571 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:10:01.337749 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f205f-74f4-465b-8474-16c82d655571 service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:10:01.346909 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1257/2514] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:10:01 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:10:04.017765 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaa89b-f846-4b0b-bd5a-8c9636d595cc None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:10:04.018632 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaa89b-f846-4b0b-bd5a-8c9636d595cc None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:10:04.019153 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaa89b-f846-4b0b-bd5a-8c9636d595cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:10:04.039645 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-4eeaa89b-f846-4b0b-bd5a-8c9636d595cc None None] MFA Rules not processed for user `987993288a1a42dfa808e39eab41c82c`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:10:04.040925 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-4eeaa89b-f846-4b0b-bd5a-8c9636d595cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:10:04.052960 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1258/2515] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:10:04 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:10:04.360539 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f205f-74f4-465b-8474-16c82d655571 service nova] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:10:04.370309 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f205f-74f4-465b-8474-16c82d655571 service nova] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:10:04.374826 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099c266-2c6b-4d82-ae0b-6a21e63d2266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:10:04.375462 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099c266-2c6b-4d82-ae0b-6a21e63d2266 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:10:04.375770 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099c266-2c6b-4d82-ae0b-6a21e63d2266 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:10:04.376043 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099c266-2c6b-4d82-ae0b-6a21e63d2266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:10:04.377911 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-6099c266-2c6b-4d82-ae0b-6a21e63d2266 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:10:04.388465 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099c266-2c6b-4d82-ae0b-6a21e63d2266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:10:04.390517 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099c266-2c6b-4d82-ae0b-6a21e63d2266 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:10:04.399034 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1258/2516] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:10:04 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:10:04.728256 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeaa89b-f846-4b0b-bd5a-8c9636d595cc None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:10:04.729716 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-4eeaa89b-f846-4b0b-bd5a-8c9636d595cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:10:04.798208 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeaa89b-f846-4b0b-bd5a-8c9636d595cc None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:10:04.803126 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6d3bd-d06d-4eb1-a62f-86d04315197c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bffc0480ffb942cdad426195eca0529e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:10:04.803795 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6d3bd-d06d-4eb1-a62f-86d04315197c service placement] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:10:04.804081 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6d3bd-d06d-4eb1-a62f-86d04315197c service placement] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:10:04.804355 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6d3bd-d06d-4eb1-a62f-86d04315197c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:10:04.806155 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-e0b6d3bd-d06d-4eb1-a62f-86d04315197c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:10:04.818369 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6d3bd-d06d-4eb1-a62f-86d04315197c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:10:04.820040 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6d3bd-d06d-4eb1-a62f-86d04315197c service placement] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:10:04.829776 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1259/2517] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:10:04 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:10:06.410535 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099c266-2c6b-4d82-ae0b-6a21e63d2266 service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:10:06.419371 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099c266-2c6b-4d82-ae0b-6a21e63d2266 service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:10:06.424106 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cce41-2522-430e-84aa-28e7e0805b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:10:06.424947 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cce41-2522-430e-84aa-28e7e0805b24 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:10:06.425236 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cce41-2522-430e-84aa-28e7e0805b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:10:06.425511 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cce41-2522-430e-84aa-28e7e0805b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:10:06.427387 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-727cce41-2522-430e-84aa-28e7e0805b24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:10:06.437894 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cce41-2522-430e-84aa-28e7e0805b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:10:06.439338 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cce41-2522-430e-84aa-28e7e0805b24 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:10:06.448381 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1259/2518] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:10:06 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:10:07.121097 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6d3bd-d06d-4eb1-a62f-86d04315197c service placement] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:10:07.124690 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-e0b6d3bd-d06d-4eb1-a62f-86d04315197c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:10:07.163481 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6d3bd-d06d-4eb1-a62f-86d04315197c service placement] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:10:07.174961 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81fcaf-2664-45ae-8e26-0a3a7e2d6e90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:10:07.175970 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81fcaf-2664-45ae-8e26-0a3a7e2d6e90 service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:10:07.176361 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81fcaf-2664-45ae-8e26-0a3a7e2d6e90 service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:10:07.176733 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81fcaf-2664-45ae-8e26-0a3a7e2d6e90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:10:07.180289 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-7f81fcaf-2664-45ae-8e26-0a3a7e2d6e90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:10:07.194872 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81fcaf-2664-45ae-8e26-0a3a7e2d6e90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:10:07.196779 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81fcaf-2664-45ae-8e26-0a3a7e2d6e90 service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:10:07.208881 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1260/2519] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:10:07 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:10:12.997315 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cce41-2522-430e-84aa-28e7e0805b24 service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:10:13.011834 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cce41-2522-430e-84aa-28e7e0805b24 service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:10:13.017265 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19439f33-cc3f-4d2f-ac96-d166b36d218f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:10:13.017908 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19439f33-cc3f-4d2f-ac96-d166b36d218f service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:10:13.018185 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19439f33-cc3f-4d2f-ac96-d166b36d218f service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:10:13.018459 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19439f33-cc3f-4d2f-ac96-d166b36d218f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:10:13.020272 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-19439f33-cc3f-4d2f-ac96-d166b36d218f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:10:13.032276 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19439f33-cc3f-4d2f-ac96-d166b36d218f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:10:13.033836 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19439f33-cc3f-4d2f-ac96-d166b36d218f service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:10:13.044135 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1260/2520] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:10:12 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:11:44.087283 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81fcaf-2664-45ae-8e26-0a3a7e2d6e90 service nova] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:11:44.088668 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-7f81fcaf-2664-45ae-8e26-0a3a7e2d6e90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:11:44.152486 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81fcaf-2664-45ae-8e26-0a3a7e2d6e90 service nova] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:11:44.156633 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f766a-a526-4f67-b881-bf44555bbafe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:11:44.157256 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f766a-a526-4f67-b881-bf44555bbafe service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:11:44.157531 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f766a-a526-4f67-b881-bf44555bbafe service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:11:44.157800 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f766a-a526-4f67-b881-bf44555bbafe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:11:44.159494 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-189f766a-a526-4f67-b881-bf44555bbafe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:11:44.224358 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f766a-a526-4f67-b881-bf44555bbafe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:11:44.225787 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f766a-a526-4f67-b881-bf44555bbafe service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:11:44.234623 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1261/2521] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:11:44 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:12:09.049186 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19439f33-cc3f-4d2f-ac96-d166b36d218f service nova] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:12:09.105661 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19439f33-cc3f-4d2f-ac96-d166b36d218f service nova] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:12:09.111647 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5f02b-ab6c-4cb9-893b-6a0ffa893ecd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bffc0480ffb942cdad426195eca0529e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:12:09.112320 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5f02b-ab6c-4cb9-893b-6a0ffa893ecd service placement] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:12:09.112632 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5f02b-ab6c-4cb9-893b-6a0ffa893ecd service placement] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:12:09.112910 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5f02b-ab6c-4cb9-893b-6a0ffa893ecd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:12:09.114682 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-40f5f02b-ab6c-4cb9-893b-6a0ffa893ecd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:12:09.146706 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5f02b-ab6c-4cb9-893b-6a0ffa893ecd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:12:09.148307 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5f02b-ab6c-4cb9-893b-6a0ffa893ecd service placement] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:12:09.157848 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1261/2522] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:12:09 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:12:44.099573 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f766a-a526-4f67-b881-bf44555bbafe service cinder] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:12:44.101094 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-189f766a-a526-4f67-b881-bf44555bbafe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:12:44.199399 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f766a-a526-4f67-b881-bf44555bbafe service cinder] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:12:44.203246 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be04de5-ce81-4ee6-a8b9-28a9d64e1b8c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456c83b8619847279927251ca48fca37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:12:44.203901 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be04de5-ce81-4ee6-a8b9-28a9d64e1b8c service glance] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:12:44.204184 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be04de5-ce81-4ee6-a8b9-28a9d64e1b8c service glance] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:12:44.204463 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be04de5-ce81-4ee6-a8b9-28a9d64e1b8c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:12:44.206262 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-0be04de5-ce81-4ee6-a8b9-28a9d64e1b8c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:12:44.217572 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: WARNING keystone.server.flask.application [None req-0be04de5-ce81-4ee6-a8b9-28a9d64e1b8c service glance] Could not find project: e361efb4da2949b0af447c5239c102c8.: keystone.exception.ProjectNotFound: Could not find project: e361efb4da2949b0af447c5239c102c8. Oct 15 04:12:44.218753 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1262/2523] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:12:44 2021] GET /identity/v3/auth/tokens => generated 113 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 15 04:12:52.241538 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5f02b-ab6c-4cb9-893b-6a0ffa893ecd service placement] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:12:52.251387 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5f02b-ab6c-4cb9-893b-6a0ffa893ecd service placement] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:12:52.255124 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fefaf0-c0f4-4b39-a05e-9701c66559c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:12:52.255784 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fefaf0-c0f4-4b39-a05e-9701c66559c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:12:52.256067 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fefaf0-c0f4-4b39-a05e-9701c66559c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:12:52.256341 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fefaf0-c0f4-4b39-a05e-9701c66559c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:12:52.258076 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d8fefaf0-c0f4-4b39-a05e-9701c66559c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:12:52.271731 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fefaf0-c0f4-4b39-a05e-9701c66559c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:12:52.273167 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fefaf0-c0f4-4b39-a05e-9701c66559c4 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:12:52.284157 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1262/2524] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:12:52 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:13:10.717087 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be04de5-ce81-4ee6-a8b9-28a9d64e1b8c service glance] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:13:10.718566 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-0be04de5-ce81-4ee6-a8b9-28a9d64e1b8c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:13:10.730790 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be04de5-ce81-4ee6-a8b9-28a9d64e1b8c service glance] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:13:10.734325 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291b210-d68c-4c97-84ca-e2bff7f623a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:13:10.735570 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291b210-d68c-4c97-84ca-e2bff7f623a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:10.735873 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291b210-d68c-4c97-84ca-e2bff7f623a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:10.736147 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291b210-d68c-4c97-84ca-e2bff7f623a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:10.737821 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-2291b210-d68c-4c97-84ca-e2bff7f623a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:13:10.748957 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291b210-d68c-4c97-84ca-e2bff7f623a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:13:10.750364 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291b210-d68c-4c97-84ca-e2bff7f623a7 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:13:10.759550 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1263/2525] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:13:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:13:11.236270 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fefaf0-c0f4-4b39-a05e-9701c66559c4 service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:13:11.238139 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d8fefaf0-c0f4-4b39-a05e-9701c66559c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:13:11.251750 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fefaf0-c0f4-4b39-a05e-9701c66559c4 service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:13:11.256330 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a9a32-ac94-4dc1-a8e6-4d21a9b67e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:13:11.257208 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a9a32-ac94-4dc1-a8e6-4d21a9b67e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:11.257488 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a9a32-ac94-4dc1-a8e6-4d21a9b67e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:11.257762 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a9a32-ac94-4dc1-a8e6-4d21a9b67e84 admin admin] PATH_INFO: `/v3/users/1a90e3068213436498812ad167bcb19f` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:11.258945 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a9a32-ac94-4dc1-a8e6-4d21a9b67e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a90e3068213436498812ad167bcb19f)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:13:11.260870 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a9a32-ac94-4dc1-a8e6-4d21a9b67e84 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:13:11.305284 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-4e3a9a32-ac94-4dc1-a8e6-4d21a9b67e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a90e3068213436498812ad167bcb19f'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:13:11.317307 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-4e3a9a32-ac94-4dc1-a8e6-4d21a9b67e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a90e3068213436498812ad167bcb19f'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:13:11.325094 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-4e3a9a32-ac94-4dc1-a8e6-4d21a9b67e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a90e3068213436498812ad167bcb19f'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:13:11.325847 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-4e3a9a32-ac94-4dc1-a8e6-4d21a9b67e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a90e3068213436498812ad167bcb19f'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:13:11.332945 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-4e3a9a32-ac94-4dc1-a8e6-4d21a9b67e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a90e3068213436498812ad167bcb19f'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:13:11.341519 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1263/2526] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:13:11 2021] DELETE /identity/v3/users/1a90e3068213436498812ad167bcb19f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:13:11.504177 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291b210-d68c-4c97-84ca-e2bff7f623a7 service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:13:11.513796 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291b210-d68c-4c97-84ca-e2bff7f623a7 service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:13:11.569997 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece7f7b-c504-435f-9d99-50fe515adb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:13:11.570779 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece7f7b-c504-435f-9d99-50fe515adb04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:11.571062 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece7f7b-c504-435f-9d99-50fe515adb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:11.571328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece7f7b-c504-435f-9d99-50fe515adb04 admin admin] PATH_INFO: `/v3/projects/6065f66d6938444d868fb5b3225ce1a1` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:11.572537 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece7f7b-c504-435f-9d99-50fe515adb04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6065f66d6938444d868fb5b3225ce1a1)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:13:11.574420 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece7f7b-c504-435f-9d99-50fe515adb04 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:13:11.621356 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-cece7f7b-c504-435f-9d99-50fe515adb04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6065f66d6938444d868fb5b3225ce1a1', 'request_id': 'req-cece7f7b-c504-435f-9d99-50fe515adb04'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:13:11.627333 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-cece7f7b-c504-435f-9d99-50fe515adb04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6065f66d6938444d868fb5b3225ce1a1', 'request_id': 'req-cece7f7b-c504-435f-9d99-50fe515adb04'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:13:11.632522 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-cece7f7b-c504-435f-9d99-50fe515adb04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6065f66d6938444d868fb5b3225ce1a1', 'request_id': 'req-cece7f7b-c504-435f-9d99-50fe515adb04'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:13:11.644317 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-cece7f7b-c504-435f-9d99-50fe515adb04 admin admin] The token cache is being invalidate because project 6065f66d6938444d868fb5b3225ce1a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:13:11.644603 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-cece7f7b-c504-435f-9d99-50fe515adb04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:13:11.645211 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-cece7f7b-c504-435f-9d99-50fe515adb04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:13:11.646717 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1264/2527] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:13:11 2021] DELETE /identity/v3/projects/6065f66d6938444d868fb5b3225ce1a1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 04:13:11.653347 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a17c7-0d95-4bd0-9ac7-2ab0c3c401cc None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:11.653634 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a17c7-0d95-4bd0-9ac7-2ab0c3c401cc None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:11.653910 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a17c7-0d95-4bd0-9ac7-2ab0c3c401cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:11.671802 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-d60a17c7-0d95-4bd0-9ac7-2ab0c3c401cc None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:13:11.673642 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-d60a17c7-0d95-4bd0-9ac7-2ab0c3c401cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:13:11.728374 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1264/2528] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:13:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:13:11.736403 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e767c0-86b3-4d45-8388-45c298c50dfe None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:11.736854 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e767c0-86b3-4d45-8388-45c298c50dfe None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:11.736964 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e767c0-86b3-4d45-8388-45c298c50dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:11.754759 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-55e767c0-86b3-4d45-8388-45c298c50dfe None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:13:11.755905 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-55e767c0-86b3-4d45-8388-45c298c50dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:13:11.763608 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1265/2529] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:13:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:13:11.768011 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a17c7-0d95-4bd0-9ac7-2ab0c3c401cc None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:13:11.777278 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a17c7-0d95-4bd0-9ac7-2ab0c3c401cc None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:13:11.782504 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4590384-823d-46d1-bc27-bb1032ad350b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:13:11.783138 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4590384-823d-46d1-bc27-bb1032ad350b admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:11.783425 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4590384-823d-46d1-bc27-bb1032ad350b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:11.783718 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4590384-823d-46d1-bc27-bb1032ad350b admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:11.784448 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4590384-823d-46d1-bc27-bb1032ad350b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 04:13:11.784751 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4590384-823d-46d1-bc27-bb1032ad350b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:13:11.786344 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4590384-823d-46d1-bc27-bb1032ad350b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:13:11.797285 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1265/2530] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 04:13:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 04:13:11.801305 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e767c0-86b3-4d45-8388-45c298c50dfe None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:13:11.810167 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e767c0-86b3-4d45-8388-45c298c50dfe None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:13:11.814789 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e666f-b127-4209-9a5f-65497c7ee3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:13:11.815673 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e666f-b127-4209-9a5f-65497c7ee3e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:11.815973 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e666f-b127-4209-9a5f-65497c7ee3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:11.816242 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e666f-b127-4209-9a5f-65497c7ee3e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:11.816934 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e666f-b127-4209-9a5f-65497c7ee3e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:13:11.818800 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e666f-b127-4209-9a5f-65497c7ee3e0 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:13:11.843288 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1266/2531] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:13:11 2021] POST /identity/v3/projects => generated 383 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:13:11.847584 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4590384-823d-46d1-bc27-bb1032ad350b admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:13:11.857232 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4590384-823d-46d1-bc27-bb1032ad350b admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:13:11.921641 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cfb2f-f7df-4aae-8275-1138b16367a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:13:11.922322 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cfb2f-f7df-4aae-8275-1138b16367a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:11.922611 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cfb2f-f7df-4aae-8275-1138b16367a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:11.922881 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cfb2f-f7df-4aae-8275-1138b16367a2 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:11.923564 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cfb2f-f7df-4aae-8275-1138b16367a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:13:11.925500 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cfb2f-f7df-4aae-8275-1138b16367a2 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:13:11.947482 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1266/2532] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:13:11 2021] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:13:11.951639 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e666f-b127-4209-9a5f-65497c7ee3e0 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:13:11.963702 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e666f-b127-4209-9a5f-65497c7ee3e0 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:13:11.968341 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ca914-f4fe-4939-86dc-ff91861732a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:13:11.969629 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ca914-f4fe-4939-86dc-ff91861732a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:11.969929 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ca914-f4fe-4939-86dc-ff91861732a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:11.970206 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ca914-f4fe-4939-86dc-ff91861732a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:11.970939 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ca914-f4fe-4939-86dc-ff91861732a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:13:11.972570 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ca914-f4fe-4939-86dc-ff91861732a2 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:13:11.982749 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1267/2533] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:13:11 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 04:13:11.986514 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cfb2f-f7df-4aae-8275-1138b16367a2 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:13:11.996071 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cfb2f-f7df-4aae-8275-1138b16367a2 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:13:12.000648 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f94ea-45c6-4d9c-b0fc-393ee0255f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:13:12.001291 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f94ea-45c6-4d9c-b0fc-393ee0255f76 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:12.001573 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f94ea-45c6-4d9c-b0fc-393ee0255f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:12.001847 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f94ea-45c6-4d9c-b0fc-393ee0255f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:12.002592 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f94ea-45c6-4d9c-b0fc-393ee0255f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:13:12.004204 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f94ea-45c6-4d9c-b0fc-393ee0255f76 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:13:12.013762 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1267/2534] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:13:11 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:13:12.017749 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ca914-f4fe-4939-86dc-ff91861732a2 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:13:12.027110 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ca914-f4fe-4939-86dc-ff91861732a2 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:13:12.032286 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14458b-2a03-49e2-937f-caf34893b1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:13:12.033127 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14458b-2a03-49e2-937f-caf34893b1ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:12.033400 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14458b-2a03-49e2-937f-caf34893b1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:12.033666 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14458b-2a03-49e2-937f-caf34893b1ca admin admin] PATH_INFO: `/v3/projects/adf86994ea4b42f08d65aefa85065d65/users/5ec3ec37e88a492ca616718e83e15816/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:12.047513 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14458b-2a03-49e2-937f-caf34893b1ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf86994ea4b42f08d65aefa85065d65, user_id=5ec3ec37e88a492ca616718e83e15816, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:13:12.050169 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14458b-2a03-49e2-937f-caf34893b1ca admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:13:12.062961 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1268/2535] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:13:12 2021] PUT /identity/v3/projects/adf86994ea4b42f08d65aefa85065d65/users/5ec3ec37e88a492ca616718e83e15816/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:13:12.068295 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29141fe0-e3a6-4feb-8f64-5480876b31d8 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:12.068585 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29141fe0-e3a6-4feb-8f64-5480876b31d8 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:12.068887 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29141fe0-e3a6-4feb-8f64-5480876b31d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:12.086711 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-29141fe0-e3a6-4feb-8f64-5480876b31d8 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:13:12.087942 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-29141fe0-e3a6-4feb-8f64-5480876b31d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:13:12.143484 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1268/2536] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:13:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:13:12.153367 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14458b-2a03-49e2-937f-caf34893b1ca admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:13:12.155017 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-ba14458b-2a03-49e2-937f-caf34893b1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:13:12.209065 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14458b-2a03-49e2-937f-caf34893b1ca admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:13:12.212767 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d073858-5213-4b8c-a652-4c317f9daa1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:13:12.213399 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d073858-5213-4b8c-a652-4c317f9daa1d service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:12.213680 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d073858-5213-4b8c-a652-4c317f9daa1d service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:12.213955 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d073858-5213-4b8c-a652-4c317f9daa1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:12.222744 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d073858-5213-4b8c-a652-4c317f9daa1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:13:12.224200 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d073858-5213-4b8c-a652-4c317f9daa1d service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:13:12.233832 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1269/2537] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:13:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:13:16.225417 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929c1fd-6f7f-4eba-9f30-9e3d203c3936 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:16.225908 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929c1fd-6f7f-4eba-9f30-9e3d203c3936 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:16.225978 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929c1fd-6f7f-4eba-9f30-9e3d203c3936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:16.256133 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-7929c1fd-6f7f-4eba-9f30-9e3d203c3936 None None] MFA Rules not processed for user `5ec3ec37e88a492ca616718e83e15816`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:13:16.257354 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7929c1fd-6f7f-4eba-9f30-9e3d203c3936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:13:16.347635 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1269/2538] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:13:16 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:13:16.349449 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d073858-5213-4b8c-a652-4c317f9daa1d service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:13:16.359450 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d073858-5213-4b8c-a652-4c317f9daa1d service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:13:16.365973 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7c33c-aba9-4e15-8eb6-f361bf12dd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:13:16.366630 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7c33c-aba9-4e15-8eb6-f361bf12dd1b admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:16.367091 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7c33c-aba9-4e15-8eb6-f361bf12dd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:16.367508 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7c33c-aba9-4e15-8eb6-f361bf12dd1b admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:16.368392 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7c33c-aba9-4e15-8eb6-f361bf12dd1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:13:16.370750 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7c33c-aba9-4e15-8eb6-f361bf12dd1b admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:13:16.400296 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1270/2539] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:13:16 2021] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:13:16.401387 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929c1fd-6f7f-4eba-9f30-9e3d203c3936 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:13:16.413067 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929c1fd-6f7f-4eba-9f30-9e3d203c3936 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:13:16.469508 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce33fd3-5dba-4c61-aa94-b1e3a996ca46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:13:16.470187 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce33fd3-5dba-4c61-aa94-b1e3a996ca46 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:16.470469 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce33fd3-5dba-4c61-aa94-b1e3a996ca46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:16.470745 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce33fd3-5dba-4c61-aa94-b1e3a996ca46 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:16.471479 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce33fd3-5dba-4c61-aa94-b1e3a996ca46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:13:16.473454 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce33fd3-5dba-4c61-aa94-b1e3a996ca46 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:13:16.497667 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1270/2540] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:13:16 2021] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 04:13:16.499443 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7c33c-aba9-4e15-8eb6-f361bf12dd1b admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:13:16.510461 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7c33c-aba9-4e15-8eb6-f361bf12dd1b admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:13:16.515362 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804fcff-05d2-4653-9b3d-926cb80d3bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:13:16.516028 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804fcff-05d2-4653-9b3d-926cb80d3bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:16.516307 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804fcff-05d2-4653-9b3d-926cb80d3bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:16.516576 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804fcff-05d2-4653-9b3d-926cb80d3bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:16.517312 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804fcff-05d2-4653-9b3d-926cb80d3bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:13:16.518978 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804fcff-05d2-4653-9b3d-926cb80d3bc0 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:13:16.529944 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1271/2541] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:13:16 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:13:16.534146 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce33fd3-5dba-4c61-aa94-b1e3a996ca46 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:13:16.544461 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce33fd3-5dba-4c61-aa94-b1e3a996ca46 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:13:16.549895 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073acd77-662a-491d-a2ca-5da7d6c34752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:13:16.550763 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073acd77-662a-491d-a2ca-5da7d6c34752 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:16.551044 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073acd77-662a-491d-a2ca-5da7d6c34752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:16.551318 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073acd77-662a-491d-a2ca-5da7d6c34752 admin admin] PATH_INFO: `/v3/projects/67950853bc2942c1b6a7a3207d660fe0/users/49093c96c34d4ea08f24b0a26d73287b/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:16.567520 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073acd77-662a-491d-a2ca-5da7d6c34752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67950853bc2942c1b6a7a3207d660fe0, user_id=49093c96c34d4ea08f24b0a26d73287b, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:13:16.570143 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073acd77-662a-491d-a2ca-5da7d6c34752 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:13:16.584989 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1271/2542] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:13:16 2021] PUT /identity/v3/projects/67950853bc2942c1b6a7a3207d660fe0/users/49093c96c34d4ea08f24b0a26d73287b/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:13:16.589032 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804fcff-05d2-4653-9b3d-926cb80d3bc0 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:13:16.599605 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804fcff-05d2-4653-9b3d-926cb80d3bc0 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:13:16.655340 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d738402-1d5c-4747-b916-55e6436cdc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:13:16.656071 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d738402-1d5c-4747-b916-55e6436cdc45 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:16.656939 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d738402-1d5c-4747-b916-55e6436cdc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:16.657208 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d738402-1d5c-4747-b916-55e6436cdc45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:16.657974 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d738402-1d5c-4747-b916-55e6436cdc45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:13:16.659581 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d738402-1d5c-4747-b916-55e6436cdc45 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:13:16.672735 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1272/2543] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:13:16 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:13:16.679370 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073acd77-662a-491d-a2ca-5da7d6c34752 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:13:16.697368 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073acd77-662a-491d-a2ca-5da7d6c34752 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:13:16.702024 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f409040-75d9-4a81-9b60-040ec4314cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:13:16.702925 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f409040-75d9-4a81-9b60-040ec4314cb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:16.703205 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f409040-75d9-4a81-9b60-040ec4314cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:16.704164 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f409040-75d9-4a81-9b60-040ec4314cb9 admin admin] PATH_INFO: `/v3/projects/67950853bc2942c1b6a7a3207d660fe0/users/49093c96c34d4ea08f24b0a26d73287b/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:16.706130 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f409040-75d9-4a81-9b60-040ec4314cb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67950853bc2942c1b6a7a3207d660fe0, user_id=49093c96c34d4ea08f24b0a26d73287b, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:13:16.708871 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f409040-75d9-4a81-9b60-040ec4314cb9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:13:16.719012 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1272/2544] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:13:16 2021] PUT /identity/v3/projects/67950853bc2942c1b6a7a3207d660fe0/users/49093c96c34d4ea08f24b0a26d73287b/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:13:21.068439 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36713eba-2aaa-4373-bff1-179b82c67eb8 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:21.068933 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36713eba-2aaa-4373-bff1-179b82c67eb8 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:21.069107 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36713eba-2aaa-4373-bff1-179b82c67eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:21.095312 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-36713eba-2aaa-4373-bff1-179b82c67eb8 None None] MFA Rules not processed for user `49093c96c34d4ea08f24b0a26d73287b`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:13:21.096710 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-36713eba-2aaa-4373-bff1-179b82c67eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:13:21.160448 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1273/2545] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:13:21 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:13:21.174073 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f409040-75d9-4a81-9b60-040ec4314cb9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:13:21.176108 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-6f409040-75d9-4a81-9b60-040ec4314cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:13:21.231607 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f409040-75d9-4a81-9b60-040ec4314cb9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:13:21.235356 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538560cf-8c8a-4c29-aeb5-339a529bf9ce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456c83b8619847279927251ca48fca37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:13:21.236040 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538560cf-8c8a-4c29-aeb5-339a529bf9ce service glance] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:21.236325 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538560cf-8c8a-4c29-aeb5-339a529bf9ce service glance] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:21.236604 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538560cf-8c8a-4c29-aeb5-339a529bf9ce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:21.291756 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538560cf-8c8a-4c29-aeb5-339a529bf9ce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:13:21.293370 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538560cf-8c8a-4c29-aeb5-339a529bf9ce service glance] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:13:21.303587 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1273/2546] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:13:21 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 04:13:21.421373 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeecc74-9c93-495f-ad7c-4922c8343cfa None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:21.421664 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeecc74-9c93-495f-ad7c-4922c8343cfa None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:21.422588 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeecc74-9c93-495f-ad7c-4922c8343cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:21.495787 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-8aeecc74-9c93-495f-ad7c-4922c8343cfa None None] MFA Rules not processed for user `3f598b94a850413494da575188706cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:13:21.497388 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-8aeecc74-9c93-495f-ad7c-4922c8343cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:13:21.571469 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1274/2547] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Oct 15 04:13:21 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 04:13:21.662861 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538560cf-8c8a-4c29-aeb5-339a529bf9ce service glance] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:13:21.666489 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-538560cf-8c8a-4c29-aeb5-339a529bf9ce service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:13:21.773582 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538560cf-8c8a-4c29-aeb5-339a529bf9ce service glance] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:13:21.778882 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df363d-ed82-4b15-8913-cec212fb2d02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfdf0fb38dd04c75a1c874913ea1bf98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:13:21.779600 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df363d-ed82-4b15-8913-cec212fb2d02 service swift] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:21.779992 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df363d-ed82-4b15-8913-cec212fb2d02 service swift] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:21.780276 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df363d-ed82-4b15-8913-cec212fb2d02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:21.789473 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df363d-ed82-4b15-8913-cec212fb2d02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:13:21.791137 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df363d-ed82-4b15-8913-cec212fb2d02 service swift] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:13:21.800363 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1274/2548] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Oct 15 04:13:21 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 15 04:13:26.768278 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeecc74-9c93-495f-ad7c-4922c8343cfa None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:13:26.770347 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-8aeecc74-9c93-495f-ad7c-4922c8343cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:13:26.833633 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeecc74-9c93-495f-ad7c-4922c8343cfa None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:13:26.837280 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b23572-5dad-46cd-ba78-1ffa1c773065 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:13:26.837919 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b23572-5dad-46cd-ba78-1ffa1c773065 service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:26.838194 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b23572-5dad-46cd-ba78-1ffa1c773065 service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:26.838464 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b23572-5dad-46cd-ba78-1ffa1c773065 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:26.840261 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-90b23572-5dad-46cd-ba78-1ffa1c773065 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:13:26.934716 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b23572-5dad-46cd-ba78-1ffa1c773065 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:13:26.936877 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b23572-5dad-46cd-ba78-1ffa1c773065 service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:13:26.948535 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1275/2549] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:13:26 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:13:30.950025 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e652de-3b9d-4b80-958e-5daf0552251c None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:30.950484 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e652de-3b9d-4b80-958e-5daf0552251c None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:30.950593 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e652de-3b9d-4b80-958e-5daf0552251c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:30.970190 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-a3e652de-3b9d-4b80-958e-5daf0552251c None None] MFA Rules not processed for user `5ec3ec37e88a492ca616718e83e15816`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:13:30.971393 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-a3e652de-3b9d-4b80-958e-5daf0552251c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:13:30.978382 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1275/2550] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:13:30 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:13:31.227537 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b23572-5dad-46cd-ba78-1ffa1c773065 service cinder] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:13:31.281634 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b23572-5dad-46cd-ba78-1ffa1c773065 service cinder] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:13:31.285291 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65e6cb-50d9-4580-910c-769dd558d16b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:13:31.285915 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65e6cb-50d9-4580-910c-769dd558d16b service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:31.286200 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65e6cb-50d9-4580-910c-769dd558d16b service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:31.286465 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65e6cb-50d9-4580-910c-769dd558d16b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:31.288208 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-1d65e6cb-50d9-4580-910c-769dd558d16b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:13:31.297796 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65e6cb-50d9-4580-910c-769dd558d16b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:13:31.299201 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65e6cb-50d9-4580-910c-769dd558d16b service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:13:31.306917 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1276/2551] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:13:31 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:13:32.708015 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf85930-65d9-4894-858c-3c4af9301b70 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:32.708514 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf85930-65d9-4894-858c-3c4af9301b70 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:32.708587 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf85930-65d9-4894-858c-3c4af9301b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:32.726788 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-ecf85930-65d9-4894-858c-3c4af9301b70 None None] MFA Rules not processed for user `3f598b94a850413494da575188706cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:13:32.728046 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-ecf85930-65d9-4894-858c-3c4af9301b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:13:32.736180 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1276/2552] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Oct 15 04:13:32 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:13:32.749221 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65e6cb-50d9-4580-910c-769dd558d16b service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:13:32.762078 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65e6cb-50d9-4580-910c-769dd558d16b service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:13:32.770865 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b79ca-8ab0-4767-9f84-03f166b7e6d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfdf0fb38dd04c75a1c874913ea1bf98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:13:32.772227 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b79ca-8ab0-4767-9f84-03f166b7e6d9 service swift] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:32.772723 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b79ca-8ab0-4767-9f84-03f166b7e6d9 service swift] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:32.773479 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b79ca-8ab0-4767-9f84-03f166b7e6d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:32.783591 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b79ca-8ab0-4767-9f84-03f166b7e6d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:13:32.785213 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b79ca-8ab0-4767-9f84-03f166b7e6d9 service swift] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:13:32.793337 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1277/2553] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Oct 15 04:13:32 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 15 04:13:37.326809 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf85930-65d9-4894-858c-3c4af9301b70 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:13:37.346543 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf85930-65d9-4894-858c-3c4af9301b70 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:13:37.350480 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388a64c-6866-46d1-a59d-3a6b2ef09ac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:13:37.351127 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388a64c-6866-46d1-a59d-3a6b2ef09ac9 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:13:37.351407 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388a64c-6866-46d1-a59d-3a6b2ef09ac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:13:37.351703 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388a64c-6866-46d1-a59d-3a6b2ef09ac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:13:37.353498 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e388a64c-6866-46d1-a59d-3a6b2ef09ac9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:13:37.425072 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388a64c-6866-46d1-a59d-3a6b2ef09ac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:13:37.426529 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388a64c-6866-46d1-a59d-3a6b2ef09ac9 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:13:37.438024 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1277/2554] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:13:37 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:14:00.358257 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b79ca-8ab0-4767-9f84-03f166b7e6d9 service swift] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:14:00.368610 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b79ca-8ab0-4767-9f84-03f166b7e6d9 service swift] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:14:00.372421 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ea872-a1cf-4c97-a138-fcc26244d362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:14:00.373045 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ea872-a1cf-4c97-a138-fcc26244d362 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:14:00.373325 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ea872-a1cf-4c97-a138-fcc26244d362 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:14:00.373596 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ea872-a1cf-4c97-a138-fcc26244d362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:14:00.382397 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ea872-a1cf-4c97-a138-fcc26244d362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:14:00.383846 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ea872-a1cf-4c97-a138-fcc26244d362 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:14:00.393094 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1278/2555] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:14:00 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:14:39.981022 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809e0a8-eae1-4f5a-9a65-f4ce802332b4 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:14:39.981541 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809e0a8-eae1-4f5a-9a65-f4ce802332b4 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:14:39.981630 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809e0a8-eae1-4f5a-9a65-f4ce802332b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:14:39.999557 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-8809e0a8-eae1-4f5a-9a65-f4ce802332b4 None None] MFA Rules not processed for user `987993288a1a42dfa808e39eab41c82c`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:14:40.000950 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-8809e0a8-eae1-4f5a-9a65-f4ce802332b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:14:40.053926 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1278/2556] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:14:39 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:15:01.973502 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ea872-a1cf-4c97-a138-fcc26244d362 service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:01.975019 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-520ea872-a1cf-4c97-a138-fcc26244d362 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:01.991897 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ea872-a1cf-4c97-a138-fcc26244d362 service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:01.997296 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1212e-0188-438b-b4ee-b7d298a59c54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:01.997932 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1212e-0188-438b-b4ee-b7d298a59c54 service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:01.998213 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1212e-0188-438b-b4ee-b7d298a59c54 service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:01.998487 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1212e-0188-438b-b4ee-b7d298a59c54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:02.001016 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-a1a1212e-0188-438b-b4ee-b7d298a59c54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:02.011009 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1212e-0188-438b-b4ee-b7d298a59c54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:02.013136 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1212e-0188-438b-b4ee-b7d298a59c54 service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:02.022417 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1279/2557] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:15:01 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:15:12.168119 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809e0a8-eae1-4f5a-9a65-f4ce802332b4 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:12.186184 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809e0a8-eae1-4f5a-9a65-f4ce802332b4 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:12.193350 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae33bf6-0c39-4973-b945-807b0a41127a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:12.193737 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae33bf6-0c39-4973-b945-807b0a41127a service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:12.194103 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae33bf6-0c39-4973-b945-807b0a41127a service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:12.194482 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae33bf6-0c39-4973-b945-807b0a41127a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:12.196525 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7ae33bf6-0c39-4973-b945-807b0a41127a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:12.213833 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae33bf6-0c39-4973-b945-807b0a41127a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:12.215442 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae33bf6-0c39-4973-b945-807b0a41127a service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:12.237056 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1279/2558] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:15:12 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:15:12.311408 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1212e-0188-438b-b4ee-b7d298a59c54 service nova] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:12.312869 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-a1a1212e-0188-438b-b4ee-b7d298a59c54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:12.362323 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1212e-0188-438b-b4ee-b7d298a59c54 service nova] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:12.366985 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9654d7-0add-44a5-9bed-af706907b0c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:12.367762 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9654d7-0add-44a5-9bed-af706907b0c6 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:12.368240 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9654d7-0add-44a5-9bed-af706907b0c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:12.368689 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9654d7-0add-44a5-9bed-af706907b0c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:12.370932 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-ab9654d7-0add-44a5-9bed-af706907b0c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:12.410405 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9654d7-0add-44a5-9bed-af706907b0c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:12.412587 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9654d7-0add-44a5-9bed-af706907b0c6 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:12.422902 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1280/2559] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:15:12 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:15:13.830757 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae33bf6-0c39-4973-b945-807b0a41127a service nova] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:13.832909 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7ae33bf6-0c39-4973-b945-807b0a41127a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:13.847878 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae33bf6-0c39-4973-b945-807b0a41127a service nova] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:13.854083 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fbc14-3b27-44e6-a113-93d70f55ba0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:13.854571 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fbc14-3b27-44e6-a113-93d70f55ba0c service nova] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:13.854848 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fbc14-3b27-44e6-a113-93d70f55ba0c service nova] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:13.855145 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fbc14-3b27-44e6-a113-93d70f55ba0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:13.857096 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-8c6fbc14-3b27-44e6-a113-93d70f55ba0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:13.869982 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6fbc14-3b27-44e6-a113-93d70f55ba0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:13.871594 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6fbc14-3b27-44e6-a113-93d70f55ba0c service nova] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:13.887015 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1280/2560] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:15:13 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 04:15:19.921554 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335d7bf-ca83-42be-a1f8-7cbb2ae2dd53 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:19.921973 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335d7bf-ca83-42be-a1f8-7cbb2ae2dd53 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:19.922114 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335d7bf-ca83-42be-a1f8-7cbb2ae2dd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:19.940164 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-7335d7bf-ca83-42be-a1f8-7cbb2ae2dd53 None None] MFA Rules not processed for user `3f598b94a850413494da575188706cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:15:19.941358 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-7335d7bf-ca83-42be-a1f8-7cbb2ae2dd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:19.948466 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1281/2561] 10.222.0.30 () {58 vars in 967 bytes} [Fri Oct 15 04:15:19 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:15:19.991331 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fbc14-3b27-44e6-a113-93d70f55ba0c service nova] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:20.002930 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fbc14-3b27-44e6-a113-93d70f55ba0c service nova] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:20.007949 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1218ba-c5a9-421a-96e7-0ba62a51e331 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfdf0fb38dd04c75a1c874913ea1bf98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:20.008572 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1218ba-c5a9-421a-96e7-0ba62a51e331 service swift] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:20.008852 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1218ba-c5a9-421a-96e7-0ba62a51e331 service swift] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:20.009124 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1218ba-c5a9-421a-96e7-0ba62a51e331 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:20.016896 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1218ba-c5a9-421a-96e7-0ba62a51e331 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:20.018468 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1218ba-c5a9-421a-96e7-0ba62a51e331 service swift] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:20.026195 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1281/2562] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Oct 15 04:15:19 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 15 04:15:26.324916 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335d7bf-ca83-42be-a1f8-7cbb2ae2dd53 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:26.389150 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335d7bf-ca83-42be-a1f8-7cbb2ae2dd53 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:26.394139 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613e40f-b603-41ce-9410-7ee10a7703e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:26.395012 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613e40f-b603-41ce-9410-7ee10a7703e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:26.395298 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613e40f-b603-41ce-9410-7ee10a7703e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:26.395575 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613e40f-b603-41ce-9410-7ee10a7703e4 admin admin] PATH_INFO: `/v3/users/5ec3ec37e88a492ca616718e83e15816` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:26.396885 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613e40f-b603-41ce-9410-7ee10a7703e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec3ec37e88a492ca616718e83e15816)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:26.398854 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613e40f-b603-41ce-9410-7ee10a7703e4 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:26.447166 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-4613e40f-b603-41ce-9410-7ee10a7703e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec3ec37e88a492ca616718e83e15816'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:26.458363 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-4613e40f-b603-41ce-9410-7ee10a7703e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec3ec37e88a492ca616718e83e15816'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:26.465434 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-4613e40f-b603-41ce-9410-7ee10a7703e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec3ec37e88a492ca616718e83e15816'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:26.466564 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-4613e40f-b603-41ce-9410-7ee10a7703e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec3ec37e88a492ca616718e83e15816'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:26.473281 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-4613e40f-b603-41ce-9410-7ee10a7703e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec3ec37e88a492ca616718e83e15816'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:26.479303 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1282/2563] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:15:26 2021] DELETE /identity/v3/users/5ec3ec37e88a492ca616718e83e15816 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:15:26.643697 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1218ba-c5a9-421a-96e7-0ba62a51e331 service swift] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:26.654696 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1218ba-c5a9-421a-96e7-0ba62a51e331 service swift] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:26.711733 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7a8ff-be66-4e26-acf6-65763d578500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:26.712520 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7a8ff-be66-4e26-acf6-65763d578500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:26.712803 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7a8ff-be66-4e26-acf6-65763d578500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:26.713079 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7a8ff-be66-4e26-acf6-65763d578500 admin admin] PATH_INFO: `/v3/projects/adf86994ea4b42f08d65aefa85065d65` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:26.714262 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7a8ff-be66-4e26-acf6-65763d578500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adf86994ea4b42f08d65aefa85065d65)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:26.716769 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7a8ff-be66-4e26-acf6-65763d578500 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:26.760195 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-b5c7a8ff-be66-4e26-acf6-65763d578500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adf86994ea4b42f08d65aefa85065d65', 'request_id': 'req-b5c7a8ff-be66-4e26-acf6-65763d578500'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:26.766552 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-b5c7a8ff-be66-4e26-acf6-65763d578500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adf86994ea4b42f08d65aefa85065d65', 'request_id': 'req-b5c7a8ff-be66-4e26-acf6-65763d578500'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:26.771700 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-b5c7a8ff-be66-4e26-acf6-65763d578500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adf86994ea4b42f08d65aefa85065d65', 'request_id': 'req-b5c7a8ff-be66-4e26-acf6-65763d578500'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:26.783653 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-b5c7a8ff-be66-4e26-acf6-65763d578500 admin admin] The token cache is being invalidate because project adf86994ea4b42f08d65aefa85065d65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:15:26.783985 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-b5c7a8ff-be66-4e26-acf6-65763d578500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:26.784614 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-b5c7a8ff-be66-4e26-acf6-65763d578500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:26.786090 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1282/2564] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:15:26 2021] DELETE /identity/v3/projects/adf86994ea4b42f08d65aefa85065d65 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:15:26.790155 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613e40f-b603-41ce-9410-7ee10a7703e4 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:26.791537 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-4613e40f-b603-41ce-9410-7ee10a7703e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:26.804199 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613e40f-b603-41ce-9410-7ee10a7703e4 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:26.857191 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69061a-bc2a-4b88-8597-d7754b4f56d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:26.858088 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69061a-bc2a-4b88-8597-d7754b4f56d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:26.858372 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69061a-bc2a-4b88-8597-d7754b4f56d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:26.858644 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69061a-bc2a-4b88-8597-d7754b4f56d8 admin admin] PATH_INFO: `/v3/users/49093c96c34d4ea08f24b0a26d73287b` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:26.859869 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69061a-bc2a-4b88-8597-d7754b4f56d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49093c96c34d4ea08f24b0a26d73287b)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:26.861766 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69061a-bc2a-4b88-8597-d7754b4f56d8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:26.904941 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-ec69061a-bc2a-4b88-8597-d7754b4f56d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49093c96c34d4ea08f24b0a26d73287b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:26.915848 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-ec69061a-bc2a-4b88-8597-d7754b4f56d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49093c96c34d4ea08f24b0a26d73287b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:26.922207 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-ec69061a-bc2a-4b88-8597-d7754b4f56d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49093c96c34d4ea08f24b0a26d73287b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:26.922925 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-ec69061a-bc2a-4b88-8597-d7754b4f56d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49093c96c34d4ea08f24b0a26d73287b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:26.929555 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-ec69061a-bc2a-4b88-8597-d7754b4f56d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49093c96c34d4ea08f24b0a26d73287b'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:26.935300 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1283/2565] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:15:26 2021] DELETE /identity/v3/users/49093c96c34d4ea08f24b0a26d73287b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:15:27.101749 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7a8ff-be66-4e26-acf6-65763d578500 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:27.103323 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-b5c7a8ff-be66-4e26-acf6-65763d578500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:27.117915 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7a8ff-be66-4e26-acf6-65763d578500 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:27.173128 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c4b06-f9d6-47ff-be2a-62347f02a995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:27.173907 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c4b06-f9d6-47ff-be2a-62347f02a995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:27.174187 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c4b06-f9d6-47ff-be2a-62347f02a995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:27.174457 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c4b06-f9d6-47ff-be2a-62347f02a995 admin admin] PATH_INFO: `/v3/projects/67950853bc2942c1b6a7a3207d660fe0` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:27.175637 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c4b06-f9d6-47ff-be2a-62347f02a995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67950853bc2942c1b6a7a3207d660fe0)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:27.177572 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c4b06-f9d6-47ff-be2a-62347f02a995 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:27.222653 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-722c4b06-f9d6-47ff-be2a-62347f02a995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67950853bc2942c1b6a7a3207d660fe0', 'request_id': 'req-722c4b06-f9d6-47ff-be2a-62347f02a995'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:27.228823 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-722c4b06-f9d6-47ff-be2a-62347f02a995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67950853bc2942c1b6a7a3207d660fe0', 'request_id': 'req-722c4b06-f9d6-47ff-be2a-62347f02a995'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:27.235035 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-722c4b06-f9d6-47ff-be2a-62347f02a995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67950853bc2942c1b6a7a3207d660fe0', 'request_id': 'req-722c4b06-f9d6-47ff-be2a-62347f02a995'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:27.247863 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-722c4b06-f9d6-47ff-be2a-62347f02a995 admin admin] The token cache is being invalidate because project 67950853bc2942c1b6a7a3207d660fe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:15:27.248151 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-722c4b06-f9d6-47ff-be2a-62347f02a995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:27.248763 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-722c4b06-f9d6-47ff-be2a-62347f02a995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:27.250323 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1283/2566] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:15:27 2021] DELETE /identity/v3/projects/67950853bc2942c1b6a7a3207d660fe0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:15:42.007888 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69061a-bc2a-4b88-8597-d7754b4f56d8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:42.009274 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-ec69061a-bc2a-4b88-8597-d7754b4f56d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:42.065975 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69061a-bc2a-4b88-8597-d7754b4f56d8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:42.111144 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929a7d8-15ab-41ba-b3b1-f8565f9a17fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:42.111800 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929a7d8-15ab-41ba-b3b1-f8565f9a17fe service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:42.112086 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929a7d8-15ab-41ba-b3b1-f8565f9a17fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:42.112359 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929a7d8-15ab-41ba-b3b1-f8565f9a17fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:42.114088 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-0929a7d8-15ab-41ba-b3b1-f8565f9a17fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:42.176677 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929a7d8-15ab-41ba-b3b1-f8565f9a17fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:42.178019 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929a7d8-15ab-41ba-b3b1-f8565f9a17fe service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:42.187356 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1284/2567] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:15:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:15:45.267041 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c4b06-f9d6-47ff-be2a-62347f02a995 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:45.268768 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-722c4b06-f9d6-47ff-be2a-62347f02a995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:45.281686 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c4b06-f9d6-47ff-be2a-62347f02a995 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:45.286316 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c76b0d-0817-4156-aee7-41a185a1fefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:45.287169 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c76b0d-0817-4156-aee7-41a185a1fefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:45.287454 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c76b0d-0817-4156-aee7-41a185a1fefb admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:45.287767 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c76b0d-0817-4156-aee7-41a185a1fefb admin admin] PATH_INFO: `/v3/users/d795b4264cbe4aff82f5a2b0275ca972` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:45.288960 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c76b0d-0817-4156-aee7-41a185a1fefb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d795b4264cbe4aff82f5a2b0275ca972)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:45.290871 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c76b0d-0817-4156-aee7-41a185a1fefb admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:45.339455 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-d5c76b0d-0817-4156-aee7-41a185a1fefb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd795b4264cbe4aff82f5a2b0275ca972'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:45.350971 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-d5c76b0d-0817-4156-aee7-41a185a1fefb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd795b4264cbe4aff82f5a2b0275ca972'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:45.358080 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-d5c76b0d-0817-4156-aee7-41a185a1fefb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd795b4264cbe4aff82f5a2b0275ca972'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:45.358706 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-d5c76b0d-0817-4156-aee7-41a185a1fefb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd795b4264cbe4aff82f5a2b0275ca972'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:45.366825 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-d5c76b0d-0817-4156-aee7-41a185a1fefb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd795b4264cbe4aff82f5a2b0275ca972'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:45.373038 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1284/2568] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:15:45 2021] DELETE /identity/v3/users/d795b4264cbe4aff82f5a2b0275ca972 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:15:45.552395 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929a7d8-15ab-41ba-b3b1-f8565f9a17fe service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:45.562324 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929a7d8-15ab-41ba-b3b1-f8565f9a17fe service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:45.617766 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b08b0-e0a4-491f-93d1-9b62914b5b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:45.618607 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b08b0-e0a4-491f-93d1-9b62914b5b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:45.618890 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b08b0-e0a4-491f-93d1-9b62914b5b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:45.619163 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b08b0-e0a4-491f-93d1-9b62914b5b4e admin admin] PATH_INFO: `/v3/projects/5b4923cacd2a4baea3b5dcf9522e9b54` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:45.620361 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b08b0-e0a4-491f-93d1-9b62914b5b4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b4923cacd2a4baea3b5dcf9522e9b54)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:45.622257 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b08b0-e0a4-491f-93d1-9b62914b5b4e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:45.665191 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-b94b08b0-e0a4-491f-93d1-9b62914b5b4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b4923cacd2a4baea3b5dcf9522e9b54', 'request_id': 'req-b94b08b0-e0a4-491f-93d1-9b62914b5b4e'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:45.670831 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-b94b08b0-e0a4-491f-93d1-9b62914b5b4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b4923cacd2a4baea3b5dcf9522e9b54', 'request_id': 'req-b94b08b0-e0a4-491f-93d1-9b62914b5b4e'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:45.676528 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-b94b08b0-e0a4-491f-93d1-9b62914b5b4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b4923cacd2a4baea3b5dcf9522e9b54', 'request_id': 'req-b94b08b0-e0a4-491f-93d1-9b62914b5b4e'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:45.688590 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-b94b08b0-e0a4-491f-93d1-9b62914b5b4e admin admin] The token cache is being invalidate because project 5b4923cacd2a4baea3b5dcf9522e9b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:15:45.688894 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-b94b08b0-e0a4-491f-93d1-9b62914b5b4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:45.689514 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-b94b08b0-e0a4-491f-93d1-9b62914b5b4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:45.691065 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1285/2569] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:15:45 2021] DELETE /identity/v3/projects/5b4923cacd2a4baea3b5dcf9522e9b54 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:15:45.698162 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0044f-3f82-4933-acff-0e274d83d867 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:45.698428 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0044f-3f82-4933-acff-0e274d83d867 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:45.698717 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0044f-3f82-4933-acff-0e274d83d867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:45.716545 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-51a0044f-3f82-4933-acff-0e274d83d867 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:15:45.717748 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-51a0044f-3f82-4933-acff-0e274d83d867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:45.772962 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1285/2570] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:15:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 04:15:45.780662 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4fece-3ac1-4d05-9148-0116852d1442 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:45.780954 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4fece-3ac1-4d05-9148-0116852d1442 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:45.781230 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4fece-3ac1-4d05-9148-0116852d1442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:45.800221 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-b4d4fece-3ac1-4d05-9148-0116852d1442 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:15:45.801353 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-b4d4fece-3ac1-4d05-9148-0116852d1442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:45.809163 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1286/2571] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:15:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 04:15:45.813117 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0044f-3f82-4933-acff-0e274d83d867 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:45.822717 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0044f-3f82-4933-acff-0e274d83d867 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:45.827276 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a229f-575b-4684-94ff-152dc3f90851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:45.827950 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a229f-575b-4684-94ff-152dc3f90851 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:45.828236 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a229f-575b-4684-94ff-152dc3f90851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:45.828511 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a229f-575b-4684-94ff-152dc3f90851 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:45.829229 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a229f-575b-4684-94ff-152dc3f90851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 04:15:45.829533 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a229f-575b-4684-94ff-152dc3f90851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:45.831135 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a229f-575b-4684-94ff-152dc3f90851 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:45.842383 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1286/2572] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 04:15:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 04:15:45.846562 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4fece-3ac1-4d05-9148-0116852d1442 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:45.856697 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4fece-3ac1-4d05-9148-0116852d1442 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:45.862186 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc6675-2bf5-4325-881a-691bafe20aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:45.862950 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc6675-2bf5-4325-881a-691bafe20aae admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:45.863255 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc6675-2bf5-4325-881a-691bafe20aae admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:45.863532 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc6675-2bf5-4325-881a-691bafe20aae admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:45.864273 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc6675-2bf5-4325-881a-691bafe20aae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:45.866179 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc6675-2bf5-4325-881a-691bafe20aae admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:45.894345 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1287/2573] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:15:45 2021] POST /identity/v3/projects => generated 405 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 04:15:45.895623 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a229f-575b-4684-94ff-152dc3f90851 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:45.905533 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a229f-575b-4684-94ff-152dc3f90851 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:45.959238 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb241c6-cf40-406b-9b1e-cdb3717803af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:45.959919 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb241c6-cf40-406b-9b1e-cdb3717803af admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:45.960217 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb241c6-cf40-406b-9b1e-cdb3717803af admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:45.960603 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb241c6-cf40-406b-9b1e-cdb3717803af admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:45.961389 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb241c6-cf40-406b-9b1e-cdb3717803af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:45.963698 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb241c6-cf40-406b-9b1e-cdb3717803af admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:45.983008 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1287/2574] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:15:45 2021] POST /identity/v3/users => generated 303 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:15:45.987797 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc6675-2bf5-4325-881a-691bafe20aae admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:45.997987 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc6675-2bf5-4325-881a-691bafe20aae admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:46.002704 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4ec5e-05b6-4c6a-9844-98156dc3d515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:46.003350 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4ec5e-05b6-4c6a-9844-98156dc3d515 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:46.003631 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4ec5e-05b6-4c6a-9844-98156dc3d515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:46.003947 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4ec5e-05b6-4c6a-9844-98156dc3d515 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:46.004711 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4ec5e-05b6-4c6a-9844-98156dc3d515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:46.006299 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4ec5e-05b6-4c6a-9844-98156dc3d515 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:46.016360 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1288/2575] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:15:45 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:15:46.020343 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb241c6-cf40-406b-9b1e-cdb3717803af admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:46.029901 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb241c6-cf40-406b-9b1e-cdb3717803af admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:46.035017 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05402321-e3a1-416f-b2d1-540f729763e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:46.035707 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05402321-e3a1-416f-b2d1-540f729763e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:46.035994 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05402321-e3a1-416f-b2d1-540f729763e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:46.036297 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05402321-e3a1-416f-b2d1-540f729763e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:46.037064 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05402321-e3a1-416f-b2d1-540f729763e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:46.038694 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05402321-e3a1-416f-b2d1-540f729763e2 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:46.052257 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1288/2576] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:15:46 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:15:46.053467 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4ec5e-05b6-4c6a-9844-98156dc3d515 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:46.064618 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4ec5e-05b6-4c6a-9844-98156dc3d515 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:46.069334 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c402d59-5dfd-4854-a1c6-99bbe9b5bf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:46.070199 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c402d59-5dfd-4854-a1c6-99bbe9b5bf59 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:46.070481 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c402d59-5dfd-4854-a1c6-99bbe9b5bf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:46.070757 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c402d59-5dfd-4854-a1c6-99bbe9b5bf59 admin admin] PATH_INFO: `/v3/projects/55dc291a750f4511b16ccdeefd6732a1/users/60d01ecf968442088ad91287a7481d29/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:46.084759 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c402d59-5dfd-4854-a1c6-99bbe9b5bf59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55dc291a750f4511b16ccdeefd6732a1, user_id=60d01ecf968442088ad91287a7481d29, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:46.087402 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c402d59-5dfd-4854-a1c6-99bbe9b5bf59 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:46.100227 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1289/2577] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:15:46 2021] PUT /identity/v3/projects/55dc291a750f4511b16ccdeefd6732a1/users/60d01ecf968442088ad91287a7481d29/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 04:15:46.105180 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33520237-db60-4ff1-9165-4bc80d4b0cf4 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:46.105470 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33520237-db60-4ff1-9165-4bc80d4b0cf4 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:46.105748 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33520237-db60-4ff1-9165-4bc80d4b0cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:46.123897 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-33520237-db60-4ff1-9165-4bc80d4b0cf4 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:15:46.125092 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-33520237-db60-4ff1-9165-4bc80d4b0cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:46.182664 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1289/2578] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:15:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 04:15:46.192595 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c402d59-5dfd-4854-a1c6-99bbe9b5bf59 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:46.194254 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-6c402d59-5dfd-4854-a1c6-99bbe9b5bf59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:46.250079 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c402d59-5dfd-4854-a1c6-99bbe9b5bf59 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:46.253733 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a792aeb-55e4-463c-8b7b-456f5e1c9799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:46.254367 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a792aeb-55e4-463c-8b7b-456f5e1c9799 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:46.254645 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a792aeb-55e4-463c-8b7b-456f5e1c9799 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:46.254919 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a792aeb-55e4-463c-8b7b-456f5e1c9799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:46.268929 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a792aeb-55e4-463c-8b7b-456f5e1c9799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:46.270381 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a792aeb-55e4-463c-8b7b-456f5e1c9799 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:46.279651 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1290/2579] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:15:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:15:46.884918 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fe589-46ba-4cf6-9e24-39da4c935dfb None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:46.885414 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fe589-46ba-4cf6-9e24-39da4c935dfb None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:46.885511 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fe589-46ba-4cf6-9e24-39da4c935dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:46.911725 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-2c5fe589-46ba-4cf6-9e24-39da4c935dfb None None] MFA Rules not processed for user `60d01ecf968442088ad91287a7481d29`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:15:46.913183 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-2c5fe589-46ba-4cf6-9e24-39da4c935dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:46.977795 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1290/2580] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:15:46 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:15:46.983220 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a792aeb-55e4-463c-8b7b-456f5e1c9799 service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:47.011649 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a792aeb-55e4-463c-8b7b-456f5e1c9799 service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:47.016372 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c874d06-58ba-4651-aa69-2603ebfb7bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:47.017134 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c874d06-58ba-4651-aa69-2603ebfb7bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:47.017482 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c874d06-58ba-4651-aa69-2603ebfb7bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:47.017823 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c874d06-58ba-4651-aa69-2603ebfb7bc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:47.018593 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c874d06-58ba-4651-aa69-2603ebfb7bc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:47.020608 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c874d06-58ba-4651-aa69-2603ebfb7bc8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:47.057002 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1291/2581] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:15:46 2021] POST /identity/v3/projects => generated 403 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:15:47.061136 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fe589-46ba-4cf6-9e24-39da4c935dfb None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:47.072649 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fe589-46ba-4cf6-9e24-39da4c935dfb None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:47.127523 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af4368-7614-4c6f-ba26-9f08015b2377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:47.128214 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af4368-7614-4c6f-ba26-9f08015b2377 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:47.128504 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af4368-7614-4c6f-ba26-9f08015b2377 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:47.128782 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af4368-7614-4c6f-ba26-9f08015b2377 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:47.129486 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af4368-7614-4c6f-ba26-9f08015b2377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:47.131432 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af4368-7614-4c6f-ba26-9f08015b2377 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:47.151331 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1291/2582] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:15:47 2021] POST /identity/v3/users => generated 308 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:15:47.155277 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c874d06-58ba-4651-aa69-2603ebfb7bc8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:47.165353 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c874d06-58ba-4651-aa69-2603ebfb7bc8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:47.169925 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2980bd-0165-4e6d-8255-1b7151822775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:47.170571 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2980bd-0165-4e6d-8255-1b7151822775 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:47.170856 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2980bd-0165-4e6d-8255-1b7151822775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:47.171134 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2980bd-0165-4e6d-8255-1b7151822775 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:47.171904 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2980bd-0165-4e6d-8255-1b7151822775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:47.174038 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2980bd-0165-4e6d-8255-1b7151822775 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:47.183645 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1292/2583] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:15:47 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 04:15:47.187379 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af4368-7614-4c6f-ba26-9f08015b2377 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:47.197558 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af4368-7614-4c6f-ba26-9f08015b2377 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:47.202147 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e8963-d0c2-427e-ad9c-cc4dd1465157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:47.202990 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e8963-d0c2-427e-ad9c-cc4dd1465157 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:47.203270 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e8963-d0c2-427e-ad9c-cc4dd1465157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:47.203542 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e8963-d0c2-427e-ad9c-cc4dd1465157 admin admin] PATH_INFO: `/v3/projects/fdf415b1b5b64fd981cae002893877a7/users/29df9fca7c9e4bdaba9b30bf6f8f8495/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:47.217523 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e8963-d0c2-427e-ad9c-cc4dd1465157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf415b1b5b64fd981cae002893877a7, user_id=29df9fca7c9e4bdaba9b30bf6f8f8495, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:47.220206 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e8963-d0c2-427e-ad9c-cc4dd1465157 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:47.232862 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1292/2584] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:15:47 2021] PUT /identity/v3/projects/fdf415b1b5b64fd981cae002893877a7/users/29df9fca7c9e4bdaba9b30bf6f8f8495/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:15:47.237527 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2980bd-0165-4e6d-8255-1b7151822775 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:47.247483 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2980bd-0165-4e6d-8255-1b7151822775 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:47.300805 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fb448-0356-4fe0-86c2-6a550f2243d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:47.301452 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fb448-0356-4fe0-86c2-6a550f2243d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:47.301732 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fb448-0356-4fe0-86c2-6a550f2243d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:47.302003 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fb448-0356-4fe0-86c2-6a550f2243d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:47.302720 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fb448-0356-4fe0-86c2-6a550f2243d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:47.304338 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fb448-0356-4fe0-86c2-6a550f2243d1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:47.314107 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1293/2585] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:15:47 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:15:47.318298 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e8963-d0c2-427e-ad9c-cc4dd1465157 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:47.328228 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e8963-d0c2-427e-ad9c-cc4dd1465157 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:47.332722 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c91bee-b2ed-416d-ae24-50adfddf3c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:47.333580 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c91bee-b2ed-416d-ae24-50adfddf3c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:47.333857 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c91bee-b2ed-416d-ae24-50adfddf3c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:47.334127 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c91bee-b2ed-416d-ae24-50adfddf3c93 admin admin] PATH_INFO: `/v3/projects/fdf415b1b5b64fd981cae002893877a7/users/29df9fca7c9e4bdaba9b30bf6f8f8495/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:47.336091 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c91bee-b2ed-416d-ae24-50adfddf3c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf415b1b5b64fd981cae002893877a7, user_id=29df9fca7c9e4bdaba9b30bf6f8f8495, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:47.338708 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c91bee-b2ed-416d-ae24-50adfddf3c93 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:47.348936 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1293/2586] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:15:47 2021] PUT /identity/v3/projects/fdf415b1b5b64fd981cae002893877a7/users/29df9fca7c9e4bdaba9b30bf6f8f8495/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:15:47.915376 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a25a6b-b0e9-40f5-8844-27ce7a817def None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:47.915707 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a25a6b-b0e9-40f5-8844-27ce7a817def None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:47.915994 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a25a6b-b0e9-40f5-8844-27ce7a817def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:47.943318 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-34a25a6b-b0e9-40f5-8844-27ce7a817def None None] MFA Rules not processed for user `29df9fca7c9e4bdaba9b30bf6f8f8495`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:15:47.944556 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-34a25a6b-b0e9-40f5-8844-27ce7a817def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:48.012101 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1294/2587] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:15:47 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:15:49.204951 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c91bee-b2ed-416d-ae24-50adfddf3c93 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:49.263157 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c91bee-b2ed-416d-ae24-50adfddf3c93 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:49.268083 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fefc91-c080-47cc-9a1d-005712ea9d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:49.268924 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fefc91-c080-47cc-9a1d-005712ea9d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:49.269205 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fefc91-c080-47cc-9a1d-005712ea9d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:49.269477 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fefc91-c080-47cc-9a1d-005712ea9d42 admin admin] PATH_INFO: `/v3/users/60d01ecf968442088ad91287a7481d29` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:49.270647 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fefc91-c080-47cc-9a1d-005712ea9d42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d01ecf968442088ad91287a7481d29)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:49.272590 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fefc91-c080-47cc-9a1d-005712ea9d42 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:49.316171 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-36fefc91-c080-47cc-9a1d-005712ea9d42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d01ecf968442088ad91287a7481d29'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:49.327189 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-36fefc91-c080-47cc-9a1d-005712ea9d42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d01ecf968442088ad91287a7481d29'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:49.334592 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-36fefc91-c080-47cc-9a1d-005712ea9d42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d01ecf968442088ad91287a7481d29'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:49.335259 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-36fefc91-c080-47cc-9a1d-005712ea9d42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d01ecf968442088ad91287a7481d29'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:49.341815 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-36fefc91-c080-47cc-9a1d-005712ea9d42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d01ecf968442088ad91287a7481d29'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:49.348067 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1294/2588] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:15:49 2021] DELETE /identity/v3/users/60d01ecf968442088ad91287a7481d29 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:15:49.515841 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a25a6b-b0e9-40f5-8844-27ce7a817def None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:49.526825 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a25a6b-b0e9-40f5-8844-27ce7a817def None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:49.581821 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81cce54-c659-446d-967d-2687e607621c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:49.582663 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cce54-c659-446d-967d-2687e607621c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:49.582947 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cce54-c659-446d-967d-2687e607621c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:49.583222 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cce54-c659-446d-967d-2687e607621c admin admin] PATH_INFO: `/v3/projects/55dc291a750f4511b16ccdeefd6732a1` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:49.584402 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81cce54-c659-446d-967d-2687e607621c admin admin] RBAC: Authorizing `identity:delete_project(project_id=55dc291a750f4511b16ccdeefd6732a1)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:49.586311 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81cce54-c659-446d-967d-2687e607621c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:49.629717 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f81cce54-c659-446d-967d-2687e607621c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55dc291a750f4511b16ccdeefd6732a1', 'request_id': 'req-f81cce54-c659-446d-967d-2687e607621c'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:49.635571 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f81cce54-c659-446d-967d-2687e607621c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55dc291a750f4511b16ccdeefd6732a1', 'request_id': 'req-f81cce54-c659-446d-967d-2687e607621c'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:49.640770 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f81cce54-c659-446d-967d-2687e607621c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55dc291a750f4511b16ccdeefd6732a1', 'request_id': 'req-f81cce54-c659-446d-967d-2687e607621c'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:49.652780 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f81cce54-c659-446d-967d-2687e607621c admin admin] The token cache is being invalidate because project 55dc291a750f4511b16ccdeefd6732a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:15:49.653059 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f81cce54-c659-446d-967d-2687e607621c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:49.653656 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f81cce54-c659-446d-967d-2687e607621c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:49.655141 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1295/2589] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:15:49 2021] DELETE /identity/v3/projects/55dc291a750f4511b16ccdeefd6732a1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:15:49.659272 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fefc91-c080-47cc-9a1d-005712ea9d42 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:49.660701 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-36fefc91-c080-47cc-9a1d-005712ea9d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:49.673276 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fefc91-c080-47cc-9a1d-005712ea9d42 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:49.727296 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f343c5-4425-4690-be3a-ad5c88370868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:49.728170 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f343c5-4425-4690-be3a-ad5c88370868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:49.728451 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f343c5-4425-4690-be3a-ad5c88370868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:49.728722 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f343c5-4425-4690-be3a-ad5c88370868 admin admin] PATH_INFO: `/v3/users/29df9fca7c9e4bdaba9b30bf6f8f8495` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:49.729879 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f343c5-4425-4690-be3a-ad5c88370868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29df9fca7c9e4bdaba9b30bf6f8f8495)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:49.732022 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f343c5-4425-4690-be3a-ad5c88370868 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:49.774857 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-14f343c5-4425-4690-be3a-ad5c88370868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29df9fca7c9e4bdaba9b30bf6f8f8495'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:49.785727 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-14f343c5-4425-4690-be3a-ad5c88370868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29df9fca7c9e4bdaba9b30bf6f8f8495'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:49.792404 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-14f343c5-4425-4690-be3a-ad5c88370868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29df9fca7c9e4bdaba9b30bf6f8f8495'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:49.793059 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-14f343c5-4425-4690-be3a-ad5c88370868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29df9fca7c9e4bdaba9b30bf6f8f8495'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:49.799827 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-14f343c5-4425-4690-be3a-ad5c88370868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29df9fca7c9e4bdaba9b30bf6f8f8495'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:49.805473 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1295/2590] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:15:49 2021] DELETE /identity/v3/users/29df9fca7c9e4bdaba9b30bf6f8f8495 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:15:49.968018 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81cce54-c659-446d-967d-2687e607621c admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:49.969453 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-f81cce54-c659-446d-967d-2687e607621c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:49.983700 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81cce54-c659-446d-967d-2687e607621c admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:50.039038 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85409a-785b-4af7-9c76-0ddf4245354d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:50.039829 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85409a-785b-4af7-9c76-0ddf4245354d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:50.040129 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85409a-785b-4af7-9c76-0ddf4245354d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:50.040385 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85409a-785b-4af7-9c76-0ddf4245354d admin admin] PATH_INFO: `/v3/projects/fdf415b1b5b64fd981cae002893877a7` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:50.041558 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85409a-785b-4af7-9c76-0ddf4245354d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdf415b1b5b64fd981cae002893877a7)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:50.043455 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85409a-785b-4af7-9c76-0ddf4245354d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:50.086984 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-de85409a-785b-4af7-9c76-0ddf4245354d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdf415b1b5b64fd981cae002893877a7', 'request_id': 'req-de85409a-785b-4af7-9c76-0ddf4245354d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:50.092974 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-de85409a-785b-4af7-9c76-0ddf4245354d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdf415b1b5b64fd981cae002893877a7', 'request_id': 'req-de85409a-785b-4af7-9c76-0ddf4245354d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:50.098763 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-de85409a-785b-4af7-9c76-0ddf4245354d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdf415b1b5b64fd981cae002893877a7', 'request_id': 'req-de85409a-785b-4af7-9c76-0ddf4245354d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:50.110352 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-de85409a-785b-4af7-9c76-0ddf4245354d admin admin] The token cache is being invalidate because project fdf415b1b5b64fd981cae002893877a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:15:50.110630 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-de85409a-785b-4af7-9c76-0ddf4245354d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:50.111251 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-de85409a-785b-4af7-9c76-0ddf4245354d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:50.112766 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1296/2591] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:15:49 2021] DELETE /identity/v3/projects/fdf415b1b5b64fd981cae002893877a7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:15:50.118431 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef4e2f-e657-4140-81b9-41ae42d1faf0 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:50.118727 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef4e2f-e657-4140-81b9-41ae42d1faf0 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:50.119037 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef4e2f-e657-4140-81b9-41ae42d1faf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:50.136873 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-e9ef4e2f-e657-4140-81b9-41ae42d1faf0 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:15:50.138110 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e9ef4e2f-e657-4140-81b9-41ae42d1faf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:50.193802 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1296/2592] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:15:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:15:50.201713 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827832-124f-409f-9cfd-2a6cc0f4d72f None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:50.202005 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827832-124f-409f-9cfd-2a6cc0f4d72f None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:50.202283 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827832-124f-409f-9cfd-2a6cc0f4d72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:50.221369 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-21827832-124f-409f-9cfd-2a6cc0f4d72f None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:15:50.222677 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-21827832-124f-409f-9cfd-2a6cc0f4d72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:50.230492 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1297/2593] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:15:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:15:50.234738 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef4e2f-e657-4140-81b9-41ae42d1faf0 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:50.247292 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef4e2f-e657-4140-81b9-41ae42d1faf0 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:50.252916 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafaa99-f088-4bd2-b503-5ad2d7a3a833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:50.253570 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafaa99-f088-4bd2-b503-5ad2d7a3a833 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:50.253853 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafaa99-f088-4bd2-b503-5ad2d7a3a833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:50.254130 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafaa99-f088-4bd2-b503-5ad2d7a3a833 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:50.254854 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaafaa99-f088-4bd2-b503-5ad2d7a3a833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 04:15:50.255159 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaafaa99-f088-4bd2-b503-5ad2d7a3a833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:50.256789 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaafaa99-f088-4bd2-b503-5ad2d7a3a833 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:50.268753 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1297/2594] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 04:15:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 04:15:50.273181 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21827832-124f-409f-9cfd-2a6cc0f4d72f None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:50.282146 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21827832-124f-409f-9cfd-2a6cc0f4d72f None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:50.287416 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442359a-c975-4e7a-9d5f-1fdc6399adb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:50.288085 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442359a-c975-4e7a-9d5f-1fdc6399adb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:50.288364 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442359a-c975-4e7a-9d5f-1fdc6399adb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:50.288636 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442359a-c975-4e7a-9d5f-1fdc6399adb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:50.289376 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442359a-c975-4e7a-9d5f-1fdc6399adb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:50.291196 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442359a-c975-4e7a-9d5f-1fdc6399adb8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:50.315957 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1298/2595] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:15:50 2021] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:15:50.319995 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafaa99-f088-4bd2-b503-5ad2d7a3a833 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:50.330432 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafaa99-f088-4bd2-b503-5ad2d7a3a833 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:50.382884 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23185e-5e47-407c-a7e5-62024d433e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:50.383524 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23185e-5e47-407c-a7e5-62024d433e27 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:50.383850 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23185e-5e47-407c-a7e5-62024d433e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:50.384126 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23185e-5e47-407c-a7e5-62024d433e27 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:50.384814 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23185e-5e47-407c-a7e5-62024d433e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:50.386718 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23185e-5e47-407c-a7e5-62024d433e27 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:50.405881 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1298/2596] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:15:50 2021] POST /identity/v3/users => generated 291 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 04:15:50.409932 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442359a-c975-4e7a-9d5f-1fdc6399adb8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:50.419817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442359a-c975-4e7a-9d5f-1fdc6399adb8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:50.424343 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68490492-fd6c-495b-b13d-5b4657fa017d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:50.424978 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68490492-fd6c-495b-b13d-5b4657fa017d admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:50.425260 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68490492-fd6c-495b-b13d-5b4657fa017d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:50.425529 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68490492-fd6c-495b-b13d-5b4657fa017d admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:50.426250 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68490492-fd6c-495b-b13d-5b4657fa017d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:50.427861 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68490492-fd6c-495b-b13d-5b4657fa017d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:50.439433 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1299/2597] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:15:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:15:50.443232 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23185e-5e47-407c-a7e5-62024d433e27 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:50.452929 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23185e-5e47-407c-a7e5-62024d433e27 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:50.458028 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29366518-6fd0-4d86-be80-317deb4ba1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:50.458671 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29366518-6fd0-4d86-be80-317deb4ba1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:50.458952 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29366518-6fd0-4d86-be80-317deb4ba1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:50.459243 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29366518-6fd0-4d86-be80-317deb4ba1d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:50.459983 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29366518-6fd0-4d86-be80-317deb4ba1d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:50.461569 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29366518-6fd0-4d86-be80-317deb4ba1d2 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:50.471088 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1299/2598] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:15:50 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:15:50.474770 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68490492-fd6c-495b-b13d-5b4657fa017d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:50.484331 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68490492-fd6c-495b-b13d-5b4657fa017d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:50.488877 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2cb27-b13b-43a6-a892-236fec5d2a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:50.489730 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2cb27-b13b-43a6-a892-236fec5d2a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:50.490011 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2cb27-b13b-43a6-a892-236fec5d2a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:50.490281 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2cb27-b13b-43a6-a892-236fec5d2a80 admin admin] PATH_INFO: `/v3/projects/35f416722d1047d9a0142bfe6b9c9737/users/b9b89a6ff14648729b5236cf2e1065e6/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:50.504731 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2cb27-b13b-43a6-a892-236fec5d2a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f416722d1047d9a0142bfe6b9c9737, user_id=b9b89a6ff14648729b5236cf2e1065e6, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:50.507386 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2cb27-b13b-43a6-a892-236fec5d2a80 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:50.520340 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1300/2599] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:15:50 2021] PUT /identity/v3/projects/35f416722d1047d9a0142bfe6b9c9737/users/b9b89a6ff14648729b5236cf2e1065e6/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 04:15:50.532726 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58eaf37-1e9d-46cb-93ea-edefcae3c95c None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:50.533017 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58eaf37-1e9d-46cb-93ea-edefcae3c95c None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:50.533296 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58eaf37-1e9d-46cb-93ea-edefcae3c95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:50.558305 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-a58eaf37-1e9d-46cb-93ea-edefcae3c95c None None] MFA Rules not processed for user `b9b89a6ff14648729b5236cf2e1065e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:15:50.559436 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-a58eaf37-1e9d-46cb-93ea-edefcae3c95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:50.620002 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1300/2600] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:15:50 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:15:50.624378 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2cb27-b13b-43a6-a892-236fec5d2a80 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:50.683136 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2cb27-b13b-43a6-a892-236fec5d2a80 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:50.687670 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620457c-6c8d-40f3-90dd-ca63e7161131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:50.689119 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620457c-6c8d-40f3-90dd-ca63e7161131 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:50.689399 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620457c-6c8d-40f3-90dd-ca63e7161131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:50.689668 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620457c-6c8d-40f3-90dd-ca63e7161131 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:50.690350 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620457c-6c8d-40f3-90dd-ca63e7161131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:50.692278 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620457c-6c8d-40f3-90dd-ca63e7161131 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:50.715844 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1301/2601] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:15:50 2021] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:15:50.719711 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58eaf37-1e9d-46cb-93ea-edefcae3c95c None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:50.730004 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58eaf37-1e9d-46cb-93ea-edefcae3c95c None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:50.784400 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db652e8d-bbae-4dd5-a36e-95ba2d80f159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:50.785049 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db652e8d-bbae-4dd5-a36e-95ba2d80f159 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:50.785331 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db652e8d-bbae-4dd5-a36e-95ba2d80f159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:50.785607 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db652e8d-bbae-4dd5-a36e-95ba2d80f159 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:50.786297 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db652e8d-bbae-4dd5-a36e-95ba2d80f159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:50.788229 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db652e8d-bbae-4dd5-a36e-95ba2d80f159 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:50.807594 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1301/2602] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:15:50 2021] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:15:50.811511 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620457c-6c8d-40f3-90dd-ca63e7161131 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:50.822172 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620457c-6c8d-40f3-90dd-ca63e7161131 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:50.826707 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc4f5d-5c77-4f5b-9483-6ef62902967e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:50.827346 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc4f5d-5c77-4f5b-9483-6ef62902967e admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:50.827625 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc4f5d-5c77-4f5b-9483-6ef62902967e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:50.827927 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc4f5d-5c77-4f5b-9483-6ef62902967e admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:50.828649 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc4f5d-5c77-4f5b-9483-6ef62902967e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:50.830230 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc4f5d-5c77-4f5b-9483-6ef62902967e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:50.840196 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1302/2603] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:15:50 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:15:50.843835 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db652e8d-bbae-4dd5-a36e-95ba2d80f159 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:50.853542 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db652e8d-bbae-4dd5-a36e-95ba2d80f159 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:50.858066 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869902f-18f7-41f7-86d1-ff0b4bbedc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:50.858907 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869902f-18f7-41f7-86d1-ff0b4bbedc58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:50.859189 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869902f-18f7-41f7-86d1-ff0b4bbedc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:50.859458 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869902f-18f7-41f7-86d1-ff0b4bbedc58 admin admin] PATH_INFO: `/v3/projects/04cc1150cac844ba9f3e98eb24c38639/users/7b97be78715d4b678544fd3785190f0a/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:50.874059 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869902f-18f7-41f7-86d1-ff0b4bbedc58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04cc1150cac844ba9f3e98eb24c38639, user_id=7b97be78715d4b678544fd3785190f0a, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:50.877359 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869902f-18f7-41f7-86d1-ff0b4bbedc58 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:50.889395 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1302/2604] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:15:50 2021] PUT /identity/v3/projects/04cc1150cac844ba9f3e98eb24c38639/users/7b97be78715d4b678544fd3785190f0a/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 04:15:50.893244 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc4f5d-5c77-4f5b-9483-6ef62902967e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:50.902660 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc4f5d-5c77-4f5b-9483-6ef62902967e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:50.955113 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1251716-f3dc-4d97-9bd9-027fb860f707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:50.955781 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1251716-f3dc-4d97-9bd9-027fb860f707 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:50.956059 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1251716-f3dc-4d97-9bd9-027fb860f707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:50.956332 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1251716-f3dc-4d97-9bd9-027fb860f707 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:50.957056 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1251716-f3dc-4d97-9bd9-027fb860f707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:50.958623 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1251716-f3dc-4d97-9bd9-027fb860f707 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:50.968419 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1303/2605] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:15:50 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:15:50.972448 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869902f-18f7-41f7-86d1-ff0b4bbedc58 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:50.982220 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869902f-18f7-41f7-86d1-ff0b4bbedc58 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:50.987255 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341246c-07d5-4328-8dcf-acf384d9b578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:50.988148 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341246c-07d5-4328-8dcf-acf384d9b578 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:50.988426 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341246c-07d5-4328-8dcf-acf384d9b578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:50.988693 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341246c-07d5-4328-8dcf-acf384d9b578 admin admin] PATH_INFO: `/v3/projects/04cc1150cac844ba9f3e98eb24c38639/users/7b97be78715d4b678544fd3785190f0a/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:50.990645 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341246c-07d5-4328-8dcf-acf384d9b578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04cc1150cac844ba9f3e98eb24c38639, user_id=7b97be78715d4b678544fd3785190f0a, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:50.993299 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341246c-07d5-4328-8dcf-acf384d9b578 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:51.003767 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1303/2606] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:15:50 2021] PUT /identity/v3/projects/04cc1150cac844ba9f3e98eb24c38639/users/7b97be78715d4b678544fd3785190f0a/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:15:51.013586 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249750c-afbf-4e13-9d05-053db94ebf7a None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:51.013875 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249750c-afbf-4e13-9d05-053db94ebf7a None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:51.014152 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249750c-afbf-4e13-9d05-053db94ebf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:51.040709 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-8249750c-afbf-4e13-9d05-053db94ebf7a None None] MFA Rules not processed for user `7b97be78715d4b678544fd3785190f0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:15:51.041895 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-8249750c-afbf-4e13-9d05-053db94ebf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:51.104683 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1304/2607] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:15:51 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:15:51.114899 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341246c-07d5-4328-8dcf-acf384d9b578 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:51.116599 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-a341246c-07d5-4328-8dcf-acf384d9b578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:51.169792 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341246c-07d5-4328-8dcf-acf384d9b578 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:51.173990 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2ee48-a18d-4a22-b00e-9a9418b1b791 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:51.174615 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2ee48-a18d-4a22-b00e-9a9418b1b791 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:51.174895 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2ee48-a18d-4a22-b00e-9a9418b1b791 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:51.175166 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2ee48-a18d-4a22-b00e-9a9418b1b791 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:51.184065 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2ee48-a18d-4a22-b00e-9a9418b1b791 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:51.185527 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2ee48-a18d-4a22-b00e-9a9418b1b791 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:51.195127 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1304/2608] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:15:51 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:15:51.514881 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249750c-afbf-4e13-9d05-053db94ebf7a None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:51.573608 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249750c-afbf-4e13-9d05-053db94ebf7a None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:51.578024 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b395c3d-c8ab-49b9-a14e-1f8f8a3de479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:51.578862 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b395c3d-c8ab-49b9-a14e-1f8f8a3de479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:51.579656 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b395c3d-c8ab-49b9-a14e-1f8f8a3de479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:51.579957 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b395c3d-c8ab-49b9-a14e-1f8f8a3de479 admin admin] PATH_INFO: `/v3/users/b9b89a6ff14648729b5236cf2e1065e6` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:51.581225 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b395c3d-c8ab-49b9-a14e-1f8f8a3de479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9b89a6ff14648729b5236cf2e1065e6)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:51.583116 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b395c3d-c8ab-49b9-a14e-1f8f8a3de479 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:51.625984 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2b395c3d-c8ab-49b9-a14e-1f8f8a3de479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9b89a6ff14648729b5236cf2e1065e6'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:51.637087 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2b395c3d-c8ab-49b9-a14e-1f8f8a3de479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9b89a6ff14648729b5236cf2e1065e6'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:51.644628 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2b395c3d-c8ab-49b9-a14e-1f8f8a3de479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9b89a6ff14648729b5236cf2e1065e6'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:51.645362 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2b395c3d-c8ab-49b9-a14e-1f8f8a3de479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9b89a6ff14648729b5236cf2e1065e6'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:51.652111 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2b395c3d-c8ab-49b9-a14e-1f8f8a3de479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9b89a6ff14648729b5236cf2e1065e6'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:51.658357 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1305/2609] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:15:51 2021] DELETE /identity/v3/users/b9b89a6ff14648729b5236cf2e1065e6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:15:51.662810 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c06642-133c-4909-b57e-f82a47e93574 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:51.663273 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c06642-133c-4909-b57e-f82a47e93574 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:51.663366 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c06642-133c-4909-b57e-f82a47e93574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:51.680660 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-05c06642-133c-4909-b57e-f82a47e93574 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:15:51.681857 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-05c06642-133c-4909-b57e-f82a47e93574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:51.738126 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1305/2610] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:15:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:15:51.747968 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b395c3d-c8ab-49b9-a14e-1f8f8a3de479 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:51.749384 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-2b395c3d-c8ab-49b9-a14e-1f8f8a3de479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:51.804058 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b395c3d-c8ab-49b9-a14e-1f8f8a3de479 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:51.807725 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1fec4-99d3-4ea8-a054-ba28a0db8c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:51.808362 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1fec4-99d3-4ea8-a054-ba28a0db8c69 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:51.808642 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1fec4-99d3-4ea8-a054-ba28a0db8c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:51.808916 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1fec4-99d3-4ea8-a054-ba28a0db8c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:51.818375 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1fec4-99d3-4ea8-a054-ba28a0db8c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:51.819821 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1fec4-99d3-4ea8-a054-ba28a0db8c69 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:51.828930 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1306/2611] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:15:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:15:52.081987 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c06642-133c-4909-b57e-f82a47e93574 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:52.083417 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-05c06642-133c-4909-b57e-f82a47e93574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:52.096493 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c06642-133c-4909-b57e-f82a47e93574 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:52.101037 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34ef59-ae15-4b80-b01d-d9c0aa924e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:52.102613 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34ef59-ae15-4b80-b01d-d9c0aa924e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:52.102913 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34ef59-ae15-4b80-b01d-d9c0aa924e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:52.103187 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34ef59-ae15-4b80-b01d-d9c0aa924e59 admin admin] PATH_INFO: `/v3/projects/35f416722d1047d9a0142bfe6b9c9737` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:52.104479 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34ef59-ae15-4b80-b01d-d9c0aa924e59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35f416722d1047d9a0142bfe6b9c9737)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:52.106286 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34ef59-ae15-4b80-b01d-d9c0aa924e59 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:52.151447 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-1a34ef59-ae15-4b80-b01d-d9c0aa924e59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35f416722d1047d9a0142bfe6b9c9737', 'request_id': 'req-1a34ef59-ae15-4b80-b01d-d9c0aa924e59'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:52.157391 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-1a34ef59-ae15-4b80-b01d-d9c0aa924e59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35f416722d1047d9a0142bfe6b9c9737', 'request_id': 'req-1a34ef59-ae15-4b80-b01d-d9c0aa924e59'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:52.162529 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-1a34ef59-ae15-4b80-b01d-d9c0aa924e59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35f416722d1047d9a0142bfe6b9c9737', 'request_id': 'req-1a34ef59-ae15-4b80-b01d-d9c0aa924e59'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:52.174395 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-1a34ef59-ae15-4b80-b01d-d9c0aa924e59 admin admin] The token cache is being invalidate because project 35f416722d1047d9a0142bfe6b9c9737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:15:52.174617 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-1a34ef59-ae15-4b80-b01d-d9c0aa924e59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:52.175238 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-1a34ef59-ae15-4b80-b01d-d9c0aa924e59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:52.176909 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1306/2612] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:15:52 2021] DELETE /identity/v3/projects/35f416722d1047d9a0142bfe6b9c9737 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:15:52.180817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1fec4-99d3-4ea8-a054-ba28a0db8c69 service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:52.192419 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1fec4-99d3-4ea8-a054-ba28a0db8c69 service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:52.247342 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf9d57-2820-403b-9d9c-5158b5b7bd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:52.248224 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf9d57-2820-403b-9d9c-5158b5b7bd51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:52.248504 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf9d57-2820-403b-9d9c-5158b5b7bd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:52.248777 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf9d57-2820-403b-9d9c-5158b5b7bd51 admin admin] PATH_INFO: `/v3/users/7b97be78715d4b678544fd3785190f0a` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:52.249955 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf9d57-2820-403b-9d9c-5158b5b7bd51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b97be78715d4b678544fd3785190f0a)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:52.252558 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf9d57-2820-403b-9d9c-5158b5b7bd51 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:52.293978 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8fcf9d57-2820-403b-9d9c-5158b5b7bd51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b97be78715d4b678544fd3785190f0a'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:52.305549 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8fcf9d57-2820-403b-9d9c-5158b5b7bd51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b97be78715d4b678544fd3785190f0a'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:52.311895 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8fcf9d57-2820-403b-9d9c-5158b5b7bd51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b97be78715d4b678544fd3785190f0a'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:52.312520 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8fcf9d57-2820-403b-9d9c-5158b5b7bd51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b97be78715d4b678544fd3785190f0a'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:52.319863 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8fcf9d57-2820-403b-9d9c-5158b5b7bd51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b97be78715d4b678544fd3785190f0a'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:52.325440 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1307/2613] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:15:52 2021] DELETE /identity/v3/users/7b97be78715d4b678544fd3785190f0a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:15:52.576948 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34ef59-ae15-4b80-b01d-d9c0aa924e59 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:52.578473 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-1a34ef59-ae15-4b80-b01d-d9c0aa924e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:52.592882 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34ef59-ae15-4b80-b01d-d9c0aa924e59 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:52.647657 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add0fec-1280-443e-8a4e-46fc7eb039f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:52.648525 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add0fec-1280-443e-8a4e-46fc7eb039f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:52.648803 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add0fec-1280-443e-8a4e-46fc7eb039f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:52.649074 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add0fec-1280-443e-8a4e-46fc7eb039f3 admin admin] PATH_INFO: `/v3/projects/04cc1150cac844ba9f3e98eb24c38639` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:52.650237 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add0fec-1280-443e-8a4e-46fc7eb039f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04cc1150cac844ba9f3e98eb24c38639)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:52.652160 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add0fec-1280-443e-8a4e-46fc7eb039f3 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:52.696170 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-6add0fec-1280-443e-8a4e-46fc7eb039f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04cc1150cac844ba9f3e98eb24c38639', 'request_id': 'req-6add0fec-1280-443e-8a4e-46fc7eb039f3'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:52.702071 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-6add0fec-1280-443e-8a4e-46fc7eb039f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04cc1150cac844ba9f3e98eb24c38639', 'request_id': 'req-6add0fec-1280-443e-8a4e-46fc7eb039f3'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:52.707455 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-6add0fec-1280-443e-8a4e-46fc7eb039f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04cc1150cac844ba9f3e98eb24c38639', 'request_id': 'req-6add0fec-1280-443e-8a4e-46fc7eb039f3'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:52.718617 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-6add0fec-1280-443e-8a4e-46fc7eb039f3 admin admin] The token cache is being invalidate because project 04cc1150cac844ba9f3e98eb24c38639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:15:52.718932 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-6add0fec-1280-443e-8a4e-46fc7eb039f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:52.719545 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-6add0fec-1280-443e-8a4e-46fc7eb039f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:15:52.721583 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1307/2614] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:15:52 2021] DELETE /identity/v3/projects/04cc1150cac844ba9f3e98eb24c38639 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:15:52.727566 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35c09d-39bb-4369-ad46-8ac433e37406 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:52.728065 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35c09d-39bb-4369-ad46-8ac433e37406 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:52.728162 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35c09d-39bb-4369-ad46-8ac433e37406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:52.746340 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-9d35c09d-39bb-4369-ad46-8ac433e37406 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:15:52.747524 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-9d35c09d-39bb-4369-ad46-8ac433e37406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:52.803248 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1308/2615] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:15:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:15:52.812195 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c9d01-1750-4e7b-a1ef-a08f88f89019 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:52.812482 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c9d01-1750-4e7b-a1ef-a08f88f89019 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:52.812753 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c9d01-1750-4e7b-a1ef-a08f88f89019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:52.830751 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-125c9d01-1750-4e7b-a1ef-a08f88f89019 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:15:52.831979 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-125c9d01-1750-4e7b-a1ef-a08f88f89019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:52.839672 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1308/2616] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:15:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:15:52.843761 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35c09d-39bb-4369-ad46-8ac433e37406 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:52.853511 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35c09d-39bb-4369-ad46-8ac433e37406 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:52.857998 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6376cd-ed0f-4396-90af-c74f478ca016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:52.858631 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6376cd-ed0f-4396-90af-c74f478ca016 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:52.858908 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6376cd-ed0f-4396-90af-c74f478ca016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:52.859190 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6376cd-ed0f-4396-90af-c74f478ca016 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:52.859939 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6376cd-ed0f-4396-90af-c74f478ca016 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 04:15:52.860239 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6376cd-ed0f-4396-90af-c74f478ca016 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:52.862424 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6376cd-ed0f-4396-90af-c74f478ca016 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:52.873369 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1309/2617] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 04:15:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 04:15:52.877396 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c9d01-1750-4e7b-a1ef-a08f88f89019 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:52.886230 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c9d01-1750-4e7b-a1ef-a08f88f89019 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:52.890810 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa82804-e48d-4654-bf76-399fc7e6a9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:52.891440 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa82804-e48d-4654-bf76-399fc7e6a9dd admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:52.891755 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa82804-e48d-4654-bf76-399fc7e6a9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:52.892523 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa82804-e48d-4654-bf76-399fc7e6a9dd admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:52.893212 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa82804-e48d-4654-bf76-399fc7e6a9dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:52.895112 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa82804-e48d-4654-bf76-399fc7e6a9dd admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:52.925398 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1309/2618] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:15:52 2021] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:15:52.929641 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6376cd-ed0f-4396-90af-c74f478ca016 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:52.939555 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6376cd-ed0f-4396-90af-c74f478ca016 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:52.992954 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5220570-7b96-4840-b4d3-706250ac5b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:52.993603 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5220570-7b96-4840-b4d3-706250ac5b78 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:52.993880 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5220570-7b96-4840-b4d3-706250ac5b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:52.994157 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5220570-7b96-4840-b4d3-706250ac5b78 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:52.994849 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5220570-7b96-4840-b4d3-706250ac5b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:52.996856 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5220570-7b96-4840-b4d3-706250ac5b78 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:53.019049 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1310/2619] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:15:52 2021] POST /identity/v3/users => generated 287 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:15:53.020238 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa82804-e48d-4654-bf76-399fc7e6a9dd admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:53.030295 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa82804-e48d-4654-bf76-399fc7e6a9dd admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:53.035508 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba81c30-8a43-4ff3-af95-79c8da53d265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:53.036199 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba81c30-8a43-4ff3-af95-79c8da53d265 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:53.036486 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba81c30-8a43-4ff3-af95-79c8da53d265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:53.036767 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba81c30-8a43-4ff3-af95-79c8da53d265 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:53.037491 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba81c30-8a43-4ff3-af95-79c8da53d265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:53.039091 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba81c30-8a43-4ff3-af95-79c8da53d265 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:53.049133 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1310/2620] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:15:53 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 04:15:53.052748 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5220570-7b96-4840-b4d3-706250ac5b78 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:53.062271 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5220570-7b96-4840-b4d3-706250ac5b78 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:53.067340 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8ab63-472b-4cb5-a0a3-63609e4c4e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:53.068020 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8ab63-472b-4cb5-a0a3-63609e4c4e7a admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:53.068307 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8ab63-472b-4cb5-a0a3-63609e4c4e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:53.068586 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8ab63-472b-4cb5-a0a3-63609e4c4e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:53.069314 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8ab63-472b-4cb5-a0a3-63609e4c4e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:53.070888 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8ab63-472b-4cb5-a0a3-63609e4c4e7a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:53.080823 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1311/2621] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:15:53 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:15:53.084632 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba81c30-8a43-4ff3-af95-79c8da53d265 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:53.094107 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba81c30-8a43-4ff3-af95-79c8da53d265 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:53.099236 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470752a-e33b-4ad6-b15d-c4d0ffd0039c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:53.100120 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470752a-e33b-4ad6-b15d-c4d0ffd0039c admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:53.100403 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470752a-e33b-4ad6-b15d-c4d0ffd0039c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:53.100675 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470752a-e33b-4ad6-b15d-c4d0ffd0039c admin admin] PATH_INFO: `/v3/projects/eeb0c86cbaa84a75bc17e524e3376243/users/7a4a23923eea43f2a814f74075f93dd2/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:53.114311 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470752a-e33b-4ad6-b15d-c4d0ffd0039c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb0c86cbaa84a75bc17e524e3376243, user_id=7a4a23923eea43f2a814f74075f93dd2, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:53.117008 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470752a-e33b-4ad6-b15d-c4d0ffd0039c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:53.129469 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1311/2622] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:15:53 2021] PUT /identity/v3/projects/eeb0c86cbaa84a75bc17e524e3376243/users/7a4a23923eea43f2a814f74075f93dd2/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:15:53.134420 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0a584-a88b-4ef9-839c-5abef3d545d2 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:53.134716 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0a584-a88b-4ef9-839c-5abef3d545d2 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:53.134999 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0a584-a88b-4ef9-839c-5abef3d545d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:53.152637 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-aab0a584-a88b-4ef9-839c-5abef3d545d2 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:15:53.153833 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-aab0a584-a88b-4ef9-839c-5abef3d545d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:53.209159 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1312/2623] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:15:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:15:53.218974 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470752a-e33b-4ad6-b15d-c4d0ffd0039c admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:53.221393 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c470752a-e33b-4ad6-b15d-c4d0ffd0039c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:53.285892 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470752a-e33b-4ad6-b15d-c4d0ffd0039c admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:53.289591 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58438e83-ef30-48be-aedd-964da7aa51a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:53.290234 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58438e83-ef30-48be-aedd-964da7aa51a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:53.290518 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58438e83-ef30-48be-aedd-964da7aa51a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:53.290848 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58438e83-ef30-48be-aedd-964da7aa51a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:53.300623 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58438e83-ef30-48be-aedd-964da7aa51a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:53.302069 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58438e83-ef30-48be-aedd-964da7aa51a8 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:53.311849 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1312/2624] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:15:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 04:15:54.273770 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708275bf-31ca-4561-bc75-5250a47aa17e None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:54.274239 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708275bf-31ca-4561-bc75-5250a47aa17e None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:54.274342 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708275bf-31ca-4561-bc75-5250a47aa17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:54.303167 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-708275bf-31ca-4561-bc75-5250a47aa17e None None] MFA Rules not processed for user `7a4a23923eea43f2a814f74075f93dd2`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:15:54.304404 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-708275bf-31ca-4561-bc75-5250a47aa17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:54.372652 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1313/2625] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:15:54 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:15:54.377118 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58438e83-ef30-48be-aedd-964da7aa51a8 service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:54.386930 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58438e83-ef30-48be-aedd-964da7aa51a8 service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:54.393215 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71bf07-557e-439e-b44c-b217c2c6ab4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:54.393863 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71bf07-557e-439e-b44c-b217c2c6ab4b admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:54.394147 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71bf07-557e-439e-b44c-b217c2c6ab4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:54.394421 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71bf07-557e-439e-b44c-b217c2c6ab4b admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:54.395133 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71bf07-557e-439e-b44c-b217c2c6ab4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:54.397077 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71bf07-557e-439e-b44c-b217c2c6ab4b admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:54.425971 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1313/2626] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:15:54 2021] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:15:54.429933 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708275bf-31ca-4561-bc75-5250a47aa17e None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:54.442637 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708275bf-31ca-4561-bc75-5250a47aa17e None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:54.501558 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71f385-8f5f-481e-bf4f-98ccbc44decc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:54.502222 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71f385-8f5f-481e-bf4f-98ccbc44decc admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:54.502503 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71f385-8f5f-481e-bf4f-98ccbc44decc admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:54.502780 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71f385-8f5f-481e-bf4f-98ccbc44decc admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:54.503537 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e71f385-8f5f-481e-bf4f-98ccbc44decc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:54.505478 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e71f385-8f5f-481e-bf4f-98ccbc44decc admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:54.526294 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1314/2627] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:15:54 2021] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 04:15:54.530232 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71bf07-557e-439e-b44c-b217c2c6ab4b admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:54.545345 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71bf07-557e-439e-b44c-b217c2c6ab4b admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:54.550183 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3540b-bdd9-416f-b32e-c21e2e8212e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:54.550842 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3540b-bdd9-416f-b32e-c21e2e8212e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:54.551126 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3540b-bdd9-416f-b32e-c21e2e8212e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:54.551401 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3540b-bdd9-416f-b32e-c21e2e8212e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:54.552164 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3540b-bdd9-416f-b32e-c21e2e8212e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:54.553769 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3540b-bdd9-416f-b32e-c21e2e8212e1 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:54.566044 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1314/2628] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:15:54 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:15:54.570328 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71f385-8f5f-481e-bf4f-98ccbc44decc admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:54.580896 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71f385-8f5f-481e-bf4f-98ccbc44decc admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:54.586032 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010a49e-5fa0-4e70-9e35-bc18669761fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:54.586898 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010a49e-5fa0-4e70-9e35-bc18669761fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:54.587173 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010a49e-5fa0-4e70-9e35-bc18669761fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:54.587440 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010a49e-5fa0-4e70-9e35-bc18669761fc admin admin] PATH_INFO: `/v3/projects/997a1e4d2eb1400a9e4c3a2329bd2566/users/147e04dcaba6465fa3955f3849282ef8/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:54.602412 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010a49e-5fa0-4e70-9e35-bc18669761fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=997a1e4d2eb1400a9e4c3a2329bd2566, user_id=147e04dcaba6465fa3955f3849282ef8, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:54.605094 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010a49e-5fa0-4e70-9e35-bc18669761fc admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:54.618472 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1315/2629] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:15:54 2021] PUT /identity/v3/projects/997a1e4d2eb1400a9e4c3a2329bd2566/users/147e04dcaba6465fa3955f3849282ef8/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:15:54.622539 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3540b-bdd9-416f-b32e-c21e2e8212e1 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:54.632409 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3540b-bdd9-416f-b32e-c21e2e8212e1 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:54.686297 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6612a-e6d1-484d-b71d-07b3aaad72f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:54.686982 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6612a-e6d1-484d-b71d-07b3aaad72f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:54.687266 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6612a-e6d1-484d-b71d-07b3aaad72f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:54.687539 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6612a-e6d1-484d-b71d-07b3aaad72f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:54.688550 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6612a-e6d1-484d-b71d-07b3aaad72f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:54.690220 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6612a-e6d1-484d-b71d-07b3aaad72f4 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:54.700094 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1315/2630] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:15:54 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:15:54.703989 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010a49e-5fa0-4e70-9e35-bc18669761fc admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:54.714524 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010a49e-5fa0-4e70-9e35-bc18669761fc admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:54.719017 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f07db-8938-4ef9-b13d-a0a61827f5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:54.720507 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f07db-8938-4ef9-b13d-a0a61827f5ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:54.720785 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f07db-8938-4ef9-b13d-a0a61827f5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:54.721058 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f07db-8938-4ef9-b13d-a0a61827f5ec admin admin] PATH_INFO: `/v3/projects/997a1e4d2eb1400a9e4c3a2329bd2566/users/147e04dcaba6465fa3955f3849282ef8/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:54.723407 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f07db-8938-4ef9-b13d-a0a61827f5ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=997a1e4d2eb1400a9e4c3a2329bd2566, user_id=147e04dcaba6465fa3955f3849282ef8, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:54.726088 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f07db-8938-4ef9-b13d-a0a61827f5ec admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:54.736100 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1316/2631] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:15:54 2021] PUT /identity/v3/projects/997a1e4d2eb1400a9e4c3a2329bd2566/users/147e04dcaba6465fa3955f3849282ef8/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 04:15:55.303021 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9ce14-dcdf-46aa-b933-76e459528337 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:55.303315 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9ce14-dcdf-46aa-b933-76e459528337 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:55.303594 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9ce14-dcdf-46aa-b933-76e459528337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:55.330703 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-c1c9ce14-dcdf-46aa-b933-76e459528337 None None] MFA Rules not processed for user `147e04dcaba6465fa3955f3849282ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:15:55.331960 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c1c9ce14-dcdf-46aa-b933-76e459528337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:55.398033 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1316/2632] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:15:55 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:15:55.408168 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f07db-8938-4ef9-b13d-a0a61827f5ec admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:55.409842 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-e28f07db-8938-4ef9-b13d-a0a61827f5ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:55.466899 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f07db-8938-4ef9-b13d-a0a61827f5ec admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:55.470873 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f8f1d-6d52-46a1-b9bb-ea4a32ef49fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:55.471522 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f8f1d-6d52-46a1-b9bb-ea4a32ef49fe service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:55.471834 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f8f1d-6d52-46a1-b9bb-ea4a32ef49fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:55.472112 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f8f1d-6d52-46a1-b9bb-ea4a32ef49fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:55.527653 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f8f1d-6d52-46a1-b9bb-ea4a32ef49fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:55.529124 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f8f1d-6d52-46a1-b9bb-ea4a32ef49fe service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:55.538284 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1317/2633] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:15:55 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:15:56.856509 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9ce14-dcdf-46aa-b933-76e459528337 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:15:56.857993 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c1c9ce14-dcdf-46aa-b933-76e459528337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:15:56.869973 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9ce14-dcdf-46aa-b933-76e459528337 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:15:56.873447 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb243c12-5f86-4b0c-9392-218bd565526d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:15:56.874066 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb243c12-5f86-4b0c-9392-218bd565526d service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:15:56.874345 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb243c12-5f86-4b0c-9392-218bd565526d service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:15:56.874616 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb243c12-5f86-4b0c-9392-218bd565526d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:15:56.883961 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb243c12-5f86-4b0c-9392-218bd565526d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:15:56.885369 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb243c12-5f86-4b0c-9392-218bd565526d service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:15:56.894528 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1317/2634] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:15:56 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:16:09.706203 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f8f1d-6d52-46a1-b9bb-ea4a32ef49fe service cinder] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:09.774188 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f8f1d-6d52-46a1-b9bb-ea4a32ef49fe service cinder] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:09.779026 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aa734-0ee6-4733-bb84-da12a4822427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:09.779918 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aa734-0ee6-4733-bb84-da12a4822427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:09.780279 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aa734-0ee6-4733-bb84-da12a4822427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:09.780464 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aa734-0ee6-4733-bb84-da12a4822427 admin admin] PATH_INFO: `/v3/users/7a4a23923eea43f2a814f74075f93dd2` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:09.781679 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2aa734-0ee6-4733-bb84-da12a4822427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a4a23923eea43f2a814f74075f93dd2)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:09.783664 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2aa734-0ee6-4733-bb84-da12a4822427 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:09.844391 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-9d2aa734-0ee6-4733-bb84-da12a4822427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a4a23923eea43f2a814f74075f93dd2'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:09.859118 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-9d2aa734-0ee6-4733-bb84-da12a4822427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a4a23923eea43f2a814f74075f93dd2'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:09.869056 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-9d2aa734-0ee6-4733-bb84-da12a4822427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a4a23923eea43f2a814f74075f93dd2'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:09.869632 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-9d2aa734-0ee6-4733-bb84-da12a4822427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a4a23923eea43f2a814f74075f93dd2'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:09.877940 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-9d2aa734-0ee6-4733-bb84-da12a4822427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a4a23923eea43f2a814f74075f93dd2'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:09.884720 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1318/2635] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:16:09 2021] DELETE /identity/v3/users/7a4a23923eea43f2a814f74075f93dd2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:10.076895 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb243c12-5f86-4b0c-9392-218bd565526d service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:10.096008 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb243c12-5f86-4b0c-9392-218bd565526d service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:10.152675 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f46ae-0767-4b10-885b-5d545330fec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:10.153947 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f46ae-0767-4b10-885b-5d545330fec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:10.154217 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f46ae-0767-4b10-885b-5d545330fec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:10.154463 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f46ae-0767-4b10-885b-5d545330fec3 admin admin] PATH_INFO: `/v3/projects/eeb0c86cbaa84a75bc17e524e3376243` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:10.155950 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f46ae-0767-4b10-885b-5d545330fec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeb0c86cbaa84a75bc17e524e3376243)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:10.157916 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f46ae-0767-4b10-885b-5d545330fec3 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:10.203595 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-0d5f46ae-0767-4b10-885b-5d545330fec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeb0c86cbaa84a75bc17e524e3376243', 'request_id': 'req-0d5f46ae-0767-4b10-885b-5d545330fec3'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:10.210702 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-0d5f46ae-0767-4b10-885b-5d545330fec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeb0c86cbaa84a75bc17e524e3376243', 'request_id': 'req-0d5f46ae-0767-4b10-885b-5d545330fec3'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:10.216132 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-0d5f46ae-0767-4b10-885b-5d545330fec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeb0c86cbaa84a75bc17e524e3376243', 'request_id': 'req-0d5f46ae-0767-4b10-885b-5d545330fec3'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:10.228872 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-0d5f46ae-0767-4b10-885b-5d545330fec3 admin admin] The token cache is being invalidate because project eeb0c86cbaa84a75bc17e524e3376243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:16:10.229158 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-0d5f46ae-0767-4b10-885b-5d545330fec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:10.229810 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-0d5f46ae-0767-4b10-885b-5d545330fec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:10.231646 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1318/2636] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:16:10 2021] DELETE /identity/v3/projects/eeb0c86cbaa84a75bc17e524e3376243 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 04:16:10.235274 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aa734-0ee6-4733-bb84-da12a4822427 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:10.237220 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-9d2aa734-0ee6-4733-bb84-da12a4822427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:10.250413 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aa734-0ee6-4733-bb84-da12a4822427 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:10.305817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68227104-a4a6-492e-9ab1-37196384552e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:10.306698 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68227104-a4a6-492e-9ab1-37196384552e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:10.306977 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68227104-a4a6-492e-9ab1-37196384552e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:10.307251 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68227104-a4a6-492e-9ab1-37196384552e admin admin] PATH_INFO: `/v3/users/147e04dcaba6465fa3955f3849282ef8` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:10.308571 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68227104-a4a6-492e-9ab1-37196384552e admin admin] RBAC: Authorizing `identity:delete_user(user_id=147e04dcaba6465fa3955f3849282ef8)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:10.310461 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68227104-a4a6-492e-9ab1-37196384552e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:10.359849 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-68227104-a4a6-492e-9ab1-37196384552e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '147e04dcaba6465fa3955f3849282ef8'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:10.372253 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-68227104-a4a6-492e-9ab1-37196384552e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '147e04dcaba6465fa3955f3849282ef8'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:10.381418 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-68227104-a4a6-492e-9ab1-37196384552e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '147e04dcaba6465fa3955f3849282ef8'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:10.382035 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-68227104-a4a6-492e-9ab1-37196384552e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '147e04dcaba6465fa3955f3849282ef8'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:10.389320 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-68227104-a4a6-492e-9ab1-37196384552e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '147e04dcaba6465fa3955f3849282ef8'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:10.395381 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1319/2637] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:16:10 2021] DELETE /identity/v3/users/147e04dcaba6465fa3955f3849282ef8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 04:16:10.565509 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f46ae-0767-4b10-885b-5d545330fec3 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:10.566936 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-0d5f46ae-0767-4b10-885b-5d545330fec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:10.580929 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f46ae-0767-4b10-885b-5d545330fec3 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:10.639559 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d62198-7c9b-4618-8293-5bf9f473c7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:10.640364 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d62198-7c9b-4618-8293-5bf9f473c7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:10.640647 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d62198-7c9b-4618-8293-5bf9f473c7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:10.640921 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d62198-7c9b-4618-8293-5bf9f473c7f7 admin admin] PATH_INFO: `/v3/projects/997a1e4d2eb1400a9e4c3a2329bd2566` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:10.642099 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d62198-7c9b-4618-8293-5bf9f473c7f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=997a1e4d2eb1400a9e4c3a2329bd2566)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:10.644079 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d62198-7c9b-4618-8293-5bf9f473c7f7 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:10.687284 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-f8d62198-7c9b-4618-8293-5bf9f473c7f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '997a1e4d2eb1400a9e4c3a2329bd2566', 'request_id': 'req-f8d62198-7c9b-4618-8293-5bf9f473c7f7'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:10.693302 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-f8d62198-7c9b-4618-8293-5bf9f473c7f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '997a1e4d2eb1400a9e4c3a2329bd2566', 'request_id': 'req-f8d62198-7c9b-4618-8293-5bf9f473c7f7'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:10.698451 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-f8d62198-7c9b-4618-8293-5bf9f473c7f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '997a1e4d2eb1400a9e4c3a2329bd2566', 'request_id': 'req-f8d62198-7c9b-4618-8293-5bf9f473c7f7'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:10.709628 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-f8d62198-7c9b-4618-8293-5bf9f473c7f7 admin admin] The token cache is being invalidate because project 997a1e4d2eb1400a9e4c3a2329bd2566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:16:10.709909 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-f8d62198-7c9b-4618-8293-5bf9f473c7f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:10.710517 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-f8d62198-7c9b-4618-8293-5bf9f473c7f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:10.712022 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1319/2638] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:16:10 2021] DELETE /identity/v3/projects/997a1e4d2eb1400a9e4c3a2329bd2566 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:10.719228 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf965b04-d515-49cb-b0ed-89e17dfb4859 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:10.719709 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf965b04-d515-49cb-b0ed-89e17dfb4859 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:10.719821 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf965b04-d515-49cb-b0ed-89e17dfb4859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:10.739035 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-bf965b04-d515-49cb-b0ed-89e17dfb4859 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:10.740264 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-bf965b04-d515-49cb-b0ed-89e17dfb4859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:10.795296 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1320/2639] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:10.841892 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2519f-b1c5-4749-8d1f-2d1cb9047b39 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:10.842213 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2519f-b1c5-4749-8d1f-2d1cb9047b39 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:10.842494 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2519f-b1c5-4749-8d1f-2d1cb9047b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:10.861014 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-9ca2519f-b1c5-4749-8d1f-2d1cb9047b39 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:10.862899 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-9ca2519f-b1c5-4749-8d1f-2d1cb9047b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:10.870706 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1320/2640] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:10.874842 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf965b04-d515-49cb-b0ed-89e17dfb4859 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:10.884649 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf965b04-d515-49cb-b0ed-89e17dfb4859 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:10.889181 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2325b-ee3f-4ed0-bd94-300ddf9c1008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:10.889880 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2325b-ee3f-4ed0-bd94-300ddf9c1008 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:10.890133 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2325b-ee3f-4ed0-bd94-300ddf9c1008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:10.890411 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2325b-ee3f-4ed0-bd94-300ddf9c1008 admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:10.891149 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2325b-ee3f-4ed0-bd94-300ddf9c1008 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 04:16:10.891455 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2325b-ee3f-4ed0-bd94-300ddf9c1008 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:10.893602 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2325b-ee3f-4ed0-bd94-300ddf9c1008 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:10.904849 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1321/2641] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 04:16:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 04:16:10.909404 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2519f-b1c5-4749-8d1f-2d1cb9047b39 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:10.918367 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2519f-b1c5-4749-8d1f-2d1cb9047b39 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:10.922889 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a796d-64ea-4acc-9f21-35d6d9c82e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:10.923514 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a796d-64ea-4acc-9f21-35d6d9c82e28 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:10.923844 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a796d-64ea-4acc-9f21-35d6d9c82e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:10.924122 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a796d-64ea-4acc-9f21-35d6d9c82e28 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:10.924813 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a796d-64ea-4acc-9f21-35d6d9c82e28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:10.926721 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a796d-64ea-4acc-9f21-35d6d9c82e28 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:10.951586 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1321/2642] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:16:10 2021] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:16:10.956048 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2325b-ee3f-4ed0-bd94-300ddf9c1008 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:10.967057 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2325b-ee3f-4ed0-bd94-300ddf9c1008 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:11.022135 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aeb97d-91e7-4032-b3d7-e59bd922965c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:11.022930 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aeb97d-91e7-4032-b3d7-e59bd922965c admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:11.023210 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aeb97d-91e7-4032-b3d7-e59bd922965c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:11.023477 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aeb97d-91e7-4032-b3d7-e59bd922965c admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:11.024200 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aeb97d-91e7-4032-b3d7-e59bd922965c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:11.026094 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aeb97d-91e7-4032-b3d7-e59bd922965c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:11.046522 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1322/2643] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:16:10 2021] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:16:11.050568 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a796d-64ea-4acc-9f21-35d6d9c82e28 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:11.060822 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a796d-64ea-4acc-9f21-35d6d9c82e28 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:11.065782 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ad5ab-55b8-43cf-9f3b-12a33d0efb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:11.066426 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ad5ab-55b8-43cf-9f3b-12a33d0efb71 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:11.066712 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ad5ab-55b8-43cf-9f3b-12a33d0efb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:11.066990 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ad5ab-55b8-43cf-9f3b-12a33d0efb71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:11.067749 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ad5ab-55b8-43cf-9f3b-12a33d0efb71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:11.069352 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ad5ab-55b8-43cf-9f3b-12a33d0efb71 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:11.079612 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1322/2644] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:11 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 04:16:11.083639 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aeb97d-91e7-4032-b3d7-e59bd922965c admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:11.093194 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aeb97d-91e7-4032-b3d7-e59bd922965c admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:11.098356 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99b89e-a738-4a10-9bd8-35cbfdcfa29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:11.098987 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99b89e-a738-4a10-9bd8-35cbfdcfa29a admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:11.099269 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99b89e-a738-4a10-9bd8-35cbfdcfa29a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:11.099544 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99b89e-a738-4a10-9bd8-35cbfdcfa29a admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:11.100304 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99b89e-a738-4a10-9bd8-35cbfdcfa29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:11.101866 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99b89e-a738-4a10-9bd8-35cbfdcfa29a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:11.115414 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1323/2645] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:11 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:16:11.119744 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ad5ab-55b8-43cf-9f3b-12a33d0efb71 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:11.129449 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ad5ab-55b8-43cf-9f3b-12a33d0efb71 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:11.134429 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cfe0d-2d94-4d28-9409-18d4c9d7ac30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:11.135293 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cfe0d-2d94-4d28-9409-18d4c9d7ac30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:11.135578 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cfe0d-2d94-4d28-9409-18d4c9d7ac30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:11.135902 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cfe0d-2d94-4d28-9409-18d4c9d7ac30 admin admin] PATH_INFO: `/v3/projects/4ec9a5ca6c2a42fe813518f2bfaa6537/users/ccf05fefb4ec4b35972bdeed672156bb/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:11.150539 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cfe0d-2d94-4d28-9409-18d4c9d7ac30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec9a5ca6c2a42fe813518f2bfaa6537, user_id=ccf05fefb4ec4b35972bdeed672156bb, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:11.153153 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cfe0d-2d94-4d28-9409-18d4c9d7ac30 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:11.165435 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1323/2646] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:16:11 2021] PUT /identity/v3/projects/4ec9a5ca6c2a42fe813518f2bfaa6537/users/ccf05fefb4ec4b35972bdeed672156bb/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:11.175581 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd3122-bc1a-4418-98e1-73fff944de4d None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:11.175987 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd3122-bc1a-4418-98e1-73fff944de4d None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:11.176269 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd3122-bc1a-4418-98e1-73fff944de4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:11.201852 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-47dd3122-bc1a-4418-98e1-73fff944de4d None None] MFA Rules not processed for user `ccf05fefb4ec4b35972bdeed672156bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:11.203043 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-47dd3122-bc1a-4418-98e1-73fff944de4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:11.264742 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1324/2647] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:11 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:11.276590 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cfe0d-2d94-4d28-9409-18d4c9d7ac30 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:11.278288 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-969cfe0d-2d94-4d28-9409-18d4c9d7ac30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:11.332323 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cfe0d-2d94-4d28-9409-18d4c9d7ac30 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:11.335979 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbb7cf-942f-402a-9fd1-9d5039c80f50 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '456c83b8619847279927251ca48fca37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:11.336608 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbb7cf-942f-402a-9fd1-9d5039c80f50 service glance] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:11.336892 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbb7cf-942f-402a-9fd1-9d5039c80f50 service glance] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:11.337175 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbb7cf-942f-402a-9fd1-9d5039c80f50 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:11.345133 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbb7cf-942f-402a-9fd1-9d5039c80f50 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:11.346590 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbb7cf-942f-402a-9fd1-9d5039c80f50 service glance] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:11.355103 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1324/2648] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:16:11 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:16:13.828517 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd3122-bc1a-4418-98e1-73fff944de4d None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:13.830440 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-47dd3122-bc1a-4418-98e1-73fff944de4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:13.886327 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd3122-bc1a-4418-98e1-73fff944de4d None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:13.890099 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55cf99-b7e9-44d9-beea-1bde2f5d11ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:13.890756 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55cf99-b7e9-44d9-beea-1bde2f5d11ce service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:13.891040 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55cf99-b7e9-44d9-beea-1bde2f5d11ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:13.891316 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55cf99-b7e9-44d9-beea-1bde2f5d11ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:13.893695 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-8f55cf99-b7e9-44d9-beea-1bde2f5d11ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:13.954096 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55cf99-b7e9-44d9-beea-1bde2f5d11ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:13.956115 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55cf99-b7e9-44d9-beea-1bde2f5d11ce service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:13.968087 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1325/2649] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:16:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:16:17.171589 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbb7cf-942f-402a-9fd1-9d5039c80f50 service glance] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:17.173356 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-78cbb7cf-942f-402a-9fd1-9d5039c80f50 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:17.194279 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbb7cf-942f-402a-9fd1-9d5039c80f50 service glance] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:17.199253 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654e7a0-d8da-4d61-be7c-e056dfc3ceca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:17.200177 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654e7a0-d8da-4d61-be7c-e056dfc3ceca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:17.200457 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654e7a0-d8da-4d61-be7c-e056dfc3ceca admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:17.200830 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654e7a0-d8da-4d61-be7c-e056dfc3ceca admin admin] PATH_INFO: `/v3/users/987993288a1a42dfa808e39eab41c82c` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:17.202034 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654e7a0-d8da-4d61-be7c-e056dfc3ceca admin admin] RBAC: Authorizing `identity:delete_user(user_id=987993288a1a42dfa808e39eab41c82c)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:17.204007 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654e7a0-d8da-4d61-be7c-e056dfc3ceca admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:17.270615 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a654e7a0-d8da-4d61-be7c-e056dfc3ceca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '987993288a1a42dfa808e39eab41c82c'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:17.281689 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a654e7a0-d8da-4d61-be7c-e056dfc3ceca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '987993288a1a42dfa808e39eab41c82c'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:17.289065 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a654e7a0-d8da-4d61-be7c-e056dfc3ceca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '987993288a1a42dfa808e39eab41c82c'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:17.289792 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a654e7a0-d8da-4d61-be7c-e056dfc3ceca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '987993288a1a42dfa808e39eab41c82c'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:17.297246 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a654e7a0-d8da-4d61-be7c-e056dfc3ceca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '987993288a1a42dfa808e39eab41c82c'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:17.303168 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1325/2650] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:16:17 2021] DELETE /identity/v3/users/987993288a1a42dfa808e39eab41c82c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 04:16:17.479129 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55cf99-b7e9-44d9-beea-1bde2f5d11ce service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:17.489903 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55cf99-b7e9-44d9-beea-1bde2f5d11ce service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:17.547395 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841d519-5a98-4458-aafa-40fffcf65dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:17.548352 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841d519-5a98-4458-aafa-40fffcf65dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:17.548667 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841d519-5a98-4458-aafa-40fffcf65dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:17.548938 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841d519-5a98-4458-aafa-40fffcf65dc1 admin admin] PATH_INFO: `/v3/projects/8a2f64c8564f447d84849db55e0b0573` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:17.550631 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841d519-5a98-4458-aafa-40fffcf65dc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a2f64c8564f447d84849db55e0b0573)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:17.552643 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841d519-5a98-4458-aafa-40fffcf65dc1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:17.601805 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a841d519-5a98-4458-aafa-40fffcf65dc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a2f64c8564f447d84849db55e0b0573', 'request_id': 'req-a841d519-5a98-4458-aafa-40fffcf65dc1'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:17.607622 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a841d519-5a98-4458-aafa-40fffcf65dc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a2f64c8564f447d84849db55e0b0573', 'request_id': 'req-a841d519-5a98-4458-aafa-40fffcf65dc1'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:17.613429 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a841d519-5a98-4458-aafa-40fffcf65dc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a2f64c8564f447d84849db55e0b0573', 'request_id': 'req-a841d519-5a98-4458-aafa-40fffcf65dc1'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:17.626574 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a841d519-5a98-4458-aafa-40fffcf65dc1 admin admin] The token cache is being invalidate because project 8a2f64c8564f447d84849db55e0b0573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:16:17.627459 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a841d519-5a98-4458-aafa-40fffcf65dc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:17.628127 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a841d519-5a98-4458-aafa-40fffcf65dc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:17.629717 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1326/2651] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:16:17 2021] DELETE /identity/v3/projects/8a2f64c8564f447d84849db55e0b0573 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:17.637500 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4eb91-cb38-4cb4-8771-41b1dda9ddd0 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:17.637787 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4eb91-cb38-4cb4-8771-41b1dda9ddd0 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:17.638092 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4eb91-cb38-4cb4-8771-41b1dda9ddd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:17.655667 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-9db4eb91-cb38-4cb4-8771-41b1dda9ddd0 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:17.656877 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-9db4eb91-cb38-4cb4-8771-41b1dda9ddd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:17.714112 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1326/2652] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:17.721629 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cd2b2-5a76-405c-b4ce-b8a3a3bd70e3 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:17.721920 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cd2b2-5a76-405c-b4ce-b8a3a3bd70e3 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:17.722199 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cd2b2-5a76-405c-b4ce-b8a3a3bd70e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:17.741629 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-702cd2b2-5a76-405c-b4ce-b8a3a3bd70e3 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:17.742847 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-702cd2b2-5a76-405c-b4ce-b8a3a3bd70e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:17.750691 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1327/2653] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:17.755458 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4eb91-cb38-4cb4-8771-41b1dda9ddd0 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:17.765138 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4eb91-cb38-4cb4-8771-41b1dda9ddd0 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:17.769705 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d88b6f-36b7-4bbe-bc4d-6599e9ae3853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:17.770376 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d88b6f-36b7-4bbe-bc4d-6599e9ae3853 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:17.770637 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d88b6f-36b7-4bbe-bc4d-6599e9ae3853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:17.770912 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d88b6f-36b7-4bbe-bc4d-6599e9ae3853 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:17.771638 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d88b6f-36b7-4bbe-bc4d-6599e9ae3853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 04:16:17.771978 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d88b6f-36b7-4bbe-bc4d-6599e9ae3853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:17.773616 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d88b6f-36b7-4bbe-bc4d-6599e9ae3853 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:17.785444 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1327/2654] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 04:16:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 04:16:17.789716 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cd2b2-5a76-405c-b4ce-b8a3a3bd70e3 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:17.802989 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cd2b2-5a76-405c-b4ce-b8a3a3bd70e3 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:17.807837 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556831fc-c9c1-46f6-a4da-b552de3ba0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:17.808485 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556831fc-c9c1-46f6-a4da-b552de3ba0ca admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:17.808943 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556831fc-c9c1-46f6-a4da-b552de3ba0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:17.809289 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556831fc-c9c1-46f6-a4da-b552de3ba0ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:17.810100 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556831fc-c9c1-46f6-a4da-b552de3ba0ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:17.812327 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556831fc-c9c1-46f6-a4da-b552de3ba0ca admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:17.838345 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1328/2655] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:16:17 2021] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:16:17.842486 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d88b6f-36b7-4bbe-bc4d-6599e9ae3853 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:17.852552 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d88b6f-36b7-4bbe-bc4d-6599e9ae3853 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:17.907487 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9f56b-fe03-435a-a1b7-37b25fb131d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:17.908175 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9f56b-fe03-435a-a1b7-37b25fb131d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:17.908457 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9f56b-fe03-435a-a1b7-37b25fb131d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:17.908732 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9f56b-fe03-435a-a1b7-37b25fb131d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:17.909432 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9f56b-fe03-435a-a1b7-37b25fb131d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:17.911742 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9f56b-fe03-435a-a1b7-37b25fb131d2 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:17.933633 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1328/2656] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:16:17 2021] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:16:17.935617 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556831fc-c9c1-46f6-a4da-b552de3ba0ca admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:17.948044 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556831fc-c9c1-46f6-a4da-b552de3ba0ca admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:17.952883 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb04784-abd0-4a3a-85c9-346482cb4cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:17.953541 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb04784-abd0-4a3a-85c9-346482cb4cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:17.953818 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb04784-abd0-4a3a-85c9-346482cb4cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:17.954090 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb04784-abd0-4a3a-85c9-346482cb4cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:17.954820 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb04784-abd0-4a3a-85c9-346482cb4cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:17.956641 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb04784-abd0-4a3a-85c9-346482cb4cf5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:17.967958 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1329/2657] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:17 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:16:17.972449 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9f56b-fe03-435a-a1b7-37b25fb131d2 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:17.982881 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9f56b-fe03-435a-a1b7-37b25fb131d2 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:17.988358 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef8020-d93d-41db-b491-8422e1bde5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:17.989025 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef8020-d93d-41db-b491-8422e1bde5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:17.989308 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef8020-d93d-41db-b491-8422e1bde5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:17.989583 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef8020-d93d-41db-b491-8422e1bde5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:17.990313 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef8020-d93d-41db-b491-8422e1bde5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:17.991972 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef8020-d93d-41db-b491-8422e1bde5d2 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:18.001927 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1329/2658] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:17 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:16:18.005983 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb04784-abd0-4a3a-85c9-346482cb4cf5 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:18.015805 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb04784-abd0-4a3a-85c9-346482cb4cf5 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:18.020644 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e298a3-45dc-4727-9c4a-1bfc13114bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:18.021544 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e298a3-45dc-4727-9c4a-1bfc13114bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:18.021827 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e298a3-45dc-4727-9c4a-1bfc13114bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:18.022103 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e298a3-45dc-4727-9c4a-1bfc13114bd7 admin admin] PATH_INFO: `/v3/projects/97f09ff483b44c18b8d249d4e8d8ac0e/users/bb3101f1258e4561a8ffa796e8879100/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:18.037017 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e298a3-45dc-4727-9c4a-1bfc13114bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97f09ff483b44c18b8d249d4e8d8ac0e, user_id=bb3101f1258e4561a8ffa796e8879100, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:18.039694 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e298a3-45dc-4727-9c4a-1bfc13114bd7 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:18.053251 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1330/2659] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:16:18 2021] PUT /identity/v3/projects/97f09ff483b44c18b8d249d4e8d8ac0e/users/bb3101f1258e4561a8ffa796e8879100/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:18.063483 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c468e-dc39-42cd-b370-88b2c0d1e3ed None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:18.063578 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c468e-dc39-42cd-b370-88b2c0d1e3ed None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:18.063901 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c468e-dc39-42cd-b370-88b2c0d1e3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:18.093080 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-f98c468e-dc39-42cd-b370-88b2c0d1e3ed None None] MFA Rules not processed for user `bb3101f1258e4561a8ffa796e8879100`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:18.094293 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-f98c468e-dc39-42cd-b370-88b2c0d1e3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:18.157439 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1330/2660] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:18 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:18.168999 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e298a3-45dc-4727-9c4a-1bfc13114bd7 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:18.170673 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-51e298a3-45dc-4727-9c4a-1bfc13114bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:18.243913 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e298a3-45dc-4727-9c4a-1bfc13114bd7 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:18.249419 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2f750-12d7-47d0-8542-2c18dff549dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:18.250057 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2f750-12d7-47d0-8542-2c18dff549dd service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:18.250336 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2f750-12d7-47d0-8542-2c18dff549dd service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:18.250604 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2f750-12d7-47d0-8542-2c18dff549dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:18.260479 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2f750-12d7-47d0-8542-2c18dff549dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:18.262070 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2f750-12d7-47d0-8542-2c18dff549dd service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:18.270791 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1331/2661] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:16:18 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 04:16:20.908489 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c468e-dc39-42cd-b370-88b2c0d1e3ed None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:20.971305 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c468e-dc39-42cd-b370-88b2c0d1e3ed None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:20.976158 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1162a-5ca7-4021-a51d-ff6fcfc38123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:20.977034 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1162a-5ca7-4021-a51d-ff6fcfc38123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:20.977314 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1162a-5ca7-4021-a51d-ff6fcfc38123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:20.977590 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1162a-5ca7-4021-a51d-ff6fcfc38123 admin admin] PATH_INFO: `/v3/users/bb3101f1258e4561a8ffa796e8879100` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:20.978792 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1162a-5ca7-4021-a51d-ff6fcfc38123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb3101f1258e4561a8ffa796e8879100)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:20.980760 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1162a-5ca7-4021-a51d-ff6fcfc38123 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:21.026587 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-b3f1162a-5ca7-4021-a51d-ff6fcfc38123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb3101f1258e4561a8ffa796e8879100'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:21.040095 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-b3f1162a-5ca7-4021-a51d-ff6fcfc38123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb3101f1258e4561a8ffa796e8879100'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:21.047936 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-b3f1162a-5ca7-4021-a51d-ff6fcfc38123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb3101f1258e4561a8ffa796e8879100'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:21.049132 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-b3f1162a-5ca7-4021-a51d-ff6fcfc38123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb3101f1258e4561a8ffa796e8879100'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:21.055705 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-b3f1162a-5ca7-4021-a51d-ff6fcfc38123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb3101f1258e4561a8ffa796e8879100'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:21.061435 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1331/2662] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:16:20 2021] DELETE /identity/v3/users/bb3101f1258e4561a8ffa796e8879100 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:21.066253 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbd6a4-53dc-4eee-92e4-b10bc2daa7e4 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:21.066711 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbd6a4-53dc-4eee-92e4-b10bc2daa7e4 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:21.066843 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbd6a4-53dc-4eee-92e4-b10bc2daa7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:21.084589 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-8dcbd6a4-53dc-4eee-92e4-b10bc2daa7e4 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:21.085796 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-8dcbd6a4-53dc-4eee-92e4-b10bc2daa7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:21.144139 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1332/2663] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:21.154037 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1162a-5ca7-4021-a51d-ff6fcfc38123 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:21.155428 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-b3f1162a-5ca7-4021-a51d-ff6fcfc38123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:21.212934 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1162a-5ca7-4021-a51d-ff6fcfc38123 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:21.216729 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1956b8-d55f-4c23-87cb-5f50caf4b99a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:21.217372 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1956b8-d55f-4c23-87cb-5f50caf4b99a service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:21.217657 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1956b8-d55f-4c23-87cb-5f50caf4b99a service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:21.217958 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1956b8-d55f-4c23-87cb-5f50caf4b99a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:21.227589 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1956b8-d55f-4c23-87cb-5f50caf4b99a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:21.229048 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1956b8-d55f-4c23-87cb-5f50caf4b99a service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:21.242500 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1332/2664] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:16:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:16:21.501487 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbd6a4-53dc-4eee-92e4-b10bc2daa7e4 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:21.503064 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-8dcbd6a4-53dc-4eee-92e4-b10bc2daa7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:21.514986 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbd6a4-53dc-4eee-92e4-b10bc2daa7e4 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:21.520399 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085e3ee-b5a9-45f8-83b1-c85c19ccdb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:21.521253 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085e3ee-b5a9-45f8-83b1-c85c19ccdb44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:21.521532 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085e3ee-b5a9-45f8-83b1-c85c19ccdb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:21.521803 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085e3ee-b5a9-45f8-83b1-c85c19ccdb44 admin admin] PATH_INFO: `/v3/projects/97f09ff483b44c18b8d249d4e8d8ac0e` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:21.523277 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085e3ee-b5a9-45f8-83b1-c85c19ccdb44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97f09ff483b44c18b8d249d4e8d8ac0e)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:21.525139 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085e3ee-b5a9-45f8-83b1-c85c19ccdb44 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:21.572110 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-1085e3ee-b5a9-45f8-83b1-c85c19ccdb44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97f09ff483b44c18b8d249d4e8d8ac0e', 'request_id': 'req-1085e3ee-b5a9-45f8-83b1-c85c19ccdb44'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:21.578784 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-1085e3ee-b5a9-45f8-83b1-c85c19ccdb44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97f09ff483b44c18b8d249d4e8d8ac0e', 'request_id': 'req-1085e3ee-b5a9-45f8-83b1-c85c19ccdb44'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:21.584853 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-1085e3ee-b5a9-45f8-83b1-c85c19ccdb44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97f09ff483b44c18b8d249d4e8d8ac0e', 'request_id': 'req-1085e3ee-b5a9-45f8-83b1-c85c19ccdb44'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:21.598430 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-1085e3ee-b5a9-45f8-83b1-c85c19ccdb44 admin admin] The token cache is being invalidate because project 97f09ff483b44c18b8d249d4e8d8ac0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:16:21.598716 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-1085e3ee-b5a9-45f8-83b1-c85c19ccdb44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:21.599338 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-1085e3ee-b5a9-45f8-83b1-c85c19ccdb44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:21.600895 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1333/2665] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:16:21 2021] DELETE /identity/v3/projects/97f09ff483b44c18b8d249d4e8d8ac0e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:21.607088 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ced009-03b0-43ac-946d-aa49fe5038c0 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:21.607382 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ced009-03b0-43ac-946d-aa49fe5038c0 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:21.607758 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ced009-03b0-43ac-946d-aa49fe5038c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:21.625953 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-c5ced009-03b0-43ac-946d-aa49fe5038c0 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:21.627187 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c5ced009-03b0-43ac-946d-aa49fe5038c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:21.686728 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1333/2666] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:21.695339 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22029b75-8e76-466f-9b9c-1adcb6b1ff40 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:21.695630 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22029b75-8e76-466f-9b9c-1adcb6b1ff40 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:21.695940 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22029b75-8e76-466f-9b9c-1adcb6b1ff40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:21.714058 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-22029b75-8e76-466f-9b9c-1adcb6b1ff40 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:21.715289 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-22029b75-8e76-466f-9b9c-1adcb6b1ff40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:21.723846 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1334/2667] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:21.728031 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ced009-03b0-43ac-946d-aa49fe5038c0 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:21.738279 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ced009-03b0-43ac-946d-aa49fe5038c0 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:21.743965 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c279d7-4c8f-49ba-bd29-8823132bc432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:21.744619 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c279d7-4c8f-49ba-bd29-8823132bc432 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:21.744907 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c279d7-4c8f-49ba-bd29-8823132bc432 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:21.745186 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c279d7-4c8f-49ba-bd29-8823132bc432 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:21.745931 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c279d7-4c8f-49ba-bd29-8823132bc432 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 04:16:21.746237 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c279d7-4c8f-49ba-bd29-8823132bc432 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:21.747940 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c279d7-4c8f-49ba-bd29-8823132bc432 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:21.760471 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1334/2668] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 04:16:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 04:16:21.766516 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22029b75-8e76-466f-9b9c-1adcb6b1ff40 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:21.775649 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22029b75-8e76-466f-9b9c-1adcb6b1ff40 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:21.780626 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7e8dc-1155-4f16-8f2b-5a667d10d834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:21.781393 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7e8dc-1155-4f16-8f2b-5a667d10d834 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:21.781683 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7e8dc-1155-4f16-8f2b-5a667d10d834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:21.781963 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7e8dc-1155-4f16-8f2b-5a667d10d834 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:21.782673 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7e8dc-1155-4f16-8f2b-5a667d10d834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:21.785155 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7e8dc-1155-4f16-8f2b-5a667d10d834 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:21.810536 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1335/2669] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:16:21 2021] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:16:21.815283 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c279d7-4c8f-49ba-bd29-8823132bc432 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:21.826248 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c279d7-4c8f-49ba-bd29-8823132bc432 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:21.881875 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b791b8-8171-426e-a474-a4ebc006391e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:21.882541 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b791b8-8171-426e-a474-a4ebc006391e admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:21.882824 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b791b8-8171-426e-a474-a4ebc006391e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:21.883094 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b791b8-8171-426e-a474-a4ebc006391e admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:21.883818 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b791b8-8171-426e-a474-a4ebc006391e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:21.885833 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b791b8-8171-426e-a474-a4ebc006391e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:21.905949 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1335/2670] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:16:21 2021] POST /identity/v3/users => generated 282 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:16:21.910725 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7e8dc-1155-4f16-8f2b-5a667d10d834 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:21.920953 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7e8dc-1155-4f16-8f2b-5a667d10d834 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:21.926365 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d310b2-68be-43f1-b426-d3836b073845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:21.927031 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d310b2-68be-43f1-b426-d3836b073845 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:21.927321 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d310b2-68be-43f1-b426-d3836b073845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:21.927620 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d310b2-68be-43f1-b426-d3836b073845 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:21.928392 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d310b2-68be-43f1-b426-d3836b073845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:21.929993 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d310b2-68be-43f1-b426-d3836b073845 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:21.940932 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1336/2671] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:21 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:16:21.945090 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b791b8-8171-426e-a474-a4ebc006391e admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:21.955729 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b791b8-8171-426e-a474-a4ebc006391e admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:21.960583 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f3aaf-b38c-4ed7-b834-fcb9d1ddaecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:21.961303 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f3aaf-b38c-4ed7-b834-fcb9d1ddaecb admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:21.961623 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f3aaf-b38c-4ed7-b834-fcb9d1ddaecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:21.961975 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f3aaf-b38c-4ed7-b834-fcb9d1ddaecb admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:21.962843 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f3aaf-b38c-4ed7-b834-fcb9d1ddaecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:21.964902 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f3aaf-b38c-4ed7-b834-fcb9d1ddaecb admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:21.976007 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1336/2672] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:21 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:16:21.980164 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d310b2-68be-43f1-b426-d3836b073845 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:21.990526 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d310b2-68be-43f1-b426-d3836b073845 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:21.995204 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce89bb-9080-4af9-89b6-3981103a7811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:21.996119 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce89bb-9080-4af9-89b6-3981103a7811 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:21.996397 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce89bb-9080-4af9-89b6-3981103a7811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:21.996685 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce89bb-9080-4af9-89b6-3981103a7811 admin admin] PATH_INFO: `/v3/projects/a0186460ff2c4b93aa7079257383b5fc/users/50a6b5eb78e84499bfd81e11059a4591/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:22.010764 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce89bb-9080-4af9-89b6-3981103a7811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0186460ff2c4b93aa7079257383b5fc, user_id=50a6b5eb78e84499bfd81e11059a4591, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:22.013431 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce89bb-9080-4af9-89b6-3981103a7811 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:22.027492 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1337/2673] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:16:21 2021] PUT /identity/v3/projects/a0186460ff2c4b93aa7079257383b5fc/users/50a6b5eb78e84499bfd81e11059a4591/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:22.039096 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc033ba-5abe-4c18-9ccf-ebd7434ba9e8 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:22.039392 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc033ba-5abe-4c18-9ccf-ebd7434ba9e8 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:22.039740 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc033ba-5abe-4c18-9ccf-ebd7434ba9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:22.068243 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-bcc033ba-5abe-4c18-9ccf-ebd7434ba9e8 None None] MFA Rules not processed for user `50a6b5eb78e84499bfd81e11059a4591`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:22.069459 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-bcc033ba-5abe-4c18-9ccf-ebd7434ba9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:22.131378 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1337/2674] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:22 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:22.135911 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce89bb-9080-4af9-89b6-3981103a7811 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:22.198087 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce89bb-9080-4af9-89b6-3981103a7811 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:22.202690 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2daf824-a0f2-4557-ad7b-a1aa4cada2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:22.203339 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daf824-a0f2-4557-ad7b-a1aa4cada2bd admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:22.203619 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daf824-a0f2-4557-ad7b-a1aa4cada2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:22.203923 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daf824-a0f2-4557-ad7b-a1aa4cada2bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:22.204631 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2daf824-a0f2-4557-ad7b-a1aa4cada2bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:22.207039 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2daf824-a0f2-4557-ad7b-a1aa4cada2bd admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:22.233701 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1338/2675] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:16:22 2021] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:16:22.238670 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc033ba-5abe-4c18-9ccf-ebd7434ba9e8 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:22.249419 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc033ba-5abe-4c18-9ccf-ebd7434ba9e8 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:22.307187 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602abb7-a541-4ca7-bf1c-e1886f7831ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:22.307888 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602abb7-a541-4ca7-bf1c-e1886f7831ff admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:22.308174 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602abb7-a541-4ca7-bf1c-e1886f7831ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:22.308449 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602abb7-a541-4ca7-bf1c-e1886f7831ff admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:22.309151 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602abb7-a541-4ca7-bf1c-e1886f7831ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:22.311071 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602abb7-a541-4ca7-bf1c-e1886f7831ff admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:22.333437 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1338/2676] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:16:22 2021] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:16:22.337386 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2daf824-a0f2-4557-ad7b-a1aa4cada2bd admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:22.348789 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2daf824-a0f2-4557-ad7b-a1aa4cada2bd admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:22.353444 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d83a6e-1cdc-42b2-ab3c-9b762b947899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:22.354099 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d83a6e-1cdc-42b2-ab3c-9b762b947899 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:22.354383 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d83a6e-1cdc-42b2-ab3c-9b762b947899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:22.354661 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d83a6e-1cdc-42b2-ab3c-9b762b947899 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:22.355396 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d83a6e-1cdc-42b2-ab3c-9b762b947899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:22.357031 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d83a6e-1cdc-42b2-ab3c-9b762b947899 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:22.367727 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1339/2677] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:22 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 04:16:22.372194 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602abb7-a541-4ca7-bf1c-e1886f7831ff admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:22.382239 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602abb7-a541-4ca7-bf1c-e1886f7831ff admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:22.386877 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb36c2-df11-4c90-ba73-1e1be5f699a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:22.387801 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb36c2-df11-4c90-ba73-1e1be5f699a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:22.388082 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb36c2-df11-4c90-ba73-1e1be5f699a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:22.388352 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb36c2-df11-4c90-ba73-1e1be5f699a9 admin admin] PATH_INFO: `/v3/projects/76ce24fddfba4123813a10f10b0d9b00/users/c2523a1d191b474c9865e6a71f2f4f71/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:22.403756 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb36c2-df11-4c90-ba73-1e1be5f699a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ce24fddfba4123813a10f10b0d9b00, user_id=c2523a1d191b474c9865e6a71f2f4f71, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:22.406424 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb36c2-df11-4c90-ba73-1e1be5f699a9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:22.419779 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1339/2678] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:16:22 2021] PUT /identity/v3/projects/76ce24fddfba4123813a10f10b0d9b00/users/c2523a1d191b474c9865e6a71f2f4f71/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:22.424031 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d83a6e-1cdc-42b2-ab3c-9b762b947899 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:22.433853 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d83a6e-1cdc-42b2-ab3c-9b762b947899 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:22.488036 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5950f-b965-460a-bfb3-e0b1c85dbdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:22.488607 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5950f-b965-460a-bfb3-e0b1c85dbdfe admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:22.488886 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5950f-b965-460a-bfb3-e0b1c85dbdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:22.489158 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5950f-b965-460a-bfb3-e0b1c85dbdfe admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:22.489890 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5950f-b965-460a-bfb3-e0b1c85dbdfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:22.491487 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5950f-b965-460a-bfb3-e0b1c85dbdfe admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:22.501435 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1340/2679] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:22 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:16:22.506007 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb36c2-df11-4c90-ba73-1e1be5f699a9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:22.516106 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb36c2-df11-4c90-ba73-1e1be5f699a9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:22.521585 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332784e-218d-4e1a-b7d0-b49c577b1d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:22.522574 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332784e-218d-4e1a-b7d0-b49c577b1d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:22.522862 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332784e-218d-4e1a-b7d0-b49c577b1d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:22.523173 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332784e-218d-4e1a-b7d0-b49c577b1d73 admin admin] PATH_INFO: `/v3/projects/76ce24fddfba4123813a10f10b0d9b00/users/c2523a1d191b474c9865e6a71f2f4f71/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:22.525382 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332784e-218d-4e1a-b7d0-b49c577b1d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ce24fddfba4123813a10f10b0d9b00, user_id=c2523a1d191b474c9865e6a71f2f4f71, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:22.528093 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332784e-218d-4e1a-b7d0-b49c577b1d73 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:22.538597 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1340/2680] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:16:22 2021] PUT /identity/v3/projects/76ce24fddfba4123813a10f10b0d9b00/users/c2523a1d191b474c9865e6a71f2f4f71/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:22.548717 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249078fd-b984-465d-92de-860277e27675 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:22.549020 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249078fd-b984-465d-92de-860277e27675 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:22.549372 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249078fd-b984-465d-92de-860277e27675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:22.580673 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-249078fd-b984-465d-92de-860277e27675 None None] MFA Rules not processed for user `c2523a1d191b474c9865e6a71f2f4f71`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:22.581877 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-249078fd-b984-465d-92de-860277e27675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:22.649583 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1341/2681] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:22 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:22.661118 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332784e-218d-4e1a-b7d0-b49c577b1d73 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:22.662845 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-9332784e-218d-4e1a-b7d0-b49c577b1d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:22.718644 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332784e-218d-4e1a-b7d0-b49c577b1d73 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:22.723074 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26384eb9-b368-4871-b46c-98642fa71ae9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:22.723809 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26384eb9-b368-4871-b46c-98642fa71ae9 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:22.724214 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26384eb9-b368-4871-b46c-98642fa71ae9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:22.724401 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26384eb9-b368-4871-b46c-98642fa71ae9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:22.734506 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26384eb9-b368-4871-b46c-98642fa71ae9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:22.736079 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26384eb9-b368-4871-b46c-98642fa71ae9 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:22.745974 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1341/2682] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:16:22 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:16:22.811892 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249078fd-b984-465d-92de-860277e27675 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:22.822056 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249078fd-b984-465d-92de-860277e27675 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:22.825621 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0328d22-3d95-4e93-914f-77733c8dabac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:22.826245 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0328d22-3d95-4e93-914f-77733c8dabac service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:22.826522 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0328d22-3d95-4e93-914f-77733c8dabac service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:22.826794 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0328d22-3d95-4e93-914f-77733c8dabac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:22.883037 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0328d22-3d95-4e93-914f-77733c8dabac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:22.884510 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0328d22-3d95-4e93-914f-77733c8dabac service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:22.893116 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1342/2683] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:16:22 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:16:34.083152 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26384eb9-b368-4871-b46c-98642fa71ae9 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:34.084649 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-26384eb9-b368-4871-b46c-98642fa71ae9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:34.156549 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26384eb9-b368-4871-b46c-98642fa71ae9 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:34.161077 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb4a0e-1f49-4140-a812-1904a488b531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:34.161928 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb4a0e-1f49-4140-a812-1904a488b531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:34.162212 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb4a0e-1f49-4140-a812-1904a488b531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:34.162490 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb4a0e-1f49-4140-a812-1904a488b531 admin admin] PATH_INFO: `/v3/users/ccf05fefb4ec4b35972bdeed672156bb` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:34.163672 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb4a0e-1f49-4140-a812-1904a488b531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccf05fefb4ec4b35972bdeed672156bb)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:34.165613 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb4a0e-1f49-4140-a812-1904a488b531 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:34.208988 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-29fb4a0e-1f49-4140-a812-1904a488b531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccf05fefb4ec4b35972bdeed672156bb'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:34.220332 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-29fb4a0e-1f49-4140-a812-1904a488b531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccf05fefb4ec4b35972bdeed672156bb'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:34.227245 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-29fb4a0e-1f49-4140-a812-1904a488b531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccf05fefb4ec4b35972bdeed672156bb'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:34.227872 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-29fb4a0e-1f49-4140-a812-1904a488b531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccf05fefb4ec4b35972bdeed672156bb'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:34.234372 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-29fb4a0e-1f49-4140-a812-1904a488b531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccf05fefb4ec4b35972bdeed672156bb'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:34.240423 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1342/2684] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:16:34 2021] DELETE /identity/v3/users/ccf05fefb4ec4b35972bdeed672156bb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:34.245452 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d499f-9616-4f61-8d2e-5e222ea52d97 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:34.245931 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d499f-9616-4f61-8d2e-5e222ea52d97 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:34.246029 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d499f-9616-4f61-8d2e-5e222ea52d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:34.264224 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-d66d499f-9616-4f61-8d2e-5e222ea52d97 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:34.265414 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-d66d499f-9616-4f61-8d2e-5e222ea52d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:34.321877 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1343/2685] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:34.331745 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb4a0e-1f49-4140-a812-1904a488b531 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:34.333181 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-29fb4a0e-1f49-4140-a812-1904a488b531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:34.390318 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb4a0e-1f49-4140-a812-1904a488b531 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:34.393939 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a01a8-7963-44e7-ad35-12c84b469f6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:34.394574 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a01a8-7963-44e7-ad35-12c84b469f6e service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:34.394860 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a01a8-7963-44e7-ad35-12c84b469f6e service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:34.395139 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a01a8-7963-44e7-ad35-12c84b469f6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:34.404531 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a01a8-7963-44e7-ad35-12c84b469f6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:34.405955 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a01a8-7963-44e7-ad35-12c84b469f6e service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:34.415222 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1343/2686] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:16:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:16:34.676904 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d499f-9616-4f61-8d2e-5e222ea52d97 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:34.678303 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-d66d499f-9616-4f61-8d2e-5e222ea52d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:34.692490 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d499f-9616-4f61-8d2e-5e222ea52d97 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:34.697543 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c10bcf-8eb8-4dc4-bb84-441a74aa6ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:34.698561 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c10bcf-8eb8-4dc4-bb84-441a74aa6ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:34.698864 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c10bcf-8eb8-4dc4-bb84-441a74aa6ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:34.699101 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c10bcf-8eb8-4dc4-bb84-441a74aa6ce2 admin admin] PATH_INFO: `/v3/projects/4ec9a5ca6c2a42fe813518f2bfaa6537` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:34.700516 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c10bcf-8eb8-4dc4-bb84-441a74aa6ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ec9a5ca6c2a42fe813518f2bfaa6537)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:34.702287 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c10bcf-8eb8-4dc4-bb84-441a74aa6ce2 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:34.746254 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-92c10bcf-8eb8-4dc4-bb84-441a74aa6ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec9a5ca6c2a42fe813518f2bfaa6537', 'request_id': 'req-92c10bcf-8eb8-4dc4-bb84-441a74aa6ce2'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:34.752058 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-92c10bcf-8eb8-4dc4-bb84-441a74aa6ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec9a5ca6c2a42fe813518f2bfaa6537', 'request_id': 'req-92c10bcf-8eb8-4dc4-bb84-441a74aa6ce2'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:34.757991 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-92c10bcf-8eb8-4dc4-bb84-441a74aa6ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec9a5ca6c2a42fe813518f2bfaa6537', 'request_id': 'req-92c10bcf-8eb8-4dc4-bb84-441a74aa6ce2'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:34.769528 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-92c10bcf-8eb8-4dc4-bb84-441a74aa6ce2 admin admin] The token cache is being invalidate because project 4ec9a5ca6c2a42fe813518f2bfaa6537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:16:34.769758 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-92c10bcf-8eb8-4dc4-bb84-441a74aa6ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:34.770372 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-92c10bcf-8eb8-4dc4-bb84-441a74aa6ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:34.771909 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1344/2687] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:16:34 2021] DELETE /identity/v3/projects/4ec9a5ca6c2a42fe813518f2bfaa6537 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:34.778124 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eef3e7-d1e7-43da-9070-7e1e059ac32f None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:34.778421 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eef3e7-d1e7-43da-9070-7e1e059ac32f None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:34.778700 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eef3e7-d1e7-43da-9070-7e1e059ac32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:34.797001 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-a4eef3e7-d1e7-43da-9070-7e1e059ac32f None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:34.798193 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-a4eef3e7-d1e7-43da-9070-7e1e059ac32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:34.852253 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1344/2688] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:34.861156 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfc11f-2ac9-4200-871d-69e192cb1628 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:34.861448 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfc11f-2ac9-4200-871d-69e192cb1628 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:34.861778 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfc11f-2ac9-4200-871d-69e192cb1628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:34.880142 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-c1cfc11f-2ac9-4200-871d-69e192cb1628 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:34.881353 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-c1cfc11f-2ac9-4200-871d-69e192cb1628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:34.892316 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1345/2689] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:34.897039 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eef3e7-d1e7-43da-9070-7e1e059ac32f None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:34.907435 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eef3e7-d1e7-43da-9070-7e1e059ac32f None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:34.912687 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e288d0-d92f-43d1-b7d2-118bde789b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:34.913460 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e288d0-d92f-43d1-b7d2-118bde789b7e admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:34.914708 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e288d0-d92f-43d1-b7d2-118bde789b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:34.914708 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e288d0-d92f-43d1-b7d2-118bde789b7e admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:34.915447 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e288d0-d92f-43d1-b7d2-118bde789b7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 04:16:34.915779 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e288d0-d92f-43d1-b7d2-118bde789b7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:34.921115 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e288d0-d92f-43d1-b7d2-118bde789b7e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:34.932482 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1345/2690] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 04:16:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 04:16:34.933402 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfc11f-2ac9-4200-871d-69e192cb1628 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:34.943014 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfc11f-2ac9-4200-871d-69e192cb1628 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:34.947921 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470eb780-20dc-4610-a90f-4a2f9e337910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:34.948577 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470eb780-20dc-4610-a90f-4a2f9e337910 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:34.948860 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470eb780-20dc-4610-a90f-4a2f9e337910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:34.949138 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470eb780-20dc-4610-a90f-4a2f9e337910 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:34.949840 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470eb780-20dc-4610-a90f-4a2f9e337910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:34.951747 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470eb780-20dc-4610-a90f-4a2f9e337910 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:34.978070 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1346/2691] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:16:34 2021] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 04:16:34.982489 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e288d0-d92f-43d1-b7d2-118bde789b7e admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:34.993217 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e288d0-d92f-43d1-b7d2-118bde789b7e admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:35.005571 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470eb780-20dc-4610-a90f-4a2f9e337910 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:35.007935 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-470eb780-20dc-4610-a90f-4a2f9e337910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:35.046526 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c138f1-d332-461b-a6ca-2298cdc39be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:35.047424 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c138f1-d332-461b-a6ca-2298cdc39be6 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:35.047535 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c138f1-d332-461b-a6ca-2298cdc39be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:35.047798 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c138f1-d332-461b-a6ca-2298cdc39be6 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:35.048486 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c138f1-d332-461b-a6ca-2298cdc39be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:35.050424 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c138f1-d332-461b-a6ca-2298cdc39be6 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:35.067110 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470eb780-20dc-4610-a90f-4a2f9e337910 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:35.071065 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1346/2692] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:16:34 2021] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:16:35.072615 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd719c9-32cf-40fd-aa6f-584834254684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:35.073487 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd719c9-32cf-40fd-aa6f-584834254684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:35.073834 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd719c9-32cf-40fd-aa6f-584834254684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:35.074114 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd719c9-32cf-40fd-aa6f-584834254684 admin admin] PATH_INFO: `/v3/users/50a6b5eb78e84499bfd81e11059a4591` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:35.075035 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c138f1-d332-461b-a6ca-2298cdc39be6 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:35.075495 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd719c9-32cf-40fd-aa6f-584834254684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a6b5eb78e84499bfd81e11059a4591)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:35.077522 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd719c9-32cf-40fd-aa6f-584834254684 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:35.084386 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c138f1-d332-461b-a6ca-2298cdc39be6 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:35.089018 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f134975-4ad2-4b78-8f55-a46db5f62b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:35.089654 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f134975-4ad2-4b78-8f55-a46db5f62b6a admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:35.089931 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f134975-4ad2-4b78-8f55-a46db5f62b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:35.090204 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f134975-4ad2-4b78-8f55-a46db5f62b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:35.090920 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f134975-4ad2-4b78-8f55-a46db5f62b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:35.092516 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f134975-4ad2-4b78-8f55-a46db5f62b6a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:35.103056 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1347/2693] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:35 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 04:16:35.107352 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f134975-4ad2-4b78-8f55-a46db5f62b6a admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:35.118735 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f134975-4ad2-4b78-8f55-a46db5f62b6a admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:35.123909 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab194608-89a7-4c99-b6e5-f01a5f082121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:35.124614 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab194608-89a7-4c99-b6e5-f01a5f082121 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:35.124902 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab194608-89a7-4c99-b6e5-f01a5f082121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:35.125183 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab194608-89a7-4c99-b6e5-f01a5f082121 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:35.125929 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab194608-89a7-4c99-b6e5-f01a5f082121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:35.126677 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-bfd719c9-32cf-40fd-aa6f-584834254684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a6b5eb78e84499bfd81e11059a4591'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:35.127519 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab194608-89a7-4c99-b6e5-f01a5f082121 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:35.138075 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-bfd719c9-32cf-40fd-aa6f-584834254684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a6b5eb78e84499bfd81e11059a4591'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:35.138238 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1348/2694] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:35 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 04:16:35.142372 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab194608-89a7-4c99-b6e5-f01a5f082121 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:35.145443 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-bfd719c9-32cf-40fd-aa6f-584834254684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a6b5eb78e84499bfd81e11059a4591'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:35.146378 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-bfd719c9-32cf-40fd-aa6f-584834254684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a6b5eb78e84499bfd81e11059a4591'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:35.151776 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab194608-89a7-4c99-b6e5-f01a5f082121 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:35.153236 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-bfd719c9-32cf-40fd-aa6f-584834254684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a6b5eb78e84499bfd81e11059a4591'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:35.156516 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e180b-e2e3-46d3-8c62-498e76a96420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:35.157363 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e180b-e2e3-46d3-8c62-498e76a96420 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:35.157646 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e180b-e2e3-46d3-8c62-498e76a96420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:35.157924 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e180b-e2e3-46d3-8c62-498e76a96420 admin admin] PATH_INFO: `/v3/projects/bc3b7829ba2e4e36b8afcea55b8f4a8a/users/d431d5ff969f41748d41ec7b75f3bdfb/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:35.159164 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1347/2695] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:16:35 2021] DELETE /identity/v3/users/50a6b5eb78e84499bfd81e11059a4591 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:35.163980 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbab58-d8d9-4839-8e7f-823deaf6d2a4 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:35.164322 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbab58-d8d9-4839-8e7f-823deaf6d2a4 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:35.164593 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbab58-d8d9-4839-8e7f-823deaf6d2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:35.174247 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e180b-e2e3-46d3-8c62-498e76a96420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc3b7829ba2e4e36b8afcea55b8f4a8a, user_id=d431d5ff969f41748d41ec7b75f3bdfb, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:35.176962 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e180b-e2e3-46d3-8c62-498e76a96420 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:35.182049 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-9fbbab58-d8d9-4839-8e7f-823deaf6d2a4 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:35.183243 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-9fbbab58-d8d9-4839-8e7f-823deaf6d2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:35.192814 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1349/2696] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:16:35 2021] PUT /identity/v3/projects/bc3b7829ba2e4e36b8afcea55b8f4a8a/users/d431d5ff969f41748d41ec7b75f3bdfb/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 04:16:35.203221 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3910ed4-edcf-4dd3-811e-d6a5debb661c None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:35.203554 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3910ed4-edcf-4dd3-811e-d6a5debb661c None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:35.203868 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3910ed4-edcf-4dd3-811e-d6a5debb661c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:35.229354 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-e3910ed4-edcf-4dd3-811e-d6a5debb661c None None] MFA Rules not processed for user `d431d5ff969f41748d41ec7b75f3bdfb`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:35.230591 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e3910ed4-edcf-4dd3-811e-d6a5debb661c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:35.247527 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1348/2697] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 04:16:35.257557 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbab58-d8d9-4839-8e7f-823deaf6d2a4 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:35.258923 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-9fbbab58-d8d9-4839-8e7f-823deaf6d2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:35.292710 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1350/2698] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:35 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 04:16:35.297152 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3910ed4-edcf-4dd3-811e-d6a5debb661c None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:35.298439 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e3910ed4-edcf-4dd3-811e-d6a5debb661c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:35.311911 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3910ed4-edcf-4dd3-811e-d6a5debb661c None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:35.314553 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbab58-d8d9-4839-8e7f-823deaf6d2a4 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:35.317063 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4b85f-8119-4a12-b807-ef57662de881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:35.317713 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4b85f-8119-4a12-b807-ef57662de881 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:35.317997 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4b85f-8119-4a12-b807-ef57662de881 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:35.318155 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab89bf-0da4-41d6-a5d2-0496743b732f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:35.318267 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4b85f-8119-4a12-b807-ef57662de881 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:35.318787 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab89bf-0da4-41d6-a5d2-0496743b732f service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:35.318960 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4b85f-8119-4a12-b807-ef57662de881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:35.319066 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab89bf-0da4-41d6-a5d2-0496743b732f service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:35.319321 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab89bf-0da4-41d6-a5d2-0496743b732f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:35.321541 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4b85f-8119-4a12-b807-ef57662de881 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:35.328615 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab89bf-0da4-41d6-a5d2-0496743b732f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:35.330017 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab89bf-0da4-41d6-a5d2-0496743b732f service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:35.340900 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1349/2699] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:16:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 04:16:35.348168 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1351/2700] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:16:35 2021] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 04:16:35.351869 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab89bf-0da4-41d6-a5d2-0496743b732f service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:35.361775 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab89bf-0da4-41d6-a5d2-0496743b732f service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:35.418388 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c435c05-80b8-4bda-8882-c94ff4ec8d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:35.419050 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c435c05-80b8-4bda-8882-c94ff4ec8d8e admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:35.419332 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c435c05-80b8-4bda-8882-c94ff4ec8d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:35.419765 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c435c05-80b8-4bda-8882-c94ff4ec8d8e admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:35.420480 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c435c05-80b8-4bda-8882-c94ff4ec8d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:35.422391 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c435c05-80b8-4bda-8882-c94ff4ec8d8e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:35.443189 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1350/2701] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:16:35 2021] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:16:35.447551 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4b85f-8119-4a12-b807-ef57662de881 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:35.457945 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4b85f-8119-4a12-b807-ef57662de881 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:35.463570 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a4ebf-a813-4849-9b7d-6581b27299a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:35.464299 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a4ebf-a813-4849-9b7d-6581b27299a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:35.464585 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a4ebf-a813-4849-9b7d-6581b27299a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:35.464859 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a4ebf-a813-4849-9b7d-6581b27299a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:35.465822 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a4ebf-a813-4849-9b7d-6581b27299a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:35.467179 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a4ebf-a813-4849-9b7d-6581b27299a3 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:35.477813 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1352/2702] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:35 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:16:35.482371 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c435c05-80b8-4bda-8882-c94ff4ec8d8e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:35.494389 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c435c05-80b8-4bda-8882-c94ff4ec8d8e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:35.499608 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659d980-0c75-4b11-9011-55505ee48436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:35.500309 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659d980-0c75-4b11-9011-55505ee48436 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:35.500610 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659d980-0c75-4b11-9011-55505ee48436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:35.500871 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659d980-0c75-4b11-9011-55505ee48436 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:35.501632 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659d980-0c75-4b11-9011-55505ee48436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:35.503272 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659d980-0c75-4b11-9011-55505ee48436 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:35.513959 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1351/2703] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:35 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 04:16:35.518042 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a4ebf-a813-4849-9b7d-6581b27299a3 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:35.528134 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a4ebf-a813-4849-9b7d-6581b27299a3 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:35.532821 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102d3b5-df35-408a-97d9-02584cbb1554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:35.533744 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102d3b5-df35-408a-97d9-02584cbb1554 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:35.534027 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102d3b5-df35-408a-97d9-02584cbb1554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:35.534305 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102d3b5-df35-408a-97d9-02584cbb1554 admin admin] PATH_INFO: `/v3/projects/de1bbe7b627145429f311ec8e31200d0/users/71dd1d09d8ff4fdab9b92a03ed99f5a9/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:35.548515 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102d3b5-df35-408a-97d9-02584cbb1554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de1bbe7b627145429f311ec8e31200d0, user_id=71dd1d09d8ff4fdab9b92a03ed99f5a9, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:35.551112 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102d3b5-df35-408a-97d9-02584cbb1554 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:35.564996 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1353/2704] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:16:35 2021] PUT /identity/v3/projects/de1bbe7b627145429f311ec8e31200d0/users/71dd1d09d8ff4fdab9b92a03ed99f5a9/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:35.575930 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9f3bf-0f74-4088-90fd-6ecd1602dc55 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:35.576220 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9f3bf-0f74-4088-90fd-6ecd1602dc55 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:35.576494 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9f3bf-0f74-4088-90fd-6ecd1602dc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:35.602685 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-88f9f3bf-0f74-4088-90fd-6ecd1602dc55 None None] MFA Rules not processed for user `71dd1d09d8ff4fdab9b92a03ed99f5a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:35.603919 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-88f9f3bf-0f74-4088-90fd-6ecd1602dc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:35.608074 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102d3b5-df35-408a-97d9-02584cbb1554 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:35.609913 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-f102d3b5-df35-408a-97d9-02584cbb1554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:35.672515 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1352/2705] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:35 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:35.676944 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9f3bf-0f74-4088-90fd-6ecd1602dc55 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:35.678588 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102d3b5-df35-408a-97d9-02584cbb1554 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:35.683288 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47086696-4abe-4d7e-a4ec-765510b734e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:35.684149 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47086696-4abe-4d7e-a4ec-765510b734e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:35.684428 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47086696-4abe-4d7e-a4ec-765510b734e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:35.684715 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47086696-4abe-4d7e-a4ec-765510b734e6 admin admin] PATH_INFO: `/v3/projects/a0186460ff2c4b93aa7079257383b5fc` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:35.685897 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47086696-4abe-4d7e-a4ec-765510b734e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0186460ff2c4b93aa7079257383b5fc)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:35.687024 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9f3bf-0f74-4088-90fd-6ecd1602dc55 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:35.688100 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47086696-4abe-4d7e-a4ec-765510b734e6 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:35.691961 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfb07c-128c-40c4-a968-b4104ed61147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:35.692612 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfb07c-128c-40c4-a968-b4104ed61147 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:35.692878 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfb07c-128c-40c4-a968-b4104ed61147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:35.693160 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfb07c-128c-40c4-a968-b4104ed61147 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:35.693879 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfb07c-128c-40c4-a968-b4104ed61147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:35.696125 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfb07c-128c-40c4-a968-b4104ed61147 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:35.724118 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1353/2706] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:16:35 2021] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 04:16:35.725364 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfb07c-128c-40c4-a968-b4104ed61147 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:35.733215 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-47086696-4abe-4d7e-a4ec-765510b734e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0186460ff2c4b93aa7079257383b5fc', 'request_id': 'req-47086696-4abe-4d7e-a4ec-765510b734e6'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:35.739185 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-47086696-4abe-4d7e-a4ec-765510b734e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0186460ff2c4b93aa7079257383b5fc', 'request_id': 'req-47086696-4abe-4d7e-a4ec-765510b734e6'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:35.744598 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-47086696-4abe-4d7e-a4ec-765510b734e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0186460ff2c4b93aa7079257383b5fc', 'request_id': 'req-47086696-4abe-4d7e-a4ec-765510b734e6'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:35.757322 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-47086696-4abe-4d7e-a4ec-765510b734e6 admin admin] The token cache is being invalidate because project a0186460ff2c4b93aa7079257383b5fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:16:35.757612 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-47086696-4abe-4d7e-a4ec-765510b734e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:35.758990 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-47086696-4abe-4d7e-a4ec-765510b734e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:35.760806 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1354/2707] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:16:35 2021] DELETE /identity/v3/projects/a0186460ff2c4b93aa7079257383b5fc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 04:16:35.764444 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47086696-4abe-4d7e-a4ec-765510b734e6 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:35.765797 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-47086696-4abe-4d7e-a4ec-765510b734e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:35.794137 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfb07c-128c-40c4-a968-b4104ed61147 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:35.827010 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47086696-4abe-4d7e-a4ec-765510b734e6 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:35.831609 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5aa93-dd1d-4d22-b04a-ad2895818409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:35.832498 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5aa93-dd1d-4d22-b04a-ad2895818409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:35.832782 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5aa93-dd1d-4d22-b04a-ad2895818409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:35.833065 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5aa93-dd1d-4d22-b04a-ad2895818409 admin admin] PATH_INFO: `/v3/users/c2523a1d191b474c9865e6a71f2f4f71` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:35.834262 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5aa93-dd1d-4d22-b04a-ad2895818409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2523a1d191b474c9865e6a71f2f4f71)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:35.836769 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5aa93-dd1d-4d22-b04a-ad2895818409 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:35.848534 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c1b57-1df1-4888-be6a-e5038d99fb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:35.849189 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c1b57-1df1-4888-be6a-e5038d99fb7b admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:35.849472 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c1b57-1df1-4888-be6a-e5038d99fb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:35.849749 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c1b57-1df1-4888-be6a-e5038d99fb7b admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:35.850439 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c1b57-1df1-4888-be6a-e5038d99fb7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:35.852941 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c1b57-1df1-4888-be6a-e5038d99fb7b admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:35.872660 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1354/2708] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:16:35 2021] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 04:16:35.876719 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c1b57-1df1-4888-be6a-e5038d99fb7b admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:35.878888 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-049c1b57-1df1-4888-be6a-e5038d99fb7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:35.881812 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-08c5aa93-dd1d-4d22-b04a-ad2895818409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2523a1d191b474c9865e6a71f2f4f71'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:35.890938 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c1b57-1df1-4888-be6a-e5038d99fb7b admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:35.893725 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-08c5aa93-dd1d-4d22-b04a-ad2895818409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2523a1d191b474c9865e6a71f2f4f71'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:35.895490 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd7bd4-395d-4e7b-a094-6bb3472d005d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:35.896194 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd7bd4-395d-4e7b-a094-6bb3472d005d admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:35.896468 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd7bd4-395d-4e7b-a094-6bb3472d005d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:35.896738 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd7bd4-395d-4e7b-a094-6bb3472d005d admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:35.897466 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd7bd4-395d-4e7b-a094-6bb3472d005d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:35.899990 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd7bd4-395d-4e7b-a094-6bb3472d005d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:35.902077 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-08c5aa93-dd1d-4d22-b04a-ad2895818409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2523a1d191b474c9865e6a71f2f4f71'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:35.902779 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-08c5aa93-dd1d-4d22-b04a-ad2895818409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2523a1d191b474c9865e6a71f2f4f71'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:35.909555 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-08c5aa93-dd1d-4d22-b04a-ad2895818409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2523a1d191b474c9865e6a71f2f4f71'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:35.910335 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1355/2709] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:35 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 04:16:35.914426 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd7bd4-395d-4e7b-a094-6bb3472d005d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:35.915732 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1355/2710] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:16:35 2021] DELETE /identity/v3/users/c2523a1d191b474c9865e6a71f2f4f71 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 04:16:35.916182 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-f1cd7bd4-395d-4e7b-a094-6bb3472d005d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:35.929041 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd7bd4-395d-4e7b-a094-6bb3472d005d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:35.988847 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390ed3a-1526-4295-bb3c-a2772ef323fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:35.989729 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390ed3a-1526-4295-bb3c-a2772ef323fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:35.990015 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390ed3a-1526-4295-bb3c-a2772ef323fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:35.990288 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390ed3a-1526-4295-bb3c-a2772ef323fd admin admin] PATH_INFO: `/v3/projects/e05df4016b6b434ebcd09195bf455faa/users/c7e0d5f692124a4ba9df19a652ec8195/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:36.005439 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390ed3a-1526-4295-bb3c-a2772ef323fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e05df4016b6b434ebcd09195bf455faa, user_id=c7e0d5f692124a4ba9df19a652ec8195, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:36.008268 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390ed3a-1526-4295-bb3c-a2772ef323fd admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:36.021635 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1356/2711] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:16:35 2021] PUT /identity/v3/projects/e05df4016b6b434ebcd09195bf455faa/users/c7e0d5f692124a4ba9df19a652ec8195/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 04:16:36.026292 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5aa93-dd1d-4d22-b04a-ad2895818409 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:36.036403 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5aa93-dd1d-4d22-b04a-ad2895818409 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:36.106004 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595500d-d935-4363-974a-6fcf8a321b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:36.106766 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595500d-d935-4363-974a-6fcf8a321b8f admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:36.106946 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595500d-d935-4363-974a-6fcf8a321b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:36.107417 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595500d-d935-4363-974a-6fcf8a321b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:36.108532 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595500d-d935-4363-974a-6fcf8a321b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:36.110154 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595500d-d935-4363-974a-6fcf8a321b8f admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:36.120664 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1356/2712] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:36 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:16:36.124822 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390ed3a-1526-4295-bb3c-a2772ef323fd admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:36.135280 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390ed3a-1526-4295-bb3c-a2772ef323fd admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:36.139868 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af560232-f8ae-4749-937d-b0fa7cf0a561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:36.140731 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af560232-f8ae-4749-937d-b0fa7cf0a561 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:36.141011 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af560232-f8ae-4749-937d-b0fa7cf0a561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:36.141281 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af560232-f8ae-4749-937d-b0fa7cf0a561 admin admin] PATH_INFO: `/v3/projects/e05df4016b6b434ebcd09195bf455faa/users/c7e0d5f692124a4ba9df19a652ec8195/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:36.143248 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af560232-f8ae-4749-937d-b0fa7cf0a561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e05df4016b6b434ebcd09195bf455faa, user_id=c7e0d5f692124a4ba9df19a652ec8195, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:36.146007 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af560232-f8ae-4749-937d-b0fa7cf0a561 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:36.156108 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1357/2713] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:16:36 2021] PUT /identity/v3/projects/e05df4016b6b434ebcd09195bf455faa/users/c7e0d5f692124a4ba9df19a652ec8195/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:36.167973 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b1369-72e0-4955-8e5a-9a9d6dd3efc7 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:36.168248 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b1369-72e0-4955-8e5a-9a9d6dd3efc7 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:36.168552 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b1369-72e0-4955-8e5a-9a9d6dd3efc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:36.196152 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af560232-f8ae-4749-937d-b0fa7cf0a561 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:36.196727 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-790b1369-72e0-4955-8e5a-9a9d6dd3efc7 None None] MFA Rules not processed for user `c7e0d5f692124a4ba9df19a652ec8195`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:36.197833 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-af560232-f8ae-4749-937d-b0fa7cf0a561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:36.197945 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-790b1369-72e0-4955-8e5a-9a9d6dd3efc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:36.267776 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1357/2714] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:36 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:36.276418 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af560232-f8ae-4749-937d-b0fa7cf0a561 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:36.278452 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b1369-72e0-4955-8e5a-9a9d6dd3efc7 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:36.279870 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-790b1369-72e0-4955-8e5a-9a9d6dd3efc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:36.281152 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d10658-faff-4676-a450-32ede9d171de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:36.281996 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d10658-faff-4676-a450-32ede9d171de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:36.282281 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d10658-faff-4676-a450-32ede9d171de admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:36.282647 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d10658-faff-4676-a450-32ede9d171de admin admin] PATH_INFO: `/v3/projects/76ce24fddfba4123813a10f10b0d9b00` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:36.283781 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d10658-faff-4676-a450-32ede9d171de admin admin] RBAC: Authorizing `identity:delete_project(project_id=76ce24fddfba4123813a10f10b0d9b00)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:36.285686 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d10658-faff-4676-a450-32ede9d171de admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:36.330886 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-30d10658-faff-4676-a450-32ede9d171de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76ce24fddfba4123813a10f10b0d9b00', 'request_id': 'req-30d10658-faff-4676-a450-32ede9d171de'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:36.336784 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-30d10658-faff-4676-a450-32ede9d171de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76ce24fddfba4123813a10f10b0d9b00', 'request_id': 'req-30d10658-faff-4676-a450-32ede9d171de'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:36.337546 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b1369-72e0-4955-8e5a-9a9d6dd3efc7 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:36.342053 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-30d10658-faff-4676-a450-32ede9d171de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76ce24fddfba4123813a10f10b0d9b00', 'request_id': 'req-30d10658-faff-4676-a450-32ede9d171de'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:36.353926 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-30d10658-faff-4676-a450-32ede9d171de admin admin] The token cache is being invalidate because project 76ce24fddfba4123813a10f10b0d9b00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:16:36.354213 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-30d10658-faff-4676-a450-32ede9d171de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:36.354845 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-30d10658-faff-4676-a450-32ede9d171de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:36.356601 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1358/2715] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:16:36 2021] DELETE /identity/v3/projects/76ce24fddfba4123813a10f10b0d9b00 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 04:16:36.362301 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e6287-9327-4a1e-82f4-d7e1398e2bff None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:36.362585 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e6287-9327-4a1e-82f4-d7e1398e2bff None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:36.362862 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e6287-9327-4a1e-82f4-d7e1398e2bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:36.381272 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-8f0e6287-9327-4a1e-82f4-d7e1398e2bff None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:36.383206 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-8f0e6287-9327-4a1e-82f4-d7e1398e2bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:36.387208 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aad8b0-f41f-4580-a618-b77f5ef2efa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:36.387941 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aad8b0-f41f-4580-a618-b77f5ef2efa7 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:36.388228 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aad8b0-f41f-4580-a618-b77f5ef2efa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:36.388617 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aad8b0-f41f-4580-a618-b77f5ef2efa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:36.390384 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-99aad8b0-f41f-4580-a618-b77f5ef2efa7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:36.439514 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1359/2716] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:36.446192 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aad8b0-f41f-4580-a618-b77f5ef2efa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:36.448105 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aad8b0-f41f-4580-a618-b77f5ef2efa7 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:36.448582 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19729aa-9cb1-4b05-8de0-451b164aa755 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:36.448866 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19729aa-9cb1-4b05-8de0-451b164aa755 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:36.449145 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19729aa-9cb1-4b05-8de0-451b164aa755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:36.457062 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1358/2717] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:16:36 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 04:16:36.467563 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-f19729aa-9cb1-4b05-8de0-451b164aa755 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:36.468805 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-f19729aa-9cb1-4b05-8de0-451b164aa755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:36.477393 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1360/2718] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 04:16:36.481569 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aad8b0-f41f-4580-a618-b77f5ef2efa7 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:36.491846 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aad8b0-f41f-4580-a618-b77f5ef2efa7 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:36.496358 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac11fa7-eff3-46bf-8c81-c47813b0d1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:36.497001 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac11fa7-eff3-46bf-8c81-c47813b0d1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:36.497285 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac11fa7-eff3-46bf-8c81-c47813b0d1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:36.497563 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac11fa7-eff3-46bf-8c81-c47813b0d1c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:36.498286 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac11fa7-eff3-46bf-8c81-c47813b0d1c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 04:16:36.498591 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac11fa7-eff3-46bf-8c81-c47813b0d1c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:36.500206 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac11fa7-eff3-46bf-8c81-c47813b0d1c9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:36.511469 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1359/2719] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 04:16:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 04:16:36.515526 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19729aa-9cb1-4b05-8de0-451b164aa755 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:36.525342 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19729aa-9cb1-4b05-8de0-451b164aa755 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:36.529975 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e544c-c4d3-46f2-a27a-0e68e77855e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:36.530615 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e544c-c4d3-46f2-a27a-0e68e77855e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:36.530895 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e544c-c4d3-46f2-a27a-0e68e77855e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:36.531167 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e544c-c4d3-46f2-a27a-0e68e77855e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:36.531900 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e544c-c4d3-46f2-a27a-0e68e77855e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:36.533815 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e544c-c4d3-46f2-a27a-0e68e77855e8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:36.563505 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1361/2720] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:16:36 2021] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:16:36.564762 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac11fa7-eff3-46bf-8c81-c47813b0d1c9 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:36.574710 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac11fa7-eff3-46bf-8c81-c47813b0d1c9 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:36.630514 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7a581-e63f-457a-8ac5-09fdb51ddda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:36.631170 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7a581-e63f-457a-8ac5-09fdb51ddda2 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:36.631448 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7a581-e63f-457a-8ac5-09fdb51ddda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:36.631748 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7a581-e63f-457a-8ac5-09fdb51ddda2 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:36.632976 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7a581-e63f-457a-8ac5-09fdb51ddda2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:36.634868 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7a581-e63f-457a-8ac5-09fdb51ddda2 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:36.655949 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1360/2721] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:16:36 2021] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:16:36.660609 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e544c-c4d3-46f2-a27a-0e68e77855e8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:36.671615 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e544c-c4d3-46f2-a27a-0e68e77855e8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:36.677365 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a61e5-8280-4cdf-a113-4d7432dbdd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:36.677888 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a61e5-8280-4cdf-a113-4d7432dbdd2d admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:36.678165 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a61e5-8280-4cdf-a113-4d7432dbdd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:36.678438 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a61e5-8280-4cdf-a113-4d7432dbdd2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:36.679251 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a61e5-8280-4cdf-a113-4d7432dbdd2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:36.688479 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a61e5-8280-4cdf-a113-4d7432dbdd2d admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:36.701076 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1362/2722] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:36 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:16:36.705158 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7a581-e63f-457a-8ac5-09fdb51ddda2 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:36.717584 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7a581-e63f-457a-8ac5-09fdb51ddda2 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:36.722394 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9658d2e-8d7e-44fb-8177-e6a866e766d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:36.723068 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9658d2e-8d7e-44fb-8177-e6a866e766d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:36.723349 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9658d2e-8d7e-44fb-8177-e6a866e766d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:36.723628 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9658d2e-8d7e-44fb-8177-e6a866e766d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:36.724405 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9658d2e-8d7e-44fb-8177-e6a866e766d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:36.726219 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9658d2e-8d7e-44fb-8177-e6a866e766d3 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:36.736921 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1361/2723] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:36 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:16:36.741040 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a61e5-8280-4cdf-a113-4d7432dbdd2d admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:36.750830 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a61e5-8280-4cdf-a113-4d7432dbdd2d admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:36.756356 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed9a63-b52a-4bd5-822c-9b01ce0f29aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:36.758046 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed9a63-b52a-4bd5-822c-9b01ce0f29aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:36.758525 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed9a63-b52a-4bd5-822c-9b01ce0f29aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:36.758852 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed9a63-b52a-4bd5-822c-9b01ce0f29aa admin admin] PATH_INFO: `/v3/projects/1b2b9145b448494e9f58fd815feeab25/users/b249efd657974bfa8f2bc3851d4df5f8/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:36.774939 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed9a63-b52a-4bd5-822c-9b01ce0f29aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b2b9145b448494e9f58fd815feeab25, user_id=b249efd657974bfa8f2bc3851d4df5f8, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:36.777716 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed9a63-b52a-4bd5-822c-9b01ce0f29aa admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:36.791361 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1363/2724] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:16:36 2021] PUT /identity/v3/projects/1b2b9145b448494e9f58fd815feeab25/users/b249efd657974bfa8f2bc3851d4df5f8/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:36.801509 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245e71f-12eb-414c-8d3b-4d8408b6c0fc None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:36.801801 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245e71f-12eb-414c-8d3b-4d8408b6c0fc None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:36.802082 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245e71f-12eb-414c-8d3b-4d8408b6c0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:36.828765 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-5245e71f-12eb-414c-8d3b-4d8408b6c0fc None None] MFA Rules not processed for user `b249efd657974bfa8f2bc3851d4df5f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:36.829964 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-5245e71f-12eb-414c-8d3b-4d8408b6c0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:36.890241 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1362/2725] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:36 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:36.894677 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed9a63-b52a-4bd5-822c-9b01ce0f29aa admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:36.955946 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed9a63-b52a-4bd5-822c-9b01ce0f29aa admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:36.961780 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526e8ce-8a88-4999-a05b-3924945fdd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:36.962423 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526e8ce-8a88-4999-a05b-3924945fdd6c admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:36.962702 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526e8ce-8a88-4999-a05b-3924945fdd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:36.962973 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526e8ce-8a88-4999-a05b-3924945fdd6c admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:36.963705 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526e8ce-8a88-4999-a05b-3924945fdd6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:36.966199 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526e8ce-8a88-4999-a05b-3924945fdd6c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:36.990135 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1364/2726] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:16:36 2021] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:16:36.994778 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245e71f-12eb-414c-8d3b-4d8408b6c0fc None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:37.005242 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245e71f-12eb-414c-8d3b-4d8408b6c0fc None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:37.059305 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c34a9f-d550-45a3-8932-d5bafa7e6065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:37.060037 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c34a9f-d550-45a3-8932-d5bafa7e6065 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:37.060474 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c34a9f-d550-45a3-8932-d5bafa7e6065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:37.060722 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c34a9f-d550-45a3-8932-d5bafa7e6065 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:37.061550 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c34a9f-d550-45a3-8932-d5bafa7e6065 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:37.063749 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c34a9f-d550-45a3-8932-d5bafa7e6065 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:37.082972 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1363/2727] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:16:36 2021] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 04:16:37.086916 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526e8ce-8a88-4999-a05b-3924945fdd6c admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:37.096855 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526e8ce-8a88-4999-a05b-3924945fdd6c admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:37.101354 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc075c0-fb2e-4be7-9ea3-98f067a43d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:37.101989 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc075c0-fb2e-4be7-9ea3-98f067a43d23 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:37.102269 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc075c0-fb2e-4be7-9ea3-98f067a43d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:37.102544 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc075c0-fb2e-4be7-9ea3-98f067a43d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:37.103266 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc075c0-fb2e-4be7-9ea3-98f067a43d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:37.104866 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc075c0-fb2e-4be7-9ea3-98f067a43d23 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:37.114785 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1365/2728] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:37 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:16:37.118986 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c34a9f-d550-45a3-8932-d5bafa7e6065 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:37.128354 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c34a9f-d550-45a3-8932-d5bafa7e6065 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:37.133533 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74436e3b-3808-4aba-9995-a919bfda9c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:37.134378 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74436e3b-3808-4aba-9995-a919bfda9c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:37.134655 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74436e3b-3808-4aba-9995-a919bfda9c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:37.134924 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74436e3b-3808-4aba-9995-a919bfda9c0e admin admin] PATH_INFO: `/v3/projects/af8b6ceb932d4a68afa5d209e7c9cd17/users/66a740cd2b80466cb66b7cd02a121711/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:37.148796 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74436e3b-3808-4aba-9995-a919bfda9c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8b6ceb932d4a68afa5d209e7c9cd17, user_id=66a740cd2b80466cb66b7cd02a121711, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:37.151332 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74436e3b-3808-4aba-9995-a919bfda9c0e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:37.167194 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1364/2729] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:16:37 2021] PUT /identity/v3/projects/af8b6ceb932d4a68afa5d209e7c9cd17/users/66a740cd2b80466cb66b7cd02a121711/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:37.170971 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc075c0-fb2e-4be7-9ea3-98f067a43d23 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:37.181169 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc075c0-fb2e-4be7-9ea3-98f067a43d23 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:37.236751 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06d779-97dc-48ad-816e-732eec5a5b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:37.237566 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06d779-97dc-48ad-816e-732eec5a5b80 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:37.237856 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06d779-97dc-48ad-816e-732eec5a5b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:37.238137 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06d779-97dc-48ad-816e-732eec5a5b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:37.238874 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06d779-97dc-48ad-816e-732eec5a5b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:37.240511 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06d779-97dc-48ad-816e-732eec5a5b80 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:37.250421 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1366/2730] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:37 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:16:37.254642 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74436e3b-3808-4aba-9995-a919bfda9c0e admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:37.264589 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74436e3b-3808-4aba-9995-a919bfda9c0e admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:37.269894 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc14f0-b87b-43f8-b4ce-8a0a19ab72c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:37.271422 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc14f0-b87b-43f8-b4ce-8a0a19ab72c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:37.271955 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc14f0-b87b-43f8-b4ce-8a0a19ab72c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:37.272471 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc14f0-b87b-43f8-b4ce-8a0a19ab72c7 admin admin] PATH_INFO: `/v3/projects/af8b6ceb932d4a68afa5d209e7c9cd17/users/66a740cd2b80466cb66b7cd02a121711/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:37.275777 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc14f0-b87b-43f8-b4ce-8a0a19ab72c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8b6ceb932d4a68afa5d209e7c9cd17, user_id=66a740cd2b80466cb66b7cd02a121711, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:37.278427 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc14f0-b87b-43f8-b4ce-8a0a19ab72c7 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:37.289002 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1365/2731] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:16:37 2021] PUT /identity/v3/projects/af8b6ceb932d4a68afa5d209e7c9cd17/users/66a740cd2b80466cb66b7cd02a121711/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:37.298780 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dd5a8-18f4-481c-9f42-6279fc7907e6 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:37.299235 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dd5a8-18f4-481c-9f42-6279fc7907e6 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:37.299340 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dd5a8-18f4-481c-9f42-6279fc7907e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:37.324691 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-783dd5a8-18f4-481c-9f42-6279fc7907e6 None None] MFA Rules not processed for user `66a740cd2b80466cb66b7cd02a121711`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:37.325878 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-783dd5a8-18f4-481c-9f42-6279fc7907e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:37.391069 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1367/2732] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:37 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:37.402278 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc14f0-b87b-43f8-b4ce-8a0a19ab72c7 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:37.403941 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-36cc14f0-b87b-43f8-b4ce-8a0a19ab72c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:37.458453 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc14f0-b87b-43f8-b4ce-8a0a19ab72c7 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:37.462722 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8313b-aa5c-45af-8be7-6425a540ae3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:37.463377 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8313b-aa5c-45af-8be7-6425a540ae3a service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:37.463658 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8313b-aa5c-45af-8be7-6425a540ae3a service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:37.463964 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8313b-aa5c-45af-8be7-6425a540ae3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:37.472641 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8313b-aa5c-45af-8be7-6425a540ae3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:37.474065 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8313b-aa5c-45af-8be7-6425a540ae3a service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:37.483113 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1366/2733] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:16:37 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:16:37.509776 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783dd5a8-18f4-481c-9f42-6279fc7907e6 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:37.568335 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783dd5a8-18f4-481c-9f42-6279fc7907e6 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:37.573710 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0c029-d347-4064-bdce-522c7cda371e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:37.574567 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0c029-d347-4064-bdce-522c7cda371e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:37.574869 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0c029-d347-4064-bdce-522c7cda371e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:37.575127 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0c029-d347-4064-bdce-522c7cda371e admin admin] PATH_INFO: `/v3/users/b249efd657974bfa8f2bc3851d4df5f8` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:37.576377 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0c029-d347-4064-bdce-522c7cda371e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b249efd657974bfa8f2bc3851d4df5f8)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:37.578299 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0c029-d347-4064-bdce-522c7cda371e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:37.620889 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-c6f0c029-d347-4064-bdce-522c7cda371e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b249efd657974bfa8f2bc3851d4df5f8'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:37.631730 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-c6f0c029-d347-4064-bdce-522c7cda371e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b249efd657974bfa8f2bc3851d4df5f8'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:37.639439 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-c6f0c029-d347-4064-bdce-522c7cda371e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b249efd657974bfa8f2bc3851d4df5f8'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:37.640105 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-c6f0c029-d347-4064-bdce-522c7cda371e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b249efd657974bfa8f2bc3851d4df5f8'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:37.646548 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-c6f0c029-d347-4064-bdce-522c7cda371e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b249efd657974bfa8f2bc3851d4df5f8'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:37.652716 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1368/2734] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:16:37 2021] DELETE /identity/v3/users/b249efd657974bfa8f2bc3851d4df5f8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:37.657162 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a908e-0dcf-46f2-b63e-38b2d718f491 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:37.657535 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a908e-0dcf-46f2-b63e-38b2d718f491 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:37.657822 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a908e-0dcf-46f2-b63e-38b2d718f491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:37.675087 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-f54a908e-0dcf-46f2-b63e-38b2d718f491 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:37.676307 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-f54a908e-0dcf-46f2-b63e-38b2d718f491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:37.733808 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1367/2735] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 04:16:37.744073 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0c029-d347-4064-bdce-522c7cda371e admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:37.745449 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-c6f0c029-d347-4064-bdce-522c7cda371e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:37.808215 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0c029-d347-4064-bdce-522c7cda371e admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:37.813906 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effe3ff-9f96-4b28-a6d4-0f7fde634d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:37.814545 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effe3ff-9f96-4b28-a6d4-0f7fde634d93 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:37.815056 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effe3ff-9f96-4b28-a6d4-0f7fde634d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:37.815338 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effe3ff-9f96-4b28-a6d4-0f7fde634d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:37.827253 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effe3ff-9f96-4b28-a6d4-0f7fde634d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:37.833217 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effe3ff-9f96-4b28-a6d4-0f7fde634d93 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:37.840657 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1369/2736] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:16:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:16:37.932320 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a908e-0dcf-46f2-b63e-38b2d718f491 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:37.933802 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-f54a908e-0dcf-46f2-b63e-38b2d718f491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:37.996139 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a908e-0dcf-46f2-b63e-38b2d718f491 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:37.999945 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce8a17-ef81-4257-b9d5-e5e28dc33747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:38.000590 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce8a17-ef81-4257-b9d5-e5e28dc33747 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:38.000872 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce8a17-ef81-4257-b9d5-e5e28dc33747 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:38.001146 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce8a17-ef81-4257-b9d5-e5e28dc33747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:38.002919 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-86ce8a17-ef81-4257-b9d5-e5e28dc33747 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:38.059873 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce8a17-ef81-4257-b9d5-e5e28dc33747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:38.061302 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce8a17-ef81-4257-b9d5-e5e28dc33747 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:38.070809 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1368/2737] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:16:37 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:16:38.104946 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effe3ff-9f96-4b28-a6d4-0f7fde634d93 service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:38.106408 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-2effe3ff-9f96-4b28-a6d4-0f7fde634d93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:38.120956 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effe3ff-9f96-4b28-a6d4-0f7fde634d93 service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:38.125946 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485628f-48cb-4b18-ab23-e994150dca6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:38.127409 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485628f-48cb-4b18-ab23-e994150dca6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:38.127724 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485628f-48cb-4b18-ab23-e994150dca6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:38.128112 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485628f-48cb-4b18-ab23-e994150dca6a admin admin] PATH_INFO: `/v3/projects/1b2b9145b448494e9f58fd815feeab25` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:38.129182 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485628f-48cb-4b18-ab23-e994150dca6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b2b9145b448494e9f58fd815feeab25)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:38.131075 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485628f-48cb-4b18-ab23-e994150dca6a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:38.180673 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2485628f-48cb-4b18-ab23-e994150dca6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b2b9145b448494e9f58fd815feeab25', 'request_id': 'req-2485628f-48cb-4b18-ab23-e994150dca6a'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:38.186823 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2485628f-48cb-4b18-ab23-e994150dca6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b2b9145b448494e9f58fd815feeab25', 'request_id': 'req-2485628f-48cb-4b18-ab23-e994150dca6a'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:38.192473 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2485628f-48cb-4b18-ab23-e994150dca6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b2b9145b448494e9f58fd815feeab25', 'request_id': 'req-2485628f-48cb-4b18-ab23-e994150dca6a'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:38.205078 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2485628f-48cb-4b18-ab23-e994150dca6a admin admin] The token cache is being invalidate because project 1b2b9145b448494e9f58fd815feeab25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:16:38.205368 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2485628f-48cb-4b18-ab23-e994150dca6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:38.206136 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-2485628f-48cb-4b18-ab23-e994150dca6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:38.207802 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1370/2738] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:16:38 2021] DELETE /identity/v3/projects/1b2b9145b448494e9f58fd815feeab25 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:38.211894 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce8a17-ef81-4257-b9d5-e5e28dc33747 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:38.222310 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce8a17-ef81-4257-b9d5-e5e28dc33747 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:38.287564 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99983279-3d2e-410c-8104-59fe7cf31ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:38.289081 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99983279-3d2e-410c-8104-59fe7cf31ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:38.289555 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99983279-3d2e-410c-8104-59fe7cf31ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:38.289862 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99983279-3d2e-410c-8104-59fe7cf31ab5 admin admin] PATH_INFO: `/v3/users/66a740cd2b80466cb66b7cd02a121711` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:38.291707 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99983279-3d2e-410c-8104-59fe7cf31ab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66a740cd2b80466cb66b7cd02a121711)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:38.293726 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99983279-3d2e-410c-8104-59fe7cf31ab5 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:38.339755 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-99983279-3d2e-410c-8104-59fe7cf31ab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66a740cd2b80466cb66b7cd02a121711'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:38.351576 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-99983279-3d2e-410c-8104-59fe7cf31ab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66a740cd2b80466cb66b7cd02a121711'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:38.359260 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-99983279-3d2e-410c-8104-59fe7cf31ab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66a740cd2b80466cb66b7cd02a121711'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:38.360059 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-99983279-3d2e-410c-8104-59fe7cf31ab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66a740cd2b80466cb66b7cd02a121711'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:38.368306 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-99983279-3d2e-410c-8104-59fe7cf31ab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66a740cd2b80466cb66b7cd02a121711'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:38.376470 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1369/2739] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:16:38 2021] DELETE /identity/v3/users/66a740cd2b80466cb66b7cd02a121711 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 04:16:38.583673 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485628f-48cb-4b18-ab23-e994150dca6a admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:38.585213 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-2485628f-48cb-4b18-ab23-e994150dca6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:38.642424 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485628f-48cb-4b18-ab23-e994150dca6a admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:38.645547 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99983279-3d2e-410c-8104-59fe7cf31ab5 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:38.647017 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-99983279-3d2e-410c-8104-59fe7cf31ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:38.693819 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55eb44-e521-44d9-afeb-ce55325b1675 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:38.694491 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55eb44-e521-44d9-afeb-ce55325b1675 service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:38.695450 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55eb44-e521-44d9-afeb-ce55325b1675 service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:38.695819 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55eb44-e521-44d9-afeb-ce55325b1675 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:38.697797 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-3a55eb44-e521-44d9-afeb-ce55325b1675 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:38.711510 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99983279-3d2e-410c-8104-59fe7cf31ab5 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:38.716138 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8a20f-0683-4382-a1ba-b505f14c2b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:38.717016 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8a20f-0683-4382-a1ba-b505f14c2b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:38.717299 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8a20f-0683-4382-a1ba-b505f14c2b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:38.717577 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8a20f-0683-4382-a1ba-b505f14c2b83 admin admin] PATH_INFO: `/v3/projects/af8b6ceb932d4a68afa5d209e7c9cd17` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:38.718778 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8a20f-0683-4382-a1ba-b505f14c2b83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af8b6ceb932d4a68afa5d209e7c9cd17)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:38.720728 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8a20f-0683-4382-a1ba-b505f14c2b83 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:38.760136 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55eb44-e521-44d9-afeb-ce55325b1675 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:38.761584 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55eb44-e521-44d9-afeb-ce55325b1675 service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:38.766526 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a9f8a20f-0683-4382-a1ba-b505f14c2b83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af8b6ceb932d4a68afa5d209e7c9cd17', 'request_id': 'req-a9f8a20f-0683-4382-a1ba-b505f14c2b83'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:38.771132 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1371/2740] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:16:38 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:16:38.773230 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a9f8a20f-0683-4382-a1ba-b505f14c2b83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af8b6ceb932d4a68afa5d209e7c9cd17', 'request_id': 'req-a9f8a20f-0683-4382-a1ba-b505f14c2b83'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:38.778908 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a9f8a20f-0683-4382-a1ba-b505f14c2b83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af8b6ceb932d4a68afa5d209e7c9cd17', 'request_id': 'req-a9f8a20f-0683-4382-a1ba-b505f14c2b83'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:38.793048 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a9f8a20f-0683-4382-a1ba-b505f14c2b83 admin admin] The token cache is being invalidate because project af8b6ceb932d4a68afa5d209e7c9cd17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:16:38.793360 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a9f8a20f-0683-4382-a1ba-b505f14c2b83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:38.794082 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-a9f8a20f-0683-4382-a1ba-b505f14c2b83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:38.795611 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1370/2741] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:16:38 2021] DELETE /identity/v3/projects/af8b6ceb932d4a68afa5d209e7c9cd17 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 04:16:38.801534 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c610e6a-e8ff-406d-a7db-6fd1c514d0b8 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:38.801824 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c610e6a-e8ff-406d-a7db-6fd1c514d0b8 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:38.802100 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c610e6a-e8ff-406d-a7db-6fd1c514d0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:38.822424 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-0c610e6a-e8ff-406d-a7db-6fd1c514d0b8 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:38.823634 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-0c610e6a-e8ff-406d-a7db-6fd1c514d0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:38.883245 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1372/2742] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 04:16:38.934024 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e745f04-57c3-40e3-96aa-c19661247bbd None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:38.934313 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e745f04-57c3-40e3-96aa-c19661247bbd None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:38.934595 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e745f04-57c3-40e3-96aa-c19661247bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:38.954255 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-3e745f04-57c3-40e3-96aa-c19661247bbd None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:38.955443 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-3e745f04-57c3-40e3-96aa-c19661247bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:38.964689 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1371/2743] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:38.969226 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c610e6a-e8ff-406d-a7db-6fd1c514d0b8 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:38.982471 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c610e6a-e8ff-406d-a7db-6fd1c514d0b8 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:38.987332 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ab72c-aaa2-4fae-b41b-93894a41059a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:38.988017 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ab72c-aaa2-4fae-b41b-93894a41059a admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:38.988309 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ab72c-aaa2-4fae-b41b-93894a41059a admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:38.988596 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ab72c-aaa2-4fae-b41b-93894a41059a admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:38.989317 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ab72c-aaa2-4fae-b41b-93894a41059a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 04:16:38.989621 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ab72c-aaa2-4fae-b41b-93894a41059a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:38.991281 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ab72c-aaa2-4fae-b41b-93894a41059a admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:39.003439 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1373/2744] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 04:16:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 04:16:39.009905 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e745f04-57c3-40e3-96aa-c19661247bbd None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:39.022260 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e745f04-57c3-40e3-96aa-c19661247bbd None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:39.027712 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723d545-54d0-4210-80d9-de2f16b4aa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:39.028363 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723d545-54d0-4210-80d9-de2f16b4aa90 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:39.028643 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723d545-54d0-4210-80d9-de2f16b4aa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:39.028917 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723d545-54d0-4210-80d9-de2f16b4aa90 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:39.029615 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723d545-54d0-4210-80d9-de2f16b4aa90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:39.031517 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723d545-54d0-4210-80d9-de2f16b4aa90 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:39.056581 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1372/2745] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:16:39 2021] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 04:16:39.060888 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ab72c-aaa2-4fae-b41b-93894a41059a admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:39.070895 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ab72c-aaa2-4fae-b41b-93894a41059a admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:39.128969 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093b944-b4df-4b19-8266-9607ebb994d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:39.129626 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093b944-b4df-4b19-8266-9607ebb994d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:39.129906 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093b944-b4df-4b19-8266-9607ebb994d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:39.130178 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093b944-b4df-4b19-8266-9607ebb994d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:39.130878 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093b944-b4df-4b19-8266-9607ebb994d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:39.132972 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093b944-b4df-4b19-8266-9607ebb994d2 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:39.151443 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1374/2746] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:16:39 2021] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:16:39.155551 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723d545-54d0-4210-80d9-de2f16b4aa90 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:39.166542 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723d545-54d0-4210-80d9-de2f16b4aa90 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:39.171271 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3f1f3-aa5f-47ac-8315-1a982b2de6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:39.172017 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3f1f3-aa5f-47ac-8315-1a982b2de6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:39.172308 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3f1f3-aa5f-47ac-8315-1a982b2de6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:39.172587 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3f1f3-aa5f-47ac-8315-1a982b2de6d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:39.173314 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3f1f3-aa5f-47ac-8315-1a982b2de6d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:39.174952 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3f1f3-aa5f-47ac-8315-1a982b2de6d6 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:39.185746 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1373/2747] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:39 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 04:16:39.189815 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093b944-b4df-4b19-8266-9607ebb994d2 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:39.199240 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093b944-b4df-4b19-8266-9607ebb994d2 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:39.203867 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21b11-7029-401a-b8b5-e9698460fb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:39.204555 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21b11-7029-401a-b8b5-e9698460fb81 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:39.204776 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21b11-7029-401a-b8b5-e9698460fb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:39.205053 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21b11-7029-401a-b8b5-e9698460fb81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:39.205774 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad21b11-7029-401a-b8b5-e9698460fb81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:39.207331 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad21b11-7029-401a-b8b5-e9698460fb81 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:39.217271 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1375/2748] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:39 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:16:39.221032 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3f1f3-aa5f-47ac-8315-1a982b2de6d6 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:39.231409 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3f1f3-aa5f-47ac-8315-1a982b2de6d6 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:39.236134 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede4bb8-731b-4146-a127-96ad285455c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:39.236996 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede4bb8-731b-4146-a127-96ad285455c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:39.237278 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede4bb8-731b-4146-a127-96ad285455c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:39.237551 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede4bb8-731b-4146-a127-96ad285455c8 admin admin] PATH_INFO: `/v3/projects/6f53e1adee604d159e9c0a24710c3c88/users/b4aa9be80fdd4fa7bb1f24e9ee8c97e0/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:39.251770 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede4bb8-731b-4146-a127-96ad285455c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f53e1adee604d159e9c0a24710c3c88, user_id=b4aa9be80fdd4fa7bb1f24e9ee8c97e0, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:39.254416 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede4bb8-731b-4146-a127-96ad285455c8 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:39.267320 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1374/2749] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:16:39 2021] PUT /identity/v3/projects/6f53e1adee604d159e9c0a24710c3c88/users/b4aa9be80fdd4fa7bb1f24e9ee8c97e0/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 04:16:39.277602 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaecbd-940d-44df-8b89-0a486a033c50 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:39.277890 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaecbd-940d-44df-8b89-0a486a033c50 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:39.278168 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaecbd-940d-44df-8b89-0a486a033c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:39.303859 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-cbfaecbd-940d-44df-8b89-0a486a033c50 None None] MFA Rules not processed for user `b4aa9be80fdd4fa7bb1f24e9ee8c97e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:39.305057 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-cbfaecbd-940d-44df-8b89-0a486a033c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:39.365361 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1376/2750] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:39 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:39.370334 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede4bb8-731b-4146-a127-96ad285455c8 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:39.427202 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede4bb8-731b-4146-a127-96ad285455c8 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:39.432486 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e4e3b-2ddd-4e9f-b9bf-5c34f89da7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:39.433130 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e4e3b-2ddd-4e9f-b9bf-5c34f89da7a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:39.433412 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e4e3b-2ddd-4e9f-b9bf-5c34f89da7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:39.433688 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e4e3b-2ddd-4e9f-b9bf-5c34f89da7a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:39.434395 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e4e3b-2ddd-4e9f-b9bf-5c34f89da7a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:39.436350 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e4e3b-2ddd-4e9f-b9bf-5c34f89da7a4 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:39.461921 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1375/2751] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:16:39 2021] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:16:39.465868 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaecbd-940d-44df-8b89-0a486a033c50 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:39.476385 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaecbd-940d-44df-8b89-0a486a033c50 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:39.529245 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6547997-8347-448e-8a50-3494a4fd5f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:39.529895 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6547997-8347-448e-8a50-3494a4fd5f29 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:39.530175 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6547997-8347-448e-8a50-3494a4fd5f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:39.530456 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6547997-8347-448e-8a50-3494a4fd5f29 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:39.531140 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6547997-8347-448e-8a50-3494a4fd5f29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:39.533076 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6547997-8347-448e-8a50-3494a4fd5f29 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:39.551590 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1377/2752] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:16:39 2021] POST /identity/v3/users => generated 296 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:16:39.556078 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e4e3b-2ddd-4e9f-b9bf-5c34f89da7a4 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:39.566412 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e4e3b-2ddd-4e9f-b9bf-5c34f89da7a4 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:39.571555 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ce2a2-3854-4daf-bee1-a5f9480fccf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:39.572229 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ce2a2-3854-4daf-bee1-a5f9480fccf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:39.572511 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ce2a2-3854-4daf-bee1-a5f9480fccf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:39.572784 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ce2a2-3854-4daf-bee1-a5f9480fccf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:39.573507 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ce2a2-3854-4daf-bee1-a5f9480fccf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:39.575108 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ce2a2-3854-4daf-bee1-a5f9480fccf4 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:39.585846 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1376/2753] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:39 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:16:39.589688 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6547997-8347-448e-8a50-3494a4fd5f29 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:39.599411 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6547997-8347-448e-8a50-3494a4fd5f29 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:39.604654 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12844ce6-4d18-4467-b75c-9806713bdb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:39.605506 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12844ce6-4d18-4467-b75c-9806713bdb6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:39.605785 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12844ce6-4d18-4467-b75c-9806713bdb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:39.606059 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12844ce6-4d18-4467-b75c-9806713bdb6c admin admin] PATH_INFO: `/v3/projects/f60d75b038f5401cbaa887f99d100ed1/users/4d43bd8249774cab80f3f5afcfca0327/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:39.619991 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12844ce6-4d18-4467-b75c-9806713bdb6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60d75b038f5401cbaa887f99d100ed1, user_id=4d43bd8249774cab80f3f5afcfca0327, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:39.622665 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12844ce6-4d18-4467-b75c-9806713bdb6c admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:39.635270 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1378/2754] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:16:39 2021] PUT /identity/v3/projects/f60d75b038f5401cbaa887f99d100ed1/users/4d43bd8249774cab80f3f5afcfca0327/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:39.638940 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ce2a2-3854-4daf-bee1-a5f9480fccf4 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:39.649256 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ce2a2-3854-4daf-bee1-a5f9480fccf4 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:39.704978 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0621238-6a8b-4abc-9180-3623ea47a02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:39.705634 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0621238-6a8b-4abc-9180-3623ea47a02e admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:39.705920 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0621238-6a8b-4abc-9180-3623ea47a02e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:39.706200 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0621238-6a8b-4abc-9180-3623ea47a02e admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:39.706923 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0621238-6a8b-4abc-9180-3623ea47a02e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:39.708562 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0621238-6a8b-4abc-9180-3623ea47a02e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:39.718611 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1377/2755] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:39 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:16:39.722646 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12844ce6-4d18-4467-b75c-9806713bdb6c admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:39.732592 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12844ce6-4d18-4467-b75c-9806713bdb6c admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:39.737117 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85650f4c-c438-4f6a-b47b-0168a7f35010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:39.737976 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85650f4c-c438-4f6a-b47b-0168a7f35010 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:39.738256 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85650f4c-c438-4f6a-b47b-0168a7f35010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:39.738533 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85650f4c-c438-4f6a-b47b-0168a7f35010 admin admin] PATH_INFO: `/v3/projects/f60d75b038f5401cbaa887f99d100ed1/users/4d43bd8249774cab80f3f5afcfca0327/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:39.740524 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85650f4c-c438-4f6a-b47b-0168a7f35010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60d75b038f5401cbaa887f99d100ed1, user_id=4d43bd8249774cab80f3f5afcfca0327, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:39.743146 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85650f4c-c438-4f6a-b47b-0168a7f35010 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:39.752952 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1379/2756] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:16:39 2021] PUT /identity/v3/projects/f60d75b038f5401cbaa887f99d100ed1/users/4d43bd8249774cab80f3f5afcfca0327/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:39.763450 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5fe41-7070-4e6e-b09f-85b8aa89d445 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:39.763771 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5fe41-7070-4e6e-b09f-85b8aa89d445 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:39.764052 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5fe41-7070-4e6e-b09f-85b8aa89d445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:39.789486 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-f5f5fe41-7070-4e6e-b09f-85b8aa89d445 None None] MFA Rules not processed for user `4d43bd8249774cab80f3f5afcfca0327`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:39.790675 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-f5f5fe41-7070-4e6e-b09f-85b8aa89d445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:39.862156 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1378/2757] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:39 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:39.873721 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85650f4c-c438-4f6a-b47b-0168a7f35010 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:39.875591 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-85650f4c-c438-4f6a-b47b-0168a7f35010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:39.930929 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85650f4c-c438-4f6a-b47b-0168a7f35010 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:39.934524 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afb917-54f6-49de-af49-01864402cc63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:39.935155 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afb917-54f6-49de-af49-01864402cc63 service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:39.935431 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afb917-54f6-49de-af49-01864402cc63 service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:39.935733 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afb917-54f6-49de-af49-01864402cc63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:39.945360 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afb917-54f6-49de-af49-01864402cc63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:39.946793 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afb917-54f6-49de-af49-01864402cc63 service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:39.956215 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1380/2758] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:16:39 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 04:16:40.264996 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5fe41-7070-4e6e-b09f-85b8aa89d445 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:40.274338 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5fe41-7070-4e6e-b09f-85b8aa89d445 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:40.279267 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc3df3-56a2-4192-a5b9-438583c81cef tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d43bd8249774cab80f3f5afcfca0327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f60d75b038f5401cbaa887f99d100ed1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:40.279957 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc3df3-56a2-4192-a5b9-438583c81cef tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:40.280256 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc3df3-56a2-4192-a5b9-438583c81cef tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:40.280527 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc3df3-56a2-4192-a5b9-438583c81cef tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:40.281253 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc3df3-56a2-4192-a5b9-438583c81cef tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 04:16:40.281562 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc3df3-56a2-4192-a5b9-438583c81cef tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:40.283158 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc3df3-56a2-4192-a5b9-438583c81cef tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:40.294492 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1379/2759] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 04:16:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 04:16:40.298415 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afb917-54f6-49de-af49-01864402cc63 service cinder] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:40.308100 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afb917-54f6-49de-af49-01864402cc63 service cinder] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:40.313045 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61532033-3c85-4d63-95e6-976411143a47 tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d43bd8249774cab80f3f5afcfca0327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f60d75b038f5401cbaa887f99d100ed1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:40.313681 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61532033-3c85-4d63-95e6-976411143a47 tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:40.313970 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61532033-3c85-4d63-95e6-976411143a47 tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:40.314250 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61532033-3c85-4d63-95e6-976411143a47 tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:40.314956 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61532033-3c85-4d63-95e6-976411143a47 tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:40.317109 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61532033-3c85-4d63-95e6-976411143a47 tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:40.342769 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1381/2760] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:16:40 2021] POST /identity/v3/projects => generated 354 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:16:40.346717 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc3df3-56a2-4192-a5b9-438583c81cef tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:40.359435 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc3df3-56a2-4192-a5b9-438583c81cef tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:40.413959 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f743fec-51d6-4435-972f-84f125f9f89a tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d43bd8249774cab80f3f5afcfca0327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f60d75b038f5401cbaa887f99d100ed1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:40.414609 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f743fec-51d6-4435-972f-84f125f9f89a tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:40.414895 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f743fec-51d6-4435-972f-84f125f9f89a tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:40.415170 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f743fec-51d6-4435-972f-84f125f9f89a tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:40.415918 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f743fec-51d6-4435-972f-84f125f9f89a tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 04:16:40.416224 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f743fec-51d6-4435-972f-84f125f9f89a tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:40.417815 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f743fec-51d6-4435-972f-84f125f9f89a tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:40.428552 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1380/2761] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 04:16:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 04:16:40.461769 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61532033-3c85-4d63-95e6-976411143a47 tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:40.472523 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61532033-3c85-4d63-95e6-976411143a47 tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:40.478014 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558e1ae-758d-4767-aa10-e1b39896ebf4 tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d43bd8249774cab80f3f5afcfca0327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f60d75b038f5401cbaa887f99d100ed1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:40.478848 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558e1ae-758d-4767-aa10-e1b39896ebf4 tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:40.479137 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558e1ae-758d-4767-aa10-e1b39896ebf4 tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:40.479412 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558e1ae-758d-4767-aa10-e1b39896ebf4 tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] PATH_INFO: `/v3/projects/2da96b3974854743b76e5a498a2cd84c` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:40.480640 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558e1ae-758d-4767-aa10-e1b39896ebf4 tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2da96b3974854743b76e5a498a2cd84c)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:40.482559 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558e1ae-758d-4767-aa10-e1b39896ebf4 tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:40.526898 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f558e1ae-758d-4767-aa10-e1b39896ebf4 tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da96b3974854743b76e5a498a2cd84c', 'request_id': 'req-f558e1ae-758d-4767-aa10-e1b39896ebf4'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:40.533208 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f558e1ae-758d-4767-aa10-e1b39896ebf4 tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da96b3974854743b76e5a498a2cd84c', 'request_id': 'req-f558e1ae-758d-4767-aa10-e1b39896ebf4'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:40.538915 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f558e1ae-758d-4767-aa10-e1b39896ebf4 tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da96b3974854743b76e5a498a2cd84c', 'request_id': 'req-f558e1ae-758d-4767-aa10-e1b39896ebf4'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:40.550163 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f558e1ae-758d-4767-aa10-e1b39896ebf4 tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] The token cache is being invalidate because project 2da96b3974854743b76e5a498a2cd84c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:16:40.550447 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f558e1ae-758d-4767-aa10-e1b39896ebf4 tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:40.551073 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-f558e1ae-758d-4767-aa10-e1b39896ebf4 tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:40.552654 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1382/2762] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:16:40 2021] DELETE /identity/v3/projects/2da96b3974854743b76e5a498a2cd84c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:40.725274 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f743fec-51d6-4435-972f-84f125f9f89a tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:40.727002 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-1f743fec-51d6-4435-972f-84f125f9f89a tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:40.789424 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f743fec-51d6-4435-972f-84f125f9f89a tempest-VolumeQuotaClassesTest-613759495 tempest-VolumeQuotaClassesTest-613759495-project-admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:40.843908 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98764518-6855-4b58-bc3d-a77728e7b1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:40.844760 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98764518-6855-4b58-bc3d-a77728e7b1e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:40.845043 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98764518-6855-4b58-bc3d-a77728e7b1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:40.845317 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98764518-6855-4b58-bc3d-a77728e7b1e7 admin admin] PATH_INFO: `/v3/users/b4aa9be80fdd4fa7bb1f24e9ee8c97e0` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:40.846504 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98764518-6855-4b58-bc3d-a77728e7b1e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4aa9be80fdd4fa7bb1f24e9ee8c97e0)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:40.848486 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98764518-6855-4b58-bc3d-a77728e7b1e7 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:40.892430 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-98764518-6855-4b58-bc3d-a77728e7b1e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4aa9be80fdd4fa7bb1f24e9ee8c97e0'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:40.903442 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-98764518-6855-4b58-bc3d-a77728e7b1e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4aa9be80fdd4fa7bb1f24e9ee8c97e0'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:40.910020 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-98764518-6855-4b58-bc3d-a77728e7b1e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4aa9be80fdd4fa7bb1f24e9ee8c97e0'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:40.910633 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-98764518-6855-4b58-bc3d-a77728e7b1e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4aa9be80fdd4fa7bb1f24e9ee8c97e0'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:40.917401 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-98764518-6855-4b58-bc3d-a77728e7b1e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4aa9be80fdd4fa7bb1f24e9ee8c97e0'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:40.923075 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1381/2763] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:16:40 2021] DELETE /identity/v3/users/b4aa9be80fdd4fa7bb1f24e9ee8c97e0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:40.927629 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ae871-c907-471b-914c-48d7e4776050 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:40.928118 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ae871-c907-471b-914c-48d7e4776050 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:40.928229 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ae871-c907-471b-914c-48d7e4776050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:40.946337 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-626ae871-c907-471b-914c-48d7e4776050 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:40.947527 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-626ae871-c907-471b-914c-48d7e4776050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:41.002490 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1383/2764] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:41.013002 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98764518-6855-4b58-bc3d-a77728e7b1e7 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:41.014395 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-98764518-6855-4b58-bc3d-a77728e7b1e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:41.068954 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98764518-6855-4b58-bc3d-a77728e7b1e7 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:41.072524 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5386c9-d759-4f71-a72e-973b3d2c4abb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:41.073155 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5386c9-d759-4f71-a72e-973b3d2c4abb service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:41.073434 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5386c9-d759-4f71-a72e-973b3d2c4abb service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:41.073705 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5386c9-d759-4f71-a72e-973b3d2c4abb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:41.082353 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5386c9-d759-4f71-a72e-973b3d2c4abb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:41.083788 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5386c9-d759-4f71-a72e-973b3d2c4abb service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:41.093418 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1382/2765] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:16:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:16:41.364237 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ae871-c907-471b-914c-48d7e4776050 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:41.365665 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-626ae871-c907-471b-914c-48d7e4776050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:41.377389 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ae871-c907-471b-914c-48d7e4776050 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:41.382524 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b262e7-ac5d-4f8a-87e4-751f02e95bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:41.383376 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b262e7-ac5d-4f8a-87e4-751f02e95bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:41.383661 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b262e7-ac5d-4f8a-87e4-751f02e95bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:41.383981 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b262e7-ac5d-4f8a-87e4-751f02e95bf1 admin admin] PATH_INFO: `/v3/projects/6f53e1adee604d159e9c0a24710c3c88` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:41.385181 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b262e7-ac5d-4f8a-87e4-751f02e95bf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f53e1adee604d159e9c0a24710c3c88)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:41.387091 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b262e7-ac5d-4f8a-87e4-751f02e95bf1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:41.447579 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-45b262e7-ac5d-4f8a-87e4-751f02e95bf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f53e1adee604d159e9c0a24710c3c88', 'request_id': 'req-45b262e7-ac5d-4f8a-87e4-751f02e95bf1'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:41.454055 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-45b262e7-ac5d-4f8a-87e4-751f02e95bf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f53e1adee604d159e9c0a24710c3c88', 'request_id': 'req-45b262e7-ac5d-4f8a-87e4-751f02e95bf1'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:41.459922 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-45b262e7-ac5d-4f8a-87e4-751f02e95bf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f53e1adee604d159e9c0a24710c3c88', 'request_id': 'req-45b262e7-ac5d-4f8a-87e4-751f02e95bf1'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:41.473507 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-45b262e7-ac5d-4f8a-87e4-751f02e95bf1 admin admin] The token cache is being invalidate because project 6f53e1adee604d159e9c0a24710c3c88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:16:41.473831 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-45b262e7-ac5d-4f8a-87e4-751f02e95bf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:41.474451 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-45b262e7-ac5d-4f8a-87e4-751f02e95bf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:41.476496 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1384/2766] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:16:41 2021] DELETE /identity/v3/projects/6f53e1adee604d159e9c0a24710c3c88 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:41.480276 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5386c9-d759-4f71-a72e-973b3d2c4abb service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:41.490030 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5386c9-d759-4f71-a72e-973b3d2c4abb service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:41.543642 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e64bd4-92b0-4fae-88c5-e41dbc6e21b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:41.544522 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e64bd4-92b0-4fae-88c5-e41dbc6e21b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:41.544803 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e64bd4-92b0-4fae-88c5-e41dbc6e21b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:41.545074 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e64bd4-92b0-4fae-88c5-e41dbc6e21b8 admin admin] PATH_INFO: `/v3/users/4d43bd8249774cab80f3f5afcfca0327` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:41.546246 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e64bd4-92b0-4fae-88c5-e41dbc6e21b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d43bd8249774cab80f3f5afcfca0327)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:41.548179 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e64bd4-92b0-4fae-88c5-e41dbc6e21b8 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:41.593434 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-26e64bd4-92b0-4fae-88c5-e41dbc6e21b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d43bd8249774cab80f3f5afcfca0327'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:41.604896 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-26e64bd4-92b0-4fae-88c5-e41dbc6e21b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d43bd8249774cab80f3f5afcfca0327'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:41.612013 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-26e64bd4-92b0-4fae-88c5-e41dbc6e21b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d43bd8249774cab80f3f5afcfca0327'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:41.612606 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-26e64bd4-92b0-4fae-88c5-e41dbc6e21b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d43bd8249774cab80f3f5afcfca0327'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:41.620028 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-26e64bd4-92b0-4fae-88c5-e41dbc6e21b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d43bd8249774cab80f3f5afcfca0327'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:41.625852 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1383/2767] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:16:41 2021] DELETE /identity/v3/users/4d43bd8249774cab80f3f5afcfca0327 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:41.880194 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b262e7-ac5d-4f8a-87e4-751f02e95bf1 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:41.881614 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-45b262e7-ac5d-4f8a-87e4-751f02e95bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:41.894658 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b262e7-ac5d-4f8a-87e4-751f02e95bf1 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:41.949464 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319fb77-4f20-4ba9-8f28-9bc9a3f4138e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:41.950310 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319fb77-4f20-4ba9-8f28-9bc9a3f4138e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:41.950589 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319fb77-4f20-4ba9-8f28-9bc9a3f4138e admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:41.950860 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319fb77-4f20-4ba9-8f28-9bc9a3f4138e admin admin] PATH_INFO: `/v3/projects/f60d75b038f5401cbaa887f99d100ed1` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:41.952067 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319fb77-4f20-4ba9-8f28-9bc9a3f4138e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f60d75b038f5401cbaa887f99d100ed1)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:41.953968 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319fb77-4f20-4ba9-8f28-9bc9a3f4138e admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:41.997956 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d319fb77-4f20-4ba9-8f28-9bc9a3f4138e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60d75b038f5401cbaa887f99d100ed1', 'request_id': 'req-d319fb77-4f20-4ba9-8f28-9bc9a3f4138e'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:42.003783 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d319fb77-4f20-4ba9-8f28-9bc9a3f4138e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60d75b038f5401cbaa887f99d100ed1', 'request_id': 'req-d319fb77-4f20-4ba9-8f28-9bc9a3f4138e'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:42.009467 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d319fb77-4f20-4ba9-8f28-9bc9a3f4138e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60d75b038f5401cbaa887f99d100ed1', 'request_id': 'req-d319fb77-4f20-4ba9-8f28-9bc9a3f4138e'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:42.021065 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d319fb77-4f20-4ba9-8f28-9bc9a3f4138e admin admin] The token cache is being invalidate because project f60d75b038f5401cbaa887f99d100ed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:16:42.021357 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d319fb77-4f20-4ba9-8f28-9bc9a3f4138e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:42.021960 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-d319fb77-4f20-4ba9-8f28-9bc9a3f4138e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:42.024256 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1385/2768] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:16:41 2021] DELETE /identity/v3/projects/f60d75b038f5401cbaa887f99d100ed1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:42.029869 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851284d-9778-4804-b79a-d30c7d1dd5d5 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:42.030163 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851284d-9778-4804-b79a-d30c7d1dd5d5 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:42.030467 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851284d-9778-4804-b79a-d30c7d1dd5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:42.048497 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-b851284d-9778-4804-b79a-d30c7d1dd5d5 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:42.049702 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-b851284d-9778-4804-b79a-d30c7d1dd5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:42.105938 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1384/2769] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:42.113726 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03e3a7-db1c-4553-8629-f34c49bdf60e None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:42.114015 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03e3a7-db1c-4553-8629-f34c49bdf60e None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:42.114320 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03e3a7-db1c-4553-8629-f34c49bdf60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:42.132706 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-fd03e3a7-db1c-4553-8629-f34c49bdf60e None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:42.133829 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-fd03e3a7-db1c-4553-8629-f34c49bdf60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:42.141513 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1386/2770] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:42.145468 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851284d-9778-4804-b79a-d30c7d1dd5d5 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:42.154780 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851284d-9778-4804-b79a-d30c7d1dd5d5 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:42.159417 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb006e6-7d87-4883-a440-ce9fb39448de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:42.160092 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb006e6-7d87-4883-a440-ce9fb39448de admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:42.160378 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb006e6-7d87-4883-a440-ce9fb39448de admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:42.160684 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb006e6-7d87-4883-a440-ce9fb39448de admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:42.161412 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb006e6-7d87-4883-a440-ce9fb39448de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 04:16:42.161722 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb006e6-7d87-4883-a440-ce9fb39448de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:42.164139 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb006e6-7d87-4883-a440-ce9fb39448de admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:42.175612 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1385/2771] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 04:16:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 15 04:16:42.180198 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03e3a7-db1c-4553-8629-f34c49bdf60e None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:42.189370 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03e3a7-db1c-4553-8629-f34c49bdf60e None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:42.193980 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2df72-84f0-4c6f-936c-ca31fa3438a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:42.194685 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2df72-84f0-4c6f-936c-ca31fa3438a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:42.194968 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2df72-84f0-4c6f-936c-ca31fa3438a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:42.195241 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2df72-84f0-4c6f-936c-ca31fa3438a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:42.195975 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2df72-84f0-4c6f-936c-ca31fa3438a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:42.197894 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2df72-84f0-4c6f-936c-ca31fa3438a7 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:42.223226 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1387/2772] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:16:42 2021] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 04:16:42.227794 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb006e6-7d87-4883-a440-ce9fb39448de admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:42.237744 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb006e6-7d87-4883-a440-ce9fb39448de admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:42.291592 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d53915-808a-4f05-b8d1-f2ce50af7bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:42.292273 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d53915-808a-4f05-b8d1-f2ce50af7bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:42.292554 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d53915-808a-4f05-b8d1-f2ce50af7bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:42.292826 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d53915-808a-4f05-b8d1-f2ce50af7bf7 admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:42.293557 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d53915-808a-4f05-b8d1-f2ce50af7bf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:42.295456 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d53915-808a-4f05-b8d1-f2ce50af7bf7 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:42.314508 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1386/2773] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:16:42 2021] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:16:42.318560 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2df72-84f0-4c6f-936c-ca31fa3438a7 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:42.328551 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2df72-84f0-4c6f-936c-ca31fa3438a7 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:42.333154 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff485d0-b819-44b4-9426-326a4956a8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:42.333794 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff485d0-b819-44b4-9426-326a4956a8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:42.334077 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff485d0-b819-44b4-9426-326a4956a8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:42.334352 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff485d0-b819-44b4-9426-326a4956a8c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:42.335592 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff485d0-b819-44b4-9426-326a4956a8c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:42.337199 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff485d0-b819-44b4-9426-326a4956a8c7 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:42.347131 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1388/2774] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:42 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:16:42.351281 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d53915-808a-4f05-b8d1-f2ce50af7bf7 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:42.360960 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d53915-808a-4f05-b8d1-f2ce50af7bf7 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:42.365576 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea88e9-74b2-4c5f-b79a-449b6b16660d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:42.366205 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea88e9-74b2-4c5f-b79a-449b6b16660d admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:42.366491 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea88e9-74b2-4c5f-b79a-449b6b16660d admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:42.366767 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea88e9-74b2-4c5f-b79a-449b6b16660d admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:42.367487 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea88e9-74b2-4c5f-b79a-449b6b16660d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:42.369407 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea88e9-74b2-4c5f-b79a-449b6b16660d admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:42.378993 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1387/2775] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:42 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:16:42.382966 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff485d0-b819-44b4-9426-326a4956a8c7 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:42.392444 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff485d0-b819-44b4-9426-326a4956a8c7 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:42.397239 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4fede-a060-4d34-b5aa-140004e372f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:42.398655 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4fede-a060-4d34-b5aa-140004e372f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:42.398935 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4fede-a060-4d34-b5aa-140004e372f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:42.399208 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4fede-a060-4d34-b5aa-140004e372f6 admin admin] PATH_INFO: `/v3/projects/ffbed5828cb94ad48cb443b6dee62659/users/72e740365dd443c98f701b1b97f13808/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:42.413162 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4fede-a060-4d34-b5aa-140004e372f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffbed5828cb94ad48cb443b6dee62659, user_id=72e740365dd443c98f701b1b97f13808, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:42.417288 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4fede-a060-4d34-b5aa-140004e372f6 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:42.432403 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1389/2776] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:16:42 2021] PUT /identity/v3/projects/ffbed5828cb94ad48cb443b6dee62659/users/72e740365dd443c98f701b1b97f13808/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:42.442835 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de81f1-18b7-498b-b315-a90bf37e2f40 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:42.443134 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de81f1-18b7-498b-b315-a90bf37e2f40 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:42.443414 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de81f1-18b7-498b-b315-a90bf37e2f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:42.469480 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-34de81f1-18b7-498b-b315-a90bf37e2f40 None None] MFA Rules not processed for user `72e740365dd443c98f701b1b97f13808`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:42.470740 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-34de81f1-18b7-498b-b315-a90bf37e2f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:42.533519 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1388/2777] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:42 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:42.537560 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4fede-a060-4d34-b5aa-140004e372f6 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:42.577606 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de81f1-18b7-498b-b315-a90bf37e2f40 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:42.579208 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-34de81f1-18b7-498b-b315-a90bf37e2f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:42.598319 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4fede-a060-4d34-b5aa-140004e372f6 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:42.603590 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763ce4e-6081-4fca-bfad-911c3809ffe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:42.604261 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763ce4e-6081-4fca-bfad-911c3809ffe8 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:42.604544 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763ce4e-6081-4fca-bfad-911c3809ffe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:42.604819 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763ce4e-6081-4fca-bfad-911c3809ffe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:42.605527 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763ce4e-6081-4fca-bfad-911c3809ffe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:42.607412 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763ce4e-6081-4fca-bfad-911c3809ffe8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:42.632540 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1390/2778] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:16:42 2021] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:16:42.636373 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763ce4e-6081-4fca-bfad-911c3809ffe8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:42.642484 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de81f1-18b7-498b-b315-a90bf37e2f40 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:42.698780 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020b013-5ee6-4036-87b2-8d8690a8e17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:42.699639 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020b013-5ee6-4036-87b2-8d8690a8e17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:42.699963 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020b013-5ee6-4036-87b2-8d8690a8e17c admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:42.700210 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020b013-5ee6-4036-87b2-8d8690a8e17c admin admin] PATH_INFO: `/v3/users/d431d5ff969f41748d41ec7b75f3bdfb` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:42.701400 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020b013-5ee6-4036-87b2-8d8690a8e17c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d431d5ff969f41748d41ec7b75f3bdfb)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:42.703308 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020b013-5ee6-4036-87b2-8d8690a8e17c admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:42.703960 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763ce4e-6081-4fca-bfad-911c3809ffe8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:42.708845 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343182c5-51fa-454a-8bc2-e3f707c7cb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:42.709492 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343182c5-51fa-454a-8bc2-e3f707c7cb22 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:42.709769 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343182c5-51fa-454a-8bc2-e3f707c7cb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:42.710081 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343182c5-51fa-454a-8bc2-e3f707c7cb22 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:42.710784 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343182c5-51fa-454a-8bc2-e3f707c7cb22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:42.712695 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343182c5-51fa-454a-8bc2-e3f707c7cb22 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:42.733123 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1391/2779] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:16:42 2021] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 04:16:42.737042 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343182c5-51fa-454a-8bc2-e3f707c7cb22 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:42.746989 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343182c5-51fa-454a-8bc2-e3f707c7cb22 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:42.747621 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-9020b013-5ee6-4036-87b2-8d8690a8e17c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd431d5ff969f41748d41ec7b75f3bdfb'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:42.751666 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2448ec-e494-4038-877d-0afd0c21a7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:42.752326 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2448ec-e494-4038-877d-0afd0c21a7af admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:42.752607 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2448ec-e494-4038-877d-0afd0c21a7af admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:42.752883 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2448ec-e494-4038-877d-0afd0c21a7af admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:42.753610 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2448ec-e494-4038-877d-0afd0c21a7af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:42.755174 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2448ec-e494-4038-877d-0afd0c21a7af admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:42.759553 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-9020b013-5ee6-4036-87b2-8d8690a8e17c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd431d5ff969f41748d41ec7b75f3bdfb'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:42.766335 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1392/2780] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:42 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 04:16:42.767435 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-9020b013-5ee6-4036-87b2-8d8690a8e17c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd431d5ff969f41748d41ec7b75f3bdfb'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:42.768187 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-9020b013-5ee6-4036-87b2-8d8690a8e17c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd431d5ff969f41748d41ec7b75f3bdfb'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:42.770291 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2448ec-e494-4038-877d-0afd0c21a7af admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:42.771936 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-8a2448ec-e494-4038-877d-0afd0c21a7af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:42.775568 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-9020b013-5ee6-4036-87b2-8d8690a8e17c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd431d5ff969f41748d41ec7b75f3bdfb'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:42.781357 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1389/2781] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:16:42 2021] DELETE /identity/v3/users/d431d5ff969f41748d41ec7b75f3bdfb => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 04:16:42.784276 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2448ec-e494-4038-877d-0afd0c21a7af admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:42.785498 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70abc2-dedb-4fca-801f-3332dbc65acc None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:42.785791 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70abc2-dedb-4fca-801f-3332dbc65acc None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:42.786070 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70abc2-dedb-4fca-801f-3332dbc65acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:42.803383 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-ac70abc2-dedb-4fca-801f-3332dbc65acc None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:42.805166 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-ac70abc2-dedb-4fca-801f-3332dbc65acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:42.837494 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebf320-b466-44f8-bd34-ca8e080923ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:42.838367 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebf320-b466-44f8-bd34-ca8e080923ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:42.838651 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebf320-b466-44f8-bd34-ca8e080923ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:42.838928 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebf320-b466-44f8-bd34-ca8e080923ce admin admin] PATH_INFO: `/v3/projects/48793a1dc45d47dca01379688743a4f6/users/6c2d93ef74864245b692c710a17ef402/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:42.853101 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eebf320-b466-44f8-bd34-ca8e080923ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=48793a1dc45d47dca01379688743a4f6, user_id=6c2d93ef74864245b692c710a17ef402, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:42.855786 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eebf320-b466-44f8-bd34-ca8e080923ce admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:42.860931 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1390/2782] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:42.870476 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1393/2783] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:16:42 2021] PUT /identity/v3/projects/48793a1dc45d47dca01379688743a4f6/users/6c2d93ef74864245b692c710a17ef402/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 04:16:42.871628 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70abc2-dedb-4fca-801f-3332dbc65acc None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:42.873016 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-ac70abc2-dedb-4fca-801f-3332dbc65acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:42.874338 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebf320-b466-44f8-bd34-ca8e080923ce admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:42.927177 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70abc2-dedb-4fca-801f-3332dbc65acc None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:42.932924 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebf320-b466-44f8-bd34-ca8e080923ce admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:42.937919 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06ac2c-8f00-4cfd-b24b-aa66ae5421d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:42.938572 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06ac2c-8f00-4cfd-b24b-aa66ae5421d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:42.938856 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06ac2c-8f00-4cfd-b24b-aa66ae5421d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:42.939132 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06ac2c-8f00-4cfd-b24b-aa66ae5421d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:42.939900 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06ac2c-8f00-4cfd-b24b-aa66ae5421d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:42.941493 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06ac2c-8f00-4cfd-b24b-aa66ae5421d8 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:42.951702 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1394/2784] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:42 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 04:16:42.955666 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06ac2c-8f00-4cfd-b24b-aa66ae5421d8 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:42.965460 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06ac2c-8f00-4cfd-b24b-aa66ae5421d8 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:42.970908 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6949f5-035e-4b4c-b6f4-b27b48db96dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:42.971874 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6949f5-035e-4b4c-b6f4-b27b48db96dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:42.972102 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6949f5-035e-4b4c-b6f4-b27b48db96dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:42.972422 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6949f5-035e-4b4c-b6f4-b27b48db96dc admin admin] PATH_INFO: `/v3/projects/48793a1dc45d47dca01379688743a4f6/users/6c2d93ef74864245b692c710a17ef402/roles/15ba70b0cba04962a6d0b80b50c07004` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:42.975053 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6949f5-035e-4b4c-b6f4-b27b48db96dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=48793a1dc45d47dca01379688743a4f6, user_id=6c2d93ef74864245b692c710a17ef402, role_id=15ba70b0cba04962a6d0b80b50c07004)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:42.976614 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d0485-add7-41d4-9cca-2425ca85eb97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:42.977255 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d0485-add7-41d4-9cca-2425ca85eb97 service neutron] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:42.977536 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d0485-add7-41d4-9cca-2425ca85eb97 service neutron] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:42.977812 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d0485-add7-41d4-9cca-2425ca85eb97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:42.978422 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6949f5-035e-4b4c-b6f4-b27b48db96dc admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:42.986818 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d0485-add7-41d4-9cca-2425ca85eb97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:42.988282 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d0485-add7-41d4-9cca-2425ca85eb97 service neutron] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:42.988614 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1395/2785] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:16:42 2021] PUT /identity/v3/projects/48793a1dc45d47dca01379688743a4f6/users/6c2d93ef74864245b692c710a17ef402/roles/15ba70b0cba04962a6d0b80b50c07004 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 04:16:42.999319 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed25a5-498b-4548-add4-d713f6d59c60 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:42.999610 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed25a5-498b-4548-add4-d713f6d59c60 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:42.999969 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed25a5-498b-4548-add4-d713f6d59c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:43.000825 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1391/2786] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:16:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:16:43.026934 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-faed25a5-498b-4548-add4-d713f6d59c60 None None] MFA Rules not processed for user `6c2d93ef74864245b692c710a17ef402`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:43.028183 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-faed25a5-498b-4548-add4-d713f6d59c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:43.097539 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1396/2787] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:42 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 04:16:43.107829 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d0485-add7-41d4-9cca-2425ca85eb97 service neutron] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:43.109252 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-381d0485-add7-41d4-9cca-2425ca85eb97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:43.168746 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d0485-add7-41d4-9cca-2425ca85eb97 service neutron] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:43.215550 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6a147-fb36-4aec-bd49-1f99129aab07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:43.216229 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6a147-fb36-4aec-bd49-1f99129aab07 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:43.216510 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6a147-fb36-4aec-bd49-1f99129aab07 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:43.216779 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6a147-fb36-4aec-bd49-1f99129aab07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:43.218543 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-6dc6a147-fb36-4aec-bd49-1f99129aab07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:43.263714 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed25a5-498b-4548-add4-d713f6d59c60 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:43.265135 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-faed25a5-498b-4548-add4-d713f6d59c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:43.280634 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6a147-fb36-4aec-bd49-1f99129aab07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:43.282139 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6a147-fb36-4aec-bd49-1f99129aab07 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:43.292374 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1392/2788] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:16:43 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:16:43.341098 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed25a5-498b-4548-add4-d713f6d59c60 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:43.345645 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe757f-014a-450c-9df1-d1a04a0dcc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:43.346481 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe757f-014a-450c-9df1-d1a04a0dcc89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:43.346763 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe757f-014a-450c-9df1-d1a04a0dcc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:43.347034 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe757f-014a-450c-9df1-d1a04a0dcc89 admin admin] PATH_INFO: `/v3/projects/bc3b7829ba2e4e36b8afcea55b8f4a8a` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:43.348244 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe757f-014a-450c-9df1-d1a04a0dcc89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc3b7829ba2e4e36b8afcea55b8f4a8a)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:43.350142 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe757f-014a-450c-9df1-d1a04a0dcc89 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:43.396066 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-13fe757f-014a-450c-9df1-d1a04a0dcc89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc3b7829ba2e4e36b8afcea55b8f4a8a', 'request_id': 'req-13fe757f-014a-450c-9df1-d1a04a0dcc89'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:43.402315 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-13fe757f-014a-450c-9df1-d1a04a0dcc89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc3b7829ba2e4e36b8afcea55b8f4a8a', 'request_id': 'req-13fe757f-014a-450c-9df1-d1a04a0dcc89'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:43.407778 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-13fe757f-014a-450c-9df1-d1a04a0dcc89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc3b7829ba2e4e36b8afcea55b8f4a8a', 'request_id': 'req-13fe757f-014a-450c-9df1-d1a04a0dcc89'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:43.419948 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-13fe757f-014a-450c-9df1-d1a04a0dcc89 admin admin] The token cache is being invalidate because project bc3b7829ba2e4e36b8afcea55b8f4a8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:16:43.420237 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-13fe757f-014a-450c-9df1-d1a04a0dcc89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:43.420859 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-13fe757f-014a-450c-9df1-d1a04a0dcc89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:43.422375 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1397/2789] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:16:43 2021] DELETE /identity/v3/projects/bc3b7829ba2e4e36b8afcea55b8f4a8a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 04:16:43.426869 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6a147-fb36-4aec-bd49-1f99129aab07 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:43.439035 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6a147-fb36-4aec-bd49-1f99129aab07 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:43.498040 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2140d72-00ed-4dce-ad72-7b15374ef524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:43.498983 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2140d72-00ed-4dce-ad72-7b15374ef524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:43.499259 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2140d72-00ed-4dce-ad72-7b15374ef524 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:43.499528 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2140d72-00ed-4dce-ad72-7b15374ef524 admin admin] PATH_INFO: `/v3/users/71dd1d09d8ff4fdab9b92a03ed99f5a9` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:43.501145 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2140d72-00ed-4dce-ad72-7b15374ef524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71dd1d09d8ff4fdab9b92a03ed99f5a9)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:43.503060 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2140d72-00ed-4dce-ad72-7b15374ef524 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:43.552421 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-e2140d72-00ed-4dce-ad72-7b15374ef524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71dd1d09d8ff4fdab9b92a03ed99f5a9'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:43.572168 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-e2140d72-00ed-4dce-ad72-7b15374ef524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71dd1d09d8ff4fdab9b92a03ed99f5a9'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:43.580324 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-e2140d72-00ed-4dce-ad72-7b15374ef524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71dd1d09d8ff4fdab9b92a03ed99f5a9'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:43.580997 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-e2140d72-00ed-4dce-ad72-7b15374ef524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71dd1d09d8ff4fdab9b92a03ed99f5a9'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:43.588132 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-e2140d72-00ed-4dce-ad72-7b15374ef524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71dd1d09d8ff4fdab9b92a03ed99f5a9'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:43.594513 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1393/2790] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:16:43 2021] DELETE /identity/v3/users/71dd1d09d8ff4fdab9b92a03ed99f5a9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:43.860738 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe757f-014a-450c-9df1-d1a04a0dcc89 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:43.862179 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-13fe757f-014a-450c-9df1-d1a04a0dcc89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:43.876119 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe757f-014a-450c-9df1-d1a04a0dcc89 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:43.930519 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c8955-9e82-4b62-ba8a-8aeee43f3829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:43.931369 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c8955-9e82-4b62-ba8a-8aeee43f3829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:43.931656 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c8955-9e82-4b62-ba8a-8aeee43f3829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:43.931963 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c8955-9e82-4b62-ba8a-8aeee43f3829 admin admin] PATH_INFO: `/v3/projects/de1bbe7b627145429f311ec8e31200d0` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:43.933148 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c8955-9e82-4b62-ba8a-8aeee43f3829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de1bbe7b627145429f311ec8e31200d0)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:43.935038 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c8955-9e82-4b62-ba8a-8aeee43f3829 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:43.980536 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-de4c8955-9e82-4b62-ba8a-8aeee43f3829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de1bbe7b627145429f311ec8e31200d0', 'request_id': 'req-de4c8955-9e82-4b62-ba8a-8aeee43f3829'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:43.986241 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-de4c8955-9e82-4b62-ba8a-8aeee43f3829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de1bbe7b627145429f311ec8e31200d0', 'request_id': 'req-de4c8955-9e82-4b62-ba8a-8aeee43f3829'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:43.991582 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-de4c8955-9e82-4b62-ba8a-8aeee43f3829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de1bbe7b627145429f311ec8e31200d0', 'request_id': 'req-de4c8955-9e82-4b62-ba8a-8aeee43f3829'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:44.003433 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-de4c8955-9e82-4b62-ba8a-8aeee43f3829 admin admin] The token cache is being invalidate because project de1bbe7b627145429f311ec8e31200d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:16:44.003743 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-de4c8955-9e82-4b62-ba8a-8aeee43f3829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:44.004368 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-de4c8955-9e82-4b62-ba8a-8aeee43f3829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:44.005876 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1398/2791] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:16:43 2021] DELETE /identity/v3/projects/de1bbe7b627145429f311ec8e31200d0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:44.009844 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2140d72-00ed-4dce-ad72-7b15374ef524 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:44.011208 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-e2140d72-00ed-4dce-ad72-7b15374ef524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:44.023875 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2140d72-00ed-4dce-ad72-7b15374ef524 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:44.076889 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198771c-8784-4845-ad85-78a7e36fba3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:44.077742 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198771c-8784-4845-ad85-78a7e36fba3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:44.078026 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198771c-8784-4845-ad85-78a7e36fba3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:44.078323 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198771c-8784-4845-ad85-78a7e36fba3a admin admin] PATH_INFO: `/v3/users/c7e0d5f692124a4ba9df19a652ec8195` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:44.079544 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198771c-8784-4845-ad85-78a7e36fba3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7e0d5f692124a4ba9df19a652ec8195)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:44.081502 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198771c-8784-4845-ad85-78a7e36fba3a admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:44.124454 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7198771c-8784-4845-ad85-78a7e36fba3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7e0d5f692124a4ba9df19a652ec8195'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:44.136130 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7198771c-8784-4845-ad85-78a7e36fba3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7e0d5f692124a4ba9df19a652ec8195'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:44.143033 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7198771c-8784-4845-ad85-78a7e36fba3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7e0d5f692124a4ba9df19a652ec8195'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:44.143654 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7198771c-8784-4845-ad85-78a7e36fba3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7e0d5f692124a4ba9df19a652ec8195'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:44.150723 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-7198771c-8784-4845-ad85-78a7e36fba3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7e0d5f692124a4ba9df19a652ec8195'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:44.156325 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1394/2792] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:16:44 2021] DELETE /identity/v3/users/c7e0d5f692124a4ba9df19a652ec8195 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:44.410529 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c8955-9e82-4b62-ba8a-8aeee43f3829 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:44.412100 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-de4c8955-9e82-4b62-ba8a-8aeee43f3829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:44.425081 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c8955-9e82-4b62-ba8a-8aeee43f3829 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:44.483399 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59519cfb-74bb-4c79-aeae-04f55e6ff558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:44.484282 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59519cfb-74bb-4c79-aeae-04f55e6ff558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:44.484564 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59519cfb-74bb-4c79-aeae-04f55e6ff558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:44.484833 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59519cfb-74bb-4c79-aeae-04f55e6ff558 admin admin] PATH_INFO: `/v3/projects/e05df4016b6b434ebcd09195bf455faa` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:44.486005 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59519cfb-74bb-4c79-aeae-04f55e6ff558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e05df4016b6b434ebcd09195bf455faa)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:44.488339 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59519cfb-74bb-4c79-aeae-04f55e6ff558 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:44.532652 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-59519cfb-74bb-4c79-aeae-04f55e6ff558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e05df4016b6b434ebcd09195bf455faa', 'request_id': 'req-59519cfb-74bb-4c79-aeae-04f55e6ff558'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:44.539036 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-59519cfb-74bb-4c79-aeae-04f55e6ff558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e05df4016b6b434ebcd09195bf455faa', 'request_id': 'req-59519cfb-74bb-4c79-aeae-04f55e6ff558'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:44.544111 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-59519cfb-74bb-4c79-aeae-04f55e6ff558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e05df4016b6b434ebcd09195bf455faa', 'request_id': 'req-59519cfb-74bb-4c79-aeae-04f55e6ff558'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:44.555775 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-59519cfb-74bb-4c79-aeae-04f55e6ff558 admin admin] The token cache is being invalidate because project e05df4016b6b434ebcd09195bf455faa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:16:44.556062 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-59519cfb-74bb-4c79-aeae-04f55e6ff558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:44.556712 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-59519cfb-74bb-4c79-aeae-04f55e6ff558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:44.558218 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1399/2793] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:16:44 2021] DELETE /identity/v3/projects/e05df4016b6b434ebcd09195bf455faa => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:44.564203 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225617d-87fe-4124-bdd6-4e05048b76c9 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:44.564664 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225617d-87fe-4124-bdd6-4e05048b76c9 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:44.564756 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225617d-87fe-4124-bdd6-4e05048b76c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:44.582918 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-5225617d-87fe-4124-bdd6-4e05048b76c9 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:44.584151 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-5225617d-87fe-4124-bdd6-4e05048b76c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:44.643002 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1395/2794] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:44.650924 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f26bd3-571e-498b-8f7d-f2879731ae11 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:44.651232 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f26bd3-571e-498b-8f7d-f2879731ae11 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:44.651475 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f26bd3-571e-498b-8f7d-f2879731ae11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:44.670671 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-a9f26bd3-571e-498b-8f7d-f2879731ae11 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:44.671906 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-a9f26bd3-571e-498b-8f7d-f2879731ae11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:44.680578 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1400/2795] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:44.684772 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225617d-87fe-4124-bdd6-4e05048b76c9 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:44.695937 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225617d-87fe-4124-bdd6-4e05048b76c9 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:44.700814 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90a3a4-e0ce-4220-8a5d-6cbdff793d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:44.701493 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90a3a4-e0ce-4220-8a5d-6cbdff793d77 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:44.701765 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90a3a4-e0ce-4220-8a5d-6cbdff793d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:44.702044 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90a3a4-e0ce-4220-8a5d-6cbdff793d77 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:44.702781 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90a3a4-e0ce-4220-8a5d-6cbdff793d77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 04:16:44.703074 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90a3a4-e0ce-4220-8a5d-6cbdff793d77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:44.704892 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90a3a4-e0ce-4220-8a5d-6cbdff793d77 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:44.716571 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1396/2796] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 04:16:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 04:16:44.721089 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f26bd3-571e-498b-8f7d-f2879731ae11 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:44.730698 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f26bd3-571e-498b-8f7d-f2879731ae11 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:44.735646 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21e76d-9f3c-416b-ae30-28b88be93aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:44.736369 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21e76d-9f3c-416b-ae30-28b88be93aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:44.736660 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21e76d-9f3c-416b-ae30-28b88be93aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:44.736925 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21e76d-9f3c-416b-ae30-28b88be93aa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:44.737662 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21e76d-9f3c-416b-ae30-28b88be93aa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:44.739594 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21e76d-9f3c-416b-ae30-28b88be93aa5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:44.766032 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1401/2797] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:16:44 2021] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:16:44.770204 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90a3a4-e0ce-4220-8a5d-6cbdff793d77 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:44.780227 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90a3a4-e0ce-4220-8a5d-6cbdff793d77 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:44.833790 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22f309-572c-40ba-8b4c-1e1c98b48fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:44.834370 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22f309-572c-40ba-8b4c-1e1c98b48fef admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:44.834660 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22f309-572c-40ba-8b4c-1e1c98b48fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:44.834947 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22f309-572c-40ba-8b4c-1e1c98b48fef admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:44.836177 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22f309-572c-40ba-8b4c-1e1c98b48fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:44.838093 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22f309-572c-40ba-8b4c-1e1c98b48fef admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:44.858565 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1397/2798] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:16:44 2021] POST /identity/v3/users => generated 286 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:16:44.861330 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21e76d-9f3c-416b-ae30-28b88be93aa5 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:44.872082 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21e76d-9f3c-416b-ae30-28b88be93aa5 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:44.876769 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3e3e5-a1d0-4bdd-9e8e-124eedc78cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:44.877438 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3e3e5-a1d0-4bdd-9e8e-124eedc78cff admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:44.877739 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3e3e5-a1d0-4bdd-9e8e-124eedc78cff admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:44.878026 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3e3e5-a1d0-4bdd-9e8e-124eedc78cff admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:44.878808 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3e3e5-a1d0-4bdd-9e8e-124eedc78cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:44.880431 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3e3e5-a1d0-4bdd-9e8e-124eedc78cff admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:44.892218 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1402/2799] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:44 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:16:44.896010 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22f309-572c-40ba-8b4c-1e1c98b48fef admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:44.906867 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22f309-572c-40ba-8b4c-1e1c98b48fef admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:44.912101 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d2999-3886-4b83-8092-cc57fdbde861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:44.912785 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d2999-3886-4b83-8092-cc57fdbde861 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:44.913072 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d2999-3886-4b83-8092-cc57fdbde861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:44.913342 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d2999-3886-4b83-8092-cc57fdbde861 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:44.914068 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d2999-3886-4b83-8092-cc57fdbde861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:44.915667 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d2999-3886-4b83-8092-cc57fdbde861 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:44.925461 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1398/2800] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:44 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:16:44.929520 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3e3e5-a1d0-4bdd-9e8e-124eedc78cff admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:44.939642 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3e3e5-a1d0-4bdd-9e8e-124eedc78cff admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:44.944832 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ceeed8-9cd9-4ea9-8ca6-b706c363fce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:44.945686 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ceeed8-9cd9-4ea9-8ca6-b706c363fce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:44.945969 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ceeed8-9cd9-4ea9-8ca6-b706c363fce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:44.946247 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ceeed8-9cd9-4ea9-8ca6-b706c363fce1 admin admin] PATH_INFO: `/v3/projects/989f5cd4f7b04ef699892d61ea100130/users/c5000c775b4a4162b27d6fec841d7f2e/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:44.960566 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ceeed8-9cd9-4ea9-8ca6-b706c363fce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=989f5cd4f7b04ef699892d61ea100130, user_id=c5000c775b4a4162b27d6fec841d7f2e, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:44.963234 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ceeed8-9cd9-4ea9-8ca6-b706c363fce1 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:44.977125 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1403/2801] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:16:44 2021] PUT /identity/v3/projects/989f5cd4f7b04ef699892d61ea100130/users/c5000c775b4a4162b27d6fec841d7f2e/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:44.982098 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ad820-657e-403a-81e6-155c5b7ee254 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:44.982421 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ad820-657e-403a-81e6-155c5b7ee254 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:44.982727 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ad820-657e-403a-81e6-155c5b7ee254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:44.999743 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-922ad820-657e-403a-81e6-155c5b7ee254 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:45.000931 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-922ad820-657e-403a-81e6-155c5b7ee254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:45.056043 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1399/2802] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:45.066013 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ceeed8-9cd9-4ea9-8ca6-b706c363fce1 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:45.067668 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-60ceeed8-9cd9-4ea9-8ca6-b706c363fce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:45.123581 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ceeed8-9cd9-4ea9-8ca6-b706c363fce1 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:45.127136 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572da402-6a93-4dca-ad32-3753160bb8ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:45.127799 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572da402-6a93-4dca-ad32-3753160bb8ac service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:45.128080 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572da402-6a93-4dca-ad32-3753160bb8ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:45.128372 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572da402-6a93-4dca-ad32-3753160bb8ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:45.137696 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572da402-6a93-4dca-ad32-3753160bb8ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:45.139146 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572da402-6a93-4dca-ad32-3753160bb8ac service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:45.149102 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1404/2803] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:16:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:16:45.713260 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a896d55-cd8c-4bb9-a434-2a7aad63274b None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:45.713761 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a896d55-cd8c-4bb9-a434-2a7aad63274b None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:45.713857 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a896d55-cd8c-4bb9-a434-2a7aad63274b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:45.739616 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-6a896d55-cd8c-4bb9-a434-2a7aad63274b None None] MFA Rules not processed for user `c5000c775b4a4162b27d6fec841d7f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:45.740935 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-6a896d55-cd8c-4bb9-a434-2a7aad63274b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:45.779096 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572da402-6a93-4dca-ad32-3753160bb8ac service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:45.780640 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-572da402-6a93-4dca-ad32-3753160bb8ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:45.794422 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572da402-6a93-4dca-ad32-3753160bb8ac service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:45.800094 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e08ac-ae9b-4500-ad73-4a98ff4fc18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:45.801295 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e08ac-ae9b-4500-ad73-4a98ff4fc18b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:45.801583 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e08ac-ae9b-4500-ad73-4a98ff4fc18b admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:45.801858 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e08ac-ae9b-4500-ad73-4a98ff4fc18b admin admin] PATH_INFO: `/v3/users/72e740365dd443c98f701b1b97f13808` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:45.803064 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e08ac-ae9b-4500-ad73-4a98ff4fc18b admin admin] RBAC: Authorizing `identity:delete_user(user_id=72e740365dd443c98f701b1b97f13808)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:45.805058 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e08ac-ae9b-4500-ad73-4a98ff4fc18b admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:45.806427 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1400/2804] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:45 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:45.818560 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a896d55-cd8c-4bb9-a434-2a7aad63274b None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:45.820694 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-6a896d55-cd8c-4bb9-a434-2a7aad63274b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:45.853022 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-321e08ac-ae9b-4500-ad73-4a98ff4fc18b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72e740365dd443c98f701b1b97f13808'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:45.864467 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-321e08ac-ae9b-4500-ad73-4a98ff4fc18b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72e740365dd443c98f701b1b97f13808'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:45.872338 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-321e08ac-ae9b-4500-ad73-4a98ff4fc18b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72e740365dd443c98f701b1b97f13808'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:45.873249 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-321e08ac-ae9b-4500-ad73-4a98ff4fc18b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72e740365dd443c98f701b1b97f13808'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:45.880492 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-321e08ac-ae9b-4500-ad73-4a98ff4fc18b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72e740365dd443c98f701b1b97f13808'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:45.887320 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1405/2805] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:16:45 2021] DELETE /identity/v3/users/72e740365dd443c98f701b1b97f13808 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 04:16:45.891319 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d8d16-9e4d-426c-beed-b3266d02f48c None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:45.891612 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d8d16-9e4d-426c-beed-b3266d02f48c None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:45.891910 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d8d16-9e4d-426c-beed-b3266d02f48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:45.896703 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a896d55-cd8c-4bb9-a434-2a7aad63274b None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:45.910229 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-342d8d16-9e4d-426c-beed-b3266d02f48c None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:45.911345 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-342d8d16-9e4d-426c-beed-b3266d02f48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:45.946551 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82565cde-fd4c-483d-9c48-800cb982f419 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:45.947193 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82565cde-fd4c-483d-9c48-800cb982f419 service cinder] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:45.947472 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82565cde-fd4c-483d-9c48-800cb982f419 service cinder] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:45.947776 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82565cde-fd4c-483d-9c48-800cb982f419 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:45.949524 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-82565cde-fd4c-483d-9c48-800cb982f419 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:45.970274 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1406/2806] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 04:16:45.980382 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d8d16-9e4d-426c-beed-b3266d02f48c None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:45.981688 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-342d8d16-9e4d-426c-beed-b3266d02f48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:46.010305 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82565cde-fd4c-483d-9c48-800cb982f419 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:46.011776 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82565cde-fd4c-483d-9c48-800cb982f419 service cinder] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:46.020434 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1401/2807] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:16:45 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 04:16:46.037375 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d8d16-9e4d-426c-beed-b3266d02f48c None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:46.041015 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fbecc-ec98-4713-9503-34a2e458839b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:46.041646 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fbecc-ec98-4713-9503-34a2e458839b service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:46.041927 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fbecc-ec98-4713-9503-34a2e458839b service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:46.042199 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fbecc-ec98-4713-9503-34a2e458839b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:46.050954 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2fbecc-ec98-4713-9503-34a2e458839b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:46.052409 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2fbecc-ec98-4713-9503-34a2e458839b service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:46.063490 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1407/2808] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:16:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 04:16:46.342404 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82565cde-fd4c-483d-9c48-800cb982f419 service cinder] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:46.344280 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-82565cde-fd4c-483d-9c48-800cb982f419 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:46.361915 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82565cde-fd4c-483d-9c48-800cb982f419 service cinder] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:46.366795 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8cfdb-968b-4503-b9cd-f21f65b7607e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:46.367630 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8cfdb-968b-4503-b9cd-f21f65b7607e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:46.367953 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8cfdb-968b-4503-b9cd-f21f65b7607e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:46.368233 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8cfdb-968b-4503-b9cd-f21f65b7607e admin admin] PATH_INFO: `/v3/projects/ffbed5828cb94ad48cb443b6dee62659` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:46.369725 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8cfdb-968b-4503-b9cd-f21f65b7607e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffbed5828cb94ad48cb443b6dee62659)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:46.371617 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8cfdb-968b-4503-b9cd-f21f65b7607e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:46.417459 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-22e8cfdb-968b-4503-b9cd-f21f65b7607e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffbed5828cb94ad48cb443b6dee62659', 'request_id': 'req-22e8cfdb-968b-4503-b9cd-f21f65b7607e'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:46.423313 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-22e8cfdb-968b-4503-b9cd-f21f65b7607e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffbed5828cb94ad48cb443b6dee62659', 'request_id': 'req-22e8cfdb-968b-4503-b9cd-f21f65b7607e'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:46.428718 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-22e8cfdb-968b-4503-b9cd-f21f65b7607e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffbed5828cb94ad48cb443b6dee62659', 'request_id': 'req-22e8cfdb-968b-4503-b9cd-f21f65b7607e'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:46.443512 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-22e8cfdb-968b-4503-b9cd-f21f65b7607e admin admin] The token cache is being invalidate because project ffbed5828cb94ad48cb443b6dee62659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:16:46.443833 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-22e8cfdb-968b-4503-b9cd-f21f65b7607e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:46.444967 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-22e8cfdb-968b-4503-b9cd-f21f65b7607e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:46.446502 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1402/2809] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:16:46 2021] DELETE /identity/v3/projects/ffbed5828cb94ad48cb443b6dee62659 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:46.450551 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fbecc-ec98-4713-9503-34a2e458839b service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:46.460651 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fbecc-ec98-4713-9503-34a2e458839b service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:46.517508 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a9fdd-a81f-4e00-9e07-6f7d1fbd23cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:46.518385 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a9fdd-a81f-4e00-9e07-6f7d1fbd23cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:46.518665 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a9fdd-a81f-4e00-9e07-6f7d1fbd23cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:46.518936 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a9fdd-a81f-4e00-9e07-6f7d1fbd23cf admin admin] PATH_INFO: `/v3/users/6c2d93ef74864245b692c710a17ef402` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:46.520148 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a9fdd-a81f-4e00-9e07-6f7d1fbd23cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c2d93ef74864245b692c710a17ef402)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:46.522485 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a9fdd-a81f-4e00-9e07-6f7d1fbd23cf admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:46.565876 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8f3a9fdd-a81f-4e00-9e07-6f7d1fbd23cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c2d93ef74864245b692c710a17ef402'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:46.577265 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8f3a9fdd-a81f-4e00-9e07-6f7d1fbd23cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c2d93ef74864245b692c710a17ef402'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:46.584029 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8f3a9fdd-a81f-4e00-9e07-6f7d1fbd23cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c2d93ef74864245b692c710a17ef402'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:46.584630 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8f3a9fdd-a81f-4e00-9e07-6f7d1fbd23cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c2d93ef74864245b692c710a17ef402'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:46.591325 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-8f3a9fdd-a81f-4e00-9e07-6f7d1fbd23cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c2d93ef74864245b692c710a17ef402'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:46.596997 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1408/2810] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:16:46 2021] DELETE /identity/v3/users/6c2d93ef74864245b692c710a17ef402 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:46.846613 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8cfdb-968b-4503-b9cd-f21f65b7607e admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:46.848089 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-22e8cfdb-968b-4503-b9cd-f21f65b7607e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:46.860792 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8cfdb-968b-4503-b9cd-f21f65b7607e admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:46.917540 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a342a12-7d93-476f-abcd-24c616e1d457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:46.918379 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a342a12-7d93-476f-abcd-24c616e1d457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:46.918665 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a342a12-7d93-476f-abcd-24c616e1d457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:46.918944 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a342a12-7d93-476f-abcd-24c616e1d457 admin admin] PATH_INFO: `/v3/projects/48793a1dc45d47dca01379688743a4f6` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:46.920174 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a342a12-7d93-476f-abcd-24c616e1d457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48793a1dc45d47dca01379688743a4f6)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:46.922088 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a342a12-7d93-476f-abcd-24c616e1d457 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:46.965176 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-3a342a12-7d93-476f-abcd-24c616e1d457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48793a1dc45d47dca01379688743a4f6', 'request_id': 'req-3a342a12-7d93-476f-abcd-24c616e1d457'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:46.971153 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-3a342a12-7d93-476f-abcd-24c616e1d457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48793a1dc45d47dca01379688743a4f6', 'request_id': 'req-3a342a12-7d93-476f-abcd-24c616e1d457'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:46.977434 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-3a342a12-7d93-476f-abcd-24c616e1d457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48793a1dc45d47dca01379688743a4f6', 'request_id': 'req-3a342a12-7d93-476f-abcd-24c616e1d457'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:46.988785 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-3a342a12-7d93-476f-abcd-24c616e1d457 admin admin] The token cache is being invalidate because project 48793a1dc45d47dca01379688743a4f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:16:46.989099 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-3a342a12-7d93-476f-abcd-24c616e1d457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:46.989707 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-3a342a12-7d93-476f-abcd-24c616e1d457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:46.991328 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1403/2811] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:16:46 2021] DELETE /identity/v3/projects/48793a1dc45d47dca01379688743a4f6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:46.997016 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388f96c-f064-442c-9b1a-82fc893d1a82 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:46.997309 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388f96c-f064-442c-9b1a-82fc893d1a82 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:46.997592 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388f96c-f064-442c-9b1a-82fc893d1a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:47.015218 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-8388f96c-f064-442c-9b1a-82fc893d1a82 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:47.016458 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-8388f96c-f064-442c-9b1a-82fc893d1a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:47.072429 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1409/2812] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:16:47.080453 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dde12-32e1-4afc-a070-ad33631a0e91 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:47.080736 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dde12-32e1-4afc-a070-ad33631a0e91 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:47.081038 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dde12-32e1-4afc-a070-ad33631a0e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:47.100098 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-3c9dde12-32e1-4afc-a070-ad33631a0e91 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:47.101886 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-3c9dde12-32e1-4afc-a070-ad33631a0e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:47.109474 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1404/2813] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 04:16:47.113562 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388f96c-f064-442c-9b1a-82fc893d1a82 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:47.123026 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388f96c-f064-442c-9b1a-82fc893d1a82 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:47.127561 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11787d4-996c-4078-a79b-d148d156bead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:47.128230 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11787d4-996c-4078-a79b-d148d156bead admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:47.128512 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11787d4-996c-4078-a79b-d148d156bead admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:47.128787 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11787d4-996c-4078-a79b-d148d156bead admin admin] PATH_INFO: `/v3/domains` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:47.129508 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11787d4-996c-4078-a79b-d148d156bead admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 04:16:47.129811 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11787d4-996c-4078-a79b-d148d156bead admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:47.131394 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11787d4-996c-4078-a79b-d148d156bead admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:47.142919 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1410/2814] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 04:16:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 04:16:47.146882 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9dde12-32e1-4afc-a070-ad33631a0e91 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:47.156305 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9dde12-32e1-4afc-a070-ad33631a0e91 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:47.160862 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64da68c-df66-441f-aa7e-71cd1db32ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:47.161520 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64da68c-df66-441f-aa7e-71cd1db32ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:47.161800 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64da68c-df66-441f-aa7e-71cd1db32ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:47.162072 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64da68c-df66-441f-aa7e-71cd1db32ee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:47.162769 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64da68c-df66-441f-aa7e-71cd1db32ee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:47.164794 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64da68c-df66-441f-aa7e-71cd1db32ee4 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:47.189522 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1405/2815] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:16:47 2021] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:16:47.193593 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11787d4-996c-4078-a79b-d148d156bead admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:47.203788 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11787d4-996c-4078-a79b-d148d156bead admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:47.257721 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06741f93-36c5-4132-a0dd-2e42e7e79bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:47.258383 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06741f93-36c5-4132-a0dd-2e42e7e79bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:47.258669 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06741f93-36c5-4132-a0dd-2e42e7e79bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:47.258950 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06741f93-36c5-4132-a0dd-2e42e7e79bd7 admin admin] PATH_INFO: `/v3/users` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:47.259657 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06741f93-36c5-4132-a0dd-2e42e7e79bd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:47.261610 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06741f93-36c5-4132-a0dd-2e42e7e79bd7 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:47.283364 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1411/2816] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:16:47 2021] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 04:16:47.285096 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64da68c-df66-441f-aa7e-71cd1db32ee4 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:47.295053 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64da68c-df66-441f-aa7e-71cd1db32ee4 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:47.299642 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86f9bb-aa8a-430a-b359-6622a4fe7618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:47.300317 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86f9bb-aa8a-430a-b359-6622a4fe7618 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:47.300600 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86f9bb-aa8a-430a-b359-6622a4fe7618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:47.300873 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86f9bb-aa8a-430a-b359-6622a4fe7618 admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:47.301598 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86f9bb-aa8a-430a-b359-6622a4fe7618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:47.303183 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86f9bb-aa8a-430a-b359-6622a4fe7618 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:47.313821 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1406/2817] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:47 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:16:47.317557 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06741f93-36c5-4132-a0dd-2e42e7e79bd7 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:47.327549 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06741f93-36c5-4132-a0dd-2e42e7e79bd7 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:47.332101 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4824e-71a0-40ac-94eb-8497ad3dfac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:47.332744 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4824e-71a0-40ac-94eb-8497ad3dfac2 admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:47.333027 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4824e-71a0-40ac-94eb-8497ad3dfac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:47.333298 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4824e-71a0-40ac-94eb-8497ad3dfac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:47.334028 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4824e-71a0-40ac-94eb-8497ad3dfac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:47.336233 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4824e-71a0-40ac-94eb-8497ad3dfac2 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:47.345756 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1412/2818] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:16:47 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:16:47.355278 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86f9bb-aa8a-430a-b359-6622a4fe7618 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:47.360913 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86f9bb-aa8a-430a-b359-6622a4fe7618 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:47.365348 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a757c-fee5-4bd7-892e-84124414be13 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:47.365575 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f5afc-237f-4de5-b115-fca47b98af0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:47.365701 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a757c-fee5-4bd7-892e-84124414be13 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:47.365888 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a757c-fee5-4bd7-892e-84124414be13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:47.367032 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f5afc-237f-4de5-b115-fca47b98af0e admin admin] REQUEST_METHOD: `PUT` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:47.367312 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f5afc-237f-4de5-b115-fca47b98af0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:47.367585 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f5afc-237f-4de5-b115-fca47b98af0e admin admin] PATH_INFO: `/v3/projects/88469a2a4ca34690ae9486a4c35310cb/users/ca1fce9e1bc24a8b99ac9dde099446bc/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:47.382115 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f5afc-237f-4de5-b115-fca47b98af0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=88469a2a4ca34690ae9486a4c35310cb, user_id=ca1fce9e1bc24a8b99ac9dde099446bc, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:47.384247 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-cf3a757c-fee5-4bd7-892e-84124414be13 None None] MFA Rules not processed for user `c5000c775b4a4162b27d6fec841d7f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:47.384813 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f5afc-237f-4de5-b115-fca47b98af0e admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:47.385714 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-cf3a757c-fee5-4bd7-892e-84124414be13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:47.396881 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1407/2819] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:16:47 2021] PUT /identity/v3/projects/88469a2a4ca34690ae9486a4c35310cb/users/ca1fce9e1bc24a8b99ac9dde099446bc/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 04:16:47.406851 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de0204-e091-4fde-b7ab-73df3edbd348 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:47.407135 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de0204-e091-4fde-b7ab-73df3edbd348 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:47.407410 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de0204-e091-4fde-b7ab-73df3edbd348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:47.433483 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-60de0204-e091-4fde-b7ab-73df3edbd348 None None] MFA Rules not processed for user `ca1fce9e1bc24a8b99ac9dde099446bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:47.434688 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-60de0204-e091-4fde-b7ab-73df3edbd348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:47.443454 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1413/2820] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:47 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 04:16:47.500760 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1408/2821] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:47 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 04:16:47.511084 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a757c-fee5-4bd7-892e-84124414be13 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:47.512522 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-cf3a757c-fee5-4bd7-892e-84124414be13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:47.568966 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a757c-fee5-4bd7-892e-84124414be13 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:47.615057 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed7211-3481-4513-ae0f-7e70f0628db7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:47.615792 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed7211-3481-4513-ae0f-7e70f0628db7 service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:47.615995 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed7211-3481-4513-ae0f-7e70f0628db7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:47.616416 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed7211-3481-4513-ae0f-7e70f0628db7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:47.625958 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed7211-3481-4513-ae0f-7e70f0628db7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:47.627416 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed7211-3481-4513-ae0f-7e70f0628db7 service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:47.636144 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1414/2822] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:16:47 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:16:47.994503 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de0204-e091-4fde-b7ab-73df3edbd348 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:47.996033 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-60de0204-e091-4fde-b7ab-73df3edbd348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:48.063376 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de0204-e091-4fde-b7ab-73df3edbd348 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:48.068368 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d50f96-cc0d-4bed-8234-e699641c94c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bffc0480ffb942cdad426195eca0529e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:48.069006 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d50f96-cc0d-4bed-8234-e699641c94c0 service placement] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:48.069803 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d50f96-cc0d-4bed-8234-e699641c94c0 service placement] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:48.070080 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d50f96-cc0d-4bed-8234-e699641c94c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:48.071853 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-68d50f96-cc0d-4bed-8234-e699641c94c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:48.082906 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d50f96-cc0d-4bed-8234-e699641c94c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:48.084505 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d50f96-cc0d-4bed-8234-e699641c94c0 service placement] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:48.095017 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1409/2823] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:16:47 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:16:50.183422 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed7211-3481-4513-ae0f-7e70f0628db7 service cinder] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:50.266922 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed7211-3481-4513-ae0f-7e70f0628db7 service cinder] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:50.272242 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf88044-4c4d-404c-ae9f-f9bb7be58df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:50.273131 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf88044-4c4d-404c-ae9f-f9bb7be58df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:50.273414 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf88044-4c4d-404c-ae9f-f9bb7be58df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:50.273684 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf88044-4c4d-404c-ae9f-f9bb7be58df5 admin admin] PATH_INFO: `/v3/users/ca1fce9e1bc24a8b99ac9dde099446bc` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:50.274896 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf88044-4c4d-404c-ae9f-f9bb7be58df5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca1fce9e1bc24a8b99ac9dde099446bc)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:50.277370 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf88044-4c4d-404c-ae9f-f9bb7be58df5 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:50.326611 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-6bf88044-4c4d-404c-ae9f-f9bb7be58df5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca1fce9e1bc24a8b99ac9dde099446bc'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:50.338478 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-6bf88044-4c4d-404c-ae9f-f9bb7be58df5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca1fce9e1bc24a8b99ac9dde099446bc'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:50.345743 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-6bf88044-4c4d-404c-ae9f-f9bb7be58df5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca1fce9e1bc24a8b99ac9dde099446bc'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:50.346354 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-6bf88044-4c4d-404c-ae9f-f9bb7be58df5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca1fce9e1bc24a8b99ac9dde099446bc'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:50.352995 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-6bf88044-4c4d-404c-ae9f-f9bb7be58df5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca1fce9e1bc24a8b99ac9dde099446bc'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:50.360444 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1415/2824] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:16:50 2021] DELETE /identity/v3/users/ca1fce9e1bc24a8b99ac9dde099446bc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:50.365083 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcbb39-c3b6-4044-8a7c-bf41f4caf565 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:50.365527 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcbb39-c3b6-4044-8a7c-bf41f4caf565 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:50.365804 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcbb39-c3b6-4044-8a7c-bf41f4caf565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:50.384594 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-b8bcbb39-c3b6-4044-8a7c-bf41f4caf565 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:16:50.385914 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-b8bcbb39-c3b6-4044-8a7c-bf41f4caf565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:50.460724 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1410/2825] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:16:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 04:16:50.470826 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf88044-4c4d-404c-ae9f-f9bb7be58df5 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:50.472360 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-6bf88044-4c4d-404c-ae9f-f9bb7be58df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:50.528544 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf88044-4c4d-404c-ae9f-f9bb7be58df5 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:50.532331 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf870e7-f0d6-43b1-8fa3-e535cff8eb7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:50.532963 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf870e7-f0d6-43b1-8fa3-e535cff8eb7a service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:50.533242 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf870e7-f0d6-43b1-8fa3-e535cff8eb7a service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:50.533513 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf870e7-f0d6-43b1-8fa3-e535cff8eb7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:50.543176 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf870e7-f0d6-43b1-8fa3-e535cff8eb7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:50.544631 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf870e7-f0d6-43b1-8fa3-e535cff8eb7a service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:50.554859 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1416/2826] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:16:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:16:50.908880 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcbb39-c3b6-4044-8a7c-bf41f4caf565 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:50.910573 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-b8bcbb39-c3b6-4044-8a7c-bf41f4caf565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:50.926589 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcbb39-c3b6-4044-8a7c-bf41f4caf565 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:50.932371 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05327a9a-df73-4817-ae73-91f75bb0d6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:50.933231 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05327a9a-df73-4817-ae73-91f75bb0d6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:50.933495 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05327a9a-df73-4817-ae73-91f75bb0d6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:50.933765 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05327a9a-df73-4817-ae73-91f75bb0d6a9 admin admin] PATH_INFO: `/v3/projects/88469a2a4ca34690ae9486a4c35310cb` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:50.935174 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05327a9a-df73-4817-ae73-91f75bb0d6a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88469a2a4ca34690ae9486a4c35310cb)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:50.937220 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05327a9a-df73-4817-ae73-91f75bb0d6a9 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:50.985681 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-05327a9a-df73-4817-ae73-91f75bb0d6a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88469a2a4ca34690ae9486a4c35310cb', 'request_id': 'req-05327a9a-df73-4817-ae73-91f75bb0d6a9'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:50.992296 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-05327a9a-df73-4817-ae73-91f75bb0d6a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88469a2a4ca34690ae9486a4c35310cb', 'request_id': 'req-05327a9a-df73-4817-ae73-91f75bb0d6a9'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:50.997550 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-05327a9a-df73-4817-ae73-91f75bb0d6a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88469a2a4ca34690ae9486a4c35310cb', 'request_id': 'req-05327a9a-df73-4817-ae73-91f75bb0d6a9'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:51.009653 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-05327a9a-df73-4817-ae73-91f75bb0d6a9 admin admin] The token cache is being invalidate because project 88469a2a4ca34690ae9486a4c35310cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:16:51.009936 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-05327a9a-df73-4817-ae73-91f75bb0d6a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:51.010557 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-05327a9a-df73-4817-ae73-91f75bb0d6a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:16:51.012139 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1411/2827] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:16:50 2021] DELETE /identity/v3/projects/88469a2a4ca34690ae9486a4c35310cb => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:16:54.783176 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf870e7-f0d6-43b1-8fa3-e535cff8eb7a service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:16:54.784962 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-4bf870e7-f0d6-43b1-8fa3-e535cff8eb7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:54.867628 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf870e7-f0d6-43b1-8fa3-e535cff8eb7a service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:16:54.927740 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f3474-a93f-48dd-98d5-7de07aa119dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d71a1bd93b04249b2b8e6a054de44c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:16:54.928419 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f3474-a93f-48dd-98d5-7de07aa119dd service nova] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:16:54.929242 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f3474-a93f-48dd-98d5-7de07aa119dd service nova] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:16:54.929640 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f3474-a93f-48dd-98d5-7de07aa119dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:16:54.931703 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-143f3474-a93f-48dd-98d5-7de07aa119dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:16:54.943779 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f3474-a93f-48dd-98d5-7de07aa119dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:16:54.945406 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f3474-a93f-48dd-98d5-7de07aa119dd service nova] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:16:54.955602 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1417/2828] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:16:54 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:17:00.040577 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fab944-d42d-4490-bed1-233534c7ea81 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:00.041086 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fab944-d42d-4490-bed1-233534c7ea81 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:00.041196 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fab944-d42d-4490-bed1-233534c7ea81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:00.058791 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-95fab944-d42d-4490-bed1-233534c7ea81 None None] MFA Rules not processed for user `c5000c775b4a4162b27d6fec841d7f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:17:00.060000 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-95fab944-d42d-4490-bed1-233534c7ea81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:17:00.111237 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1412/2829] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:17:00 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:17:11.015817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f3474-a93f-48dd-98d5-7de07aa119dd service nova] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:17:11.017183 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-143f3474-a93f-48dd-98d5-7de07aa119dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:17:11.081352 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f3474-a93f-48dd-98d5-7de07aa119dd service nova] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:17:11.086851 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353cd42-cf6b-43bc-97ad-187219dddd43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bffc0480ffb942cdad426195eca0529e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:17:11.087415 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353cd42-cf6b-43bc-97ad-187219dddd43 service placement] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:11.087719 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353cd42-cf6b-43bc-97ad-187219dddd43 service placement] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:11.088015 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353cd42-cf6b-43bc-97ad-187219dddd43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:11.089723 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-1353cd42-cf6b-43bc-97ad-187219dddd43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:17:11.101222 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353cd42-cf6b-43bc-97ad-187219dddd43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:17:11.102796 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353cd42-cf6b-43bc-97ad-187219dddd43 service placement] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:17:11.112532 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1418/2830] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:17:11 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:17:17.292824 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dc9f4-8893-47f9-a25d-6a1c5f71f041 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:17.293283 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dc9f4-8893-47f9-a25d-6a1c5f71f041 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:17.293415 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dc9f4-8893-47f9-a25d-6a1c5f71f041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:17.311638 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-948dc9f4-8893-47f9-a25d-6a1c5f71f041 None None] MFA Rules not processed for user `3f598b94a850413494da575188706cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:17:17.313102 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-948dc9f4-8893-47f9-a25d-6a1c5f71f041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:17:17.366797 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1413/2831] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Oct 15 04:17:17 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:17:17.412534 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353cd42-cf6b-43bc-97ad-187219dddd43 service placement] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:17:17.413917 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-1353cd42-cf6b-43bc-97ad-187219dddd43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:17:17.478698 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353cd42-cf6b-43bc-97ad-187219dddd43 service placement] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:17:17.483524 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622a8b0-8488-486d-b01a-05a88f8ec148 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfdf0fb38dd04c75a1c874913ea1bf98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:17:17.484182 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622a8b0-8488-486d-b01a-05a88f8ec148 service swift] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:17.484460 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622a8b0-8488-486d-b01a-05a88f8ec148 service swift] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:17.484732 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622a8b0-8488-486d-b01a-05a88f8ec148 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:17.493087 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622a8b0-8488-486d-b01a-05a88f8ec148 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:17:17.495042 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622a8b0-8488-486d-b01a-05a88f8ec148 service swift] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:17:17.502847 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1419/2832] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Oct 15 04:17:17 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 15 04:17:31.746746 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128245b-78be-4e90-8c50-1762035cd700 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:31.747244 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128245b-78be-4e90-8c50-1762035cd700 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:31.747338 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128245b-78be-4e90-8c50-1762035cd700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:31.764778 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-c128245b-78be-4e90-8c50-1762035cd700 None None] MFA Rules not processed for user `3f598b94a850413494da575188706cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:17:31.765944 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c128245b-78be-4e90-8c50-1762035cd700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:17:31.772847 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1414/2833] 10.222.0.30 () {58 vars in 967 bytes} [Fri Oct 15 04:17:31 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:17:31.785414 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622a8b0-8488-486d-b01a-05a88f8ec148 service swift] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:17:31.795591 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622a8b0-8488-486d-b01a-05a88f8ec148 service swift] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:17:31.800898 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67627f58-a424-4d89-818d-d881695cbc49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfdf0fb38dd04c75a1c874913ea1bf98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:17:31.801529 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67627f58-a424-4d89-818d-d881695cbc49 service swift] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:31.801812 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67627f58-a424-4d89-818d-d881695cbc49 service swift] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:31.802093 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67627f58-a424-4d89-818d-d881695cbc49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:31.810542 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67627f58-a424-4d89-818d-d881695cbc49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:17:31.812425 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67627f58-a424-4d89-818d-d881695cbc49 service swift] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:17:31.820877 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1420/2834] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Oct 15 04:17:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 15 04:17:33.668922 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128245b-78be-4e90-8c50-1762035cd700 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:17:33.670492 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-c128245b-78be-4e90-8c50-1762035cd700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:17:33.734129 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128245b-78be-4e90-8c50-1762035cd700 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:17:33.738461 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69685da-e61a-49bb-9a0c-c3ffe0ad832f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:17:33.739310 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69685da-e61a-49bb-9a0c-c3ffe0ad832f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:33.739587 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69685da-e61a-49bb-9a0c-c3ffe0ad832f admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:33.739887 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69685da-e61a-49bb-9a0c-c3ffe0ad832f admin admin] PATH_INFO: `/v3/users/c5000c775b4a4162b27d6fec841d7f2e` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:33.741068 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69685da-e61a-49bb-9a0c-c3ffe0ad832f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5000c775b4a4162b27d6fec841d7f2e)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:17:33.743520 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69685da-e61a-49bb-9a0c-c3ffe0ad832f admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:17:33.787450 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-f69685da-e61a-49bb-9a0c-c3ffe0ad832f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5000c775b4a4162b27d6fec841d7f2e'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:17:33.799109 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-f69685da-e61a-49bb-9a0c-c3ffe0ad832f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5000c775b4a4162b27d6fec841d7f2e'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:17:33.805881 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-f69685da-e61a-49bb-9a0c-c3ffe0ad832f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5000c775b4a4162b27d6fec841d7f2e'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:17:33.806489 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-f69685da-e61a-49bb-9a0c-c3ffe0ad832f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5000c775b4a4162b27d6fec841d7f2e'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:17:33.813342 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-f69685da-e61a-49bb-9a0c-c3ffe0ad832f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5000c775b4a4162b27d6fec841d7f2e'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:17:33.819061 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1415/2835] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:17:33 2021] DELETE /identity/v3/users/c5000c775b4a4162b27d6fec841d7f2e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 15 04:17:33.987239 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67627f58-a424-4d89-818d-d881695cbc49 service swift] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:17:33.999920 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67627f58-a424-4d89-818d-d881695cbc49 service swift] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:17:34.052872 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a52d4-f711-49e1-9b11-adc1c71d8bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:17:34.053707 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a52d4-f711-49e1-9b11-adc1c71d8bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:34.053982 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a52d4-f711-49e1-9b11-adc1c71d8bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:34.054250 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a52d4-f711-49e1-9b11-adc1c71d8bb0 admin admin] PATH_INFO: `/v3/projects/989f5cd4f7b04ef699892d61ea100130` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:34.056042 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a52d4-f711-49e1-9b11-adc1c71d8bb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=989f5cd4f7b04ef699892d61ea100130)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:17:34.057916 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a52d4-f711-49e1-9b11-adc1c71d8bb0 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:17:34.100320 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a10a52d4-f711-49e1-9b11-adc1c71d8bb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '989f5cd4f7b04ef699892d61ea100130', 'request_id': 'req-a10a52d4-f711-49e1-9b11-adc1c71d8bb0'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:17:34.106633 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a10a52d4-f711-49e1-9b11-adc1c71d8bb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '989f5cd4f7b04ef699892d61ea100130', 'request_id': 'req-a10a52d4-f711-49e1-9b11-adc1c71d8bb0'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:17:34.111799 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a10a52d4-f711-49e1-9b11-adc1c71d8bb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '989f5cd4f7b04ef699892d61ea100130', 'request_id': 'req-a10a52d4-f711-49e1-9b11-adc1c71d8bb0'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:17:34.128472 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a10a52d4-f711-49e1-9b11-adc1c71d8bb0 admin admin] The token cache is being invalidate because project 989f5cd4f7b04ef699892d61ea100130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:17:34.128756 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a10a52d4-f711-49e1-9b11-adc1c71d8bb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:17:34.129381 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-a10a52d4-f711-49e1-9b11-adc1c71d8bb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:17:34.131228 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1421/2836] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:17:33 2021] DELETE /identity/v3/projects/989f5cd4f7b04ef699892d61ea100130 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:17:34.137315 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ce611-d7a3-4961-9a97-878bfa1a5e89 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:34.137606 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ce611-d7a3-4961-9a97-878bfa1a5e89 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:34.137906 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ce611-d7a3-4961-9a97-878bfa1a5e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:34.155410 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-858ce611-d7a3-4961-9a97-878bfa1a5e89 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:17:34.156640 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-858ce611-d7a3-4961-9a97-878bfa1a5e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:17:34.212204 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1416/2837] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:17:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 04:17:34.220557 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ef861-1620-4542-bcf3-995c51c52f89 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:34.220956 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ef861-1620-4542-bcf3-995c51c52f89 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:34.221236 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ef861-1620-4542-bcf3-995c51c52f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:34.240107 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-a96ef861-1620-4542-bcf3-995c51c52f89 None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:17:34.241254 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-a96ef861-1620-4542-bcf3-995c51c52f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:17:34.249818 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1422/2838] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:17:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:17:34.253898 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ce611-d7a3-4961-9a97-878bfa1a5e89 None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:17:34.263557 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ce611-d7a3-4961-9a97-878bfa1a5e89 None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:17:34.268113 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeccae4-cc65-4b8d-b2bd-fd0878c1e827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:17:34.268751 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeccae4-cc65-4b8d-b2bd-fd0878c1e827 admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:34.269030 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeccae4-cc65-4b8d-b2bd-fd0878c1e827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:34.269303 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeccae4-cc65-4b8d-b2bd-fd0878c1e827 admin admin] PATH_INFO: `/v3/domains` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:34.270017 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeccae4-cc65-4b8d-b2bd-fd0878c1e827 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 15 04:17:34.270320 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeccae4-cc65-4b8d-b2bd-fd0878c1e827 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:17:34.271962 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeccae4-cc65-4b8d-b2bd-fd0878c1e827 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:17:34.283530 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1417/2839] 10.222.0.30 () {58 vars in 1152 bytes} [Fri Oct 15 04:17:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 15 04:17:34.286885 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ef861-1620-4542-bcf3-995c51c52f89 None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:17:34.296435 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ef861-1620-4542-bcf3-995c51c52f89 None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:17:34.301069 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42d5ce-9074-42b7-9689-32e274a7e653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:17:34.301701 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42d5ce-9074-42b7-9689-32e274a7e653 admin admin] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:34.301981 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42d5ce-9074-42b7-9689-32e274a7e653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:34.302254 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42d5ce-9074-42b7-9689-32e274a7e653 admin admin] PATH_INFO: `/v3/projects` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:34.302958 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42d5ce-9074-42b7-9689-32e274a7e653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:17:34.305485 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42d5ce-9074-42b7-9689-32e274a7e653 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:17:34.330538 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1423/2840] 10.222.0.30 () {60 vars in 1152 bytes} [Fri Oct 15 04:17:34 2021] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 15 04:17:34.334418 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeccae4-cc65-4b8d-b2bd-fd0878c1e827 admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:17:34.345376 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeccae4-cc65-4b8d-b2bd-fd0878c1e827 admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:17:34.398044 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769daf9-4fee-4ad7-9051-e482ca4f52ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:17:34.399245 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769daf9-4fee-4ad7-9051-e482ca4f52ae admin admin] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:34.399530 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769daf9-4fee-4ad7-9051-e482ca4f52ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:34.399840 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769daf9-4fee-4ad7-9051-e482ca4f52ae admin admin] PATH_INFO: `/v3/users` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:34.400536 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769daf9-4fee-4ad7-9051-e482ca4f52ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:17:34.402434 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769daf9-4fee-4ad7-9051-e482ca4f52ae admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:17:34.422378 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1418/2841] 10.222.0.30 () {60 vars in 1143 bytes} [Fri Oct 15 04:17:34 2021] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 15 04:17:34.426446 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42d5ce-9074-42b7-9689-32e274a7e653 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:17:34.436480 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42d5ce-9074-42b7-9689-32e274a7e653 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:17:34.441330 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63683e1-8888-40a2-a36e-48a5524f582f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:17:34.441974 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63683e1-8888-40a2-a36e-48a5524f582f admin admin] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:34.442254 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63683e1-8888-40a2-a36e-48a5524f582f admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:34.442529 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63683e1-8888-40a2-a36e-48a5524f582f admin admin] PATH_INFO: `/v3/roles` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:34.443285 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63683e1-8888-40a2-a36e-48a5524f582f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:17:34.444914 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63683e1-8888-40a2-a36e-48a5524f582f admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:17:34.455053 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1424/2842] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:17:34 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 15 04:17:34.458454 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769daf9-4fee-4ad7-9051-e482ca4f52ae admin admin] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:17:34.468687 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769daf9-4fee-4ad7-9051-e482ca4f52ae admin admin] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:17:34.473265 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f44c7-938a-437b-b236-b14c9bf29ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:17:34.473898 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f44c7-938a-437b-b236-b14c9bf29ebe admin admin] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:34.474180 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f44c7-938a-437b-b236-b14c9bf29ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:34.474451 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f44c7-938a-437b-b236-b14c9bf29ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:34.475165 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f44c7-938a-437b-b236-b14c9bf29ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:17:34.477403 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f44c7-938a-437b-b236-b14c9bf29ebe admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:17:34.486894 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1419/2843] 10.222.0.30 () {58 vars in 1121 bytes} [Fri Oct 15 04:17:34 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 15 04:17:34.490817 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63683e1-8888-40a2-a36e-48a5524f582f admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:17:34.501492 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63683e1-8888-40a2-a36e-48a5524f582f admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:17:34.506138 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62b0a2-86bd-4fc9-bf10-03f93d150996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:17:34.506998 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62b0a2-86bd-4fc9-bf10-03f93d150996 admin admin] REQUEST_METHOD: `PUT` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:34.507282 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62b0a2-86bd-4fc9-bf10-03f93d150996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:34.507556 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62b0a2-86bd-4fc9-bf10-03f93d150996 admin admin] PATH_INFO: `/v3/projects/7620d025b3dc4f9d8780b5991054fd28/users/b84b5179805c47daaf49be4432b0266d/roles/ee5acd2d5378499bb27dc24366041b42` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:34.521915 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62b0a2-86bd-4fc9-bf10-03f93d150996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7620d025b3dc4f9d8780b5991054fd28, user_id=b84b5179805c47daaf49be4432b0266d, role_id=ee5acd2d5378499bb27dc24366041b42)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:17:34.525109 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62b0a2-86bd-4fc9-bf10-03f93d150996 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:17:34.537261 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1425/2844] 10.222.0.30 () {60 vars in 1482 bytes} [Fri Oct 15 04:17:34 2021] PUT /identity/v3/projects/7620d025b3dc4f9d8780b5991054fd28/users/b84b5179805c47daaf49be4432b0266d/roles/ee5acd2d5378499bb27dc24366041b42 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:17:34.547667 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159be27-ebd8-4ee3-86ae-2c5ab969e526 None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:34.547981 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159be27-ebd8-4ee3-86ae-2c5ab969e526 None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:34.548259 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159be27-ebd8-4ee3-86ae-2c5ab969e526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:34.574065 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-7159be27-ebd8-4ee3-86ae-2c5ab969e526 None None] MFA Rules not processed for user `b84b5179805c47daaf49be4432b0266d`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:17:34.575259 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-7159be27-ebd8-4ee3-86ae-2c5ab969e526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:17:34.635257 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1420/2845] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:17:34 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:17:34.644901 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62b0a2-86bd-4fc9-bf10-03f93d150996 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:17:34.646575 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-fb62b0a2-86bd-4fc9-bf10-03f93d150996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:17:34.701521 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62b0a2-86bd-4fc9-bf10-03f93d150996 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:17:34.705215 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae739947-5e06-49c0-beab-7ed4eed4020b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4edffc4b89f74ce590a2dd7b8fc904bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:17:34.705848 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae739947-5e06-49c0-beab-7ed4eed4020b service cinder] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:34.706187 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae739947-5e06-49c0-beab-7ed4eed4020b service cinder] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:34.706493 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae739947-5e06-49c0-beab-7ed4eed4020b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:34.716521 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae739947-5e06-49c0-beab-7ed4eed4020b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:17:34.717949 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae739947-5e06-49c0-beab-7ed4eed4020b service cinder] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:17:34.726553 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1426/2846] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:17:34 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 15 04:17:36.046909 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872bab7-edd2-49d5-bb7a-7ec4b2a22f7a None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:36.047391 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872bab7-edd2-49d5-bb7a-7ec4b2a22f7a None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:36.047483 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872bab7-edd2-49d5-bb7a-7ec4b2a22f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:36.067627 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-4872bab7-edd2-49d5-bb7a-7ec4b2a22f7a None None] MFA Rules not processed for user `b84b5179805c47daaf49be4432b0266d`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:17:36.069558 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-4872bab7-edd2-49d5-bb7a-7ec4b2a22f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:17:36.080179 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1421/2847] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:17:36 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:17:47.143458 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243579e-9b6f-4920-9eeb-d46858eb5530 None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:47.143931 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243579e-9b6f-4920-9eeb-d46858eb5530 None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:47.144040 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243579e-9b6f-4920-9eeb-d46858eb5530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:47.161749 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-6243579e-9b6f-4920-9eeb-d46858eb5530 None None] MFA Rules not processed for user `3f598b94a850413494da575188706cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:17:47.162916 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-6243579e-9b6f-4920-9eeb-d46858eb5530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:17:47.215576 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1427/2848] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Oct 15 04:17:47 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:17:47.228154 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872bab7-edd2-49d5-bb7a-7ec4b2a22f7a None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:17:47.229539 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-4872bab7-edd2-49d5-bb7a-7ec4b2a22f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:17:47.295319 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872bab7-edd2-49d5-bb7a-7ec4b2a22f7a None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:17:47.300206 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17386b45-1294-46f6-abce-647ffa7fc53e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfdf0fb38dd04c75a1c874913ea1bf98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:17:47.300836 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17386b45-1294-46f6-abce-647ffa7fc53e service swift] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:47.301115 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17386b45-1294-46f6-abce-647ffa7fc53e service swift] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:47.301386 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17386b45-1294-46f6-abce-647ffa7fc53e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:47.309138 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17386b45-1294-46f6-abce-647ffa7fc53e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:17:47.310638 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17386b45-1294-46f6-abce-647ffa7fc53e service swift] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:17:47.318500 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1422/2849] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Oct 15 04:17:47 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 15 04:17:47.897439 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f991987-a0a3-4a33-9efd-2281da4e3f1c None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:47.897726 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f991987-a0a3-4a33-9efd-2281da4e3f1c None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:47.898000 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f991987-a0a3-4a33-9efd-2281da4e3f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:47.915496 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-3f991987-a0a3-4a33-9efd-2281da4e3f1c None None] MFA Rules not processed for user `3f598b94a850413494da575188706cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:17:47.916698 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-3f991987-a0a3-4a33-9efd-2281da4e3f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:17:47.923581 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1428/2850] 10.222.0.30 () {58 vars in 1009 bytes} [Fri Oct 15 04:17:47 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 15 04:17:47.936463 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17386b45-1294-46f6-abce-647ffa7fc53e service swift] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:17:47.947150 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17386b45-1294-46f6-abce-647ffa7fc53e service swift] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:17:47.952073 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2895d70-8b25-433b-a10e-771245986bd4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfdf0fb38dd04c75a1c874913ea1bf98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:17:47.952721 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2895d70-8b25-433b-a10e-771245986bd4 service swift] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:47.953003 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2895d70-8b25-433b-a10e-771245986bd4 service swift] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:47.953281 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2895d70-8b25-433b-a10e-771245986bd4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:47.961057 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2895d70-8b25-433b-a10e-771245986bd4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:17:47.962620 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2895d70-8b25-433b-a10e-771245986bd4 service swift] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:17:47.970726 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1423/2851] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Oct 15 04:17:47 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 15 04:17:48.278600 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969e21f-6d70-44d8-b84c-c53aaaa6ed4c None None] REQUEST_METHOD: `POST` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:48.279065 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969e21f-6d70-44d8-b84c-c53aaaa6ed4c None None] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:48.279158 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969e21f-6d70-44d8-b84c-c53aaaa6ed4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:48.296644 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.auth.core [None req-5969e21f-6d70-44d8-b84c-c53aaaa6ed4c None None] MFA Rules not processed for user `3f598b94a850413494da575188706cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:17:48.297800 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-5969e21f-6d70-44d8-b84c-c53aaaa6ed4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:17:48.304668 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1429/2852] 10.222.0.30 () {58 vars in 967 bytes} [Fri Oct 15 04:17:48 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:17:48.316982 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2895d70-8b25-433b-a10e-771245986bd4 service swift] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:17:48.327238 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2895d70-8b25-433b-a10e-771245986bd4 service swift] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:17:48.332197 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b7b0e-20a1-41b8-b8bd-1dad6b3a6c8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfdf0fb38dd04c75a1c874913ea1bf98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:17:48.332822 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b7b0e-20a1-41b8-b8bd-1dad6b3a6c8b service swift] REQUEST_METHOD: `GET` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:48.333104 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b7b0e-20a1-41b8-b8bd-1dad6b3a6c8b service swift] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:48.333378 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b7b0e-20a1-41b8-b8bd-1dad6b3a6c8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:48.341580 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b7b0e-20a1-41b8-b8bd-1dad6b3a6c8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:17:48.343089 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b7b0e-20a1-41b8-b8bd-1dad6b3a6c8b service swift] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:17:48.350713 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1424/2853] 10.222.0.30 () {60 vars in 1384 bytes} [Fri Oct 15 04:17:48 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 15 04:17:50.300538 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969e21f-6d70-44d8-b84c-c53aaaa6ed4c None None] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:17:50.360019 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969e21f-6d70-44d8-b84c-c53aaaa6ed4c None None] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:17:50.364532 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01f1de-9b6a-4a14-8ab4-fc7d46ab4884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:17:50.365380 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01f1de-9b6a-4a14-8ab4-fc7d46ab4884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:50.365664 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01f1de-9b6a-4a14-8ab4-fc7d46ab4884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:50.365941 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01f1de-9b6a-4a14-8ab4-fc7d46ab4884 admin admin] PATH_INFO: `/v3/users/b84b5179805c47daaf49be4432b0266d` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:50.367792 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01f1de-9b6a-4a14-8ab4-fc7d46ab4884 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b84b5179805c47daaf49be4432b0266d)` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:17:50.369711 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01f1de-9b6a-4a14-8ab4-fc7d46ab4884 admin admin] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:17:50.413027 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-9e01f1de-9b6a-4a14-8ab4-fc7d46ab4884 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b84b5179805c47daaf49be4432b0266d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:17:50.424626 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-9e01f1de-9b6a-4a14-8ab4-fc7d46ab4884 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b84b5179805c47daaf49be4432b0266d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:17:50.432832 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-9e01f1de-9b6a-4a14-8ab4-fc7d46ab4884 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b84b5179805c47daaf49be4432b0266d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:17:50.433497 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-9e01f1de-9b6a-4a14-8ab4-fc7d46ab4884 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b84b5179805c47daaf49be4432b0266d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:17:50.440312 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.notifications [None req-9e01f1de-9b6a-4a14-8ab4-fc7d46ab4884 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b84b5179805c47daaf49be4432b0266d'} {{(pid=79362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:17:50.446007 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1430/2854] 10.222.0.30 () {58 vars in 1223 bytes} [Fri Oct 15 04:17:50 2021] DELETE /identity/v3/users/b84b5179805c47daaf49be4432b0266d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:17:50.450456 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27101a17-9e12-4316-8303-8dc3c50f5d8e None None] REQUEST_METHOD: `POST` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:50.450902 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27101a17-9e12-4316-8303-8dc3c50f5d8e None None] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:50.450993 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27101a17-9e12-4316-8303-8dc3c50f5d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:50.469045 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.auth.core [None req-27101a17-9e12-4316-8303-8dc3c50f5d8e None None] MFA Rules not processed for user `54e89668dd2f4bda9877cf539179b3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 15 04:17:50.470287 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-27101a17-9e12-4316-8303-8dc3c50f5d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:17:50.525925 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1425/2855] 10.222.0.30 () {58 vars in 957 bytes} [Fri Oct 15 04:17:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 15 04:17:50.535604 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01f1de-9b6a-4a14-8ab4-fc7d46ab4884 admin admin] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:17:50.537028 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-9e01f1de-9b6a-4a14-8ab4-fc7d46ab4884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:17:50.591143 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01f1de-9b6a-4a14-8ab4-fc7d46ab4884 admin admin] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:17:50.594757 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713422fe-d802-4712-87d7-64b31009f5a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea75b4f9132494388b223a309a40640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:17:50.595386 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713422fe-d802-4712-87d7-64b31009f5a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:50.595668 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713422fe-d802-4712-87d7-64b31009f5a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:50.596039 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713422fe-d802-4712-87d7-64b31009f5a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:50.605337 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713422fe-d802-4712-87d7-64b31009f5a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:17:50.606752 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713422fe-d802-4712-87d7-64b31009f5a0 service neutron] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:17:50.615853 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1431/2856] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:17:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 15 04:17:50.775717 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27101a17-9e12-4316-8303-8dc3c50f5d8e None None] Authenticating user token {{(pid=79361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:17:50.777197 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.fernet_utils [None req-27101a17-9e12-4316-8303-8dc3c50f5d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:17:50.789345 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27101a17-9e12-4316-8303-8dc3c50f5d8e None None] Validating token access rules against request {{(pid=79361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:17:50.793910 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95152022-0b4f-4e4c-af6a-41992931fc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e89668dd2f4bda9877cf539179b3ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38d38c962f4f466f9c11db2457ea0b1e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:17:50.794745 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95152022-0b4f-4e4c-af6a-41992931fc98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:17:50.795021 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95152022-0b4f-4e4c-af6a-41992931fc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:17:50.795291 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95152022-0b4f-4e4c-af6a-41992931fc98 admin admin] PATH_INFO: `/v3/projects/7620d025b3dc4f9d8780b5991054fd28` {{(pid=79361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:17:50.797046 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95152022-0b4f-4e4c-af6a-41992931fc98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7620d025b3dc4f9d8780b5991054fd28)` {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:17:50.798966 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95152022-0b4f-4e4c-af6a-41992931fc98 admin admin] RBAC: Authorization granted {{(pid=79361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:17:50.844945 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-95152022-0b4f-4e4c-af6a-41992931fc98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7620d025b3dc4f9d8780b5991054fd28', 'request_id': 'req-95152022-0b4f-4e4c-af6a-41992931fc98'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:17:50.850846 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-95152022-0b4f-4e4c-af6a-41992931fc98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7620d025b3dc4f9d8780b5991054fd28', 'request_id': 'req-95152022-0b4f-4e4c-af6a-41992931fc98'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:17:50.857824 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-95152022-0b4f-4e4c-af6a-41992931fc98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7620d025b3dc4f9d8780b5991054fd28', 'request_id': 'req-95152022-0b4f-4e4c-af6a-41992931fc98'} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:17:50.869873 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-95152022-0b4f-4e4c-af6a-41992931fc98 admin admin] The token cache is being invalidate because project 7620d025b3dc4f9d8780b5991054fd28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 15 04:17:50.870161 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-95152022-0b4f-4e4c-af6a-41992931fc98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:17:50.870783 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: DEBUG keystone.notifications [None req-95152022-0b4f-4e4c-af6a-41992931fc98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 15 04:17:50.872350 dv-cinder-814100-1-iscsi devstack@keystone.service[79361]: [pid: 79361|app: 0|req: 1426/2857] 10.222.0.30 () {58 vars in 1232 bytes} [Fri Oct 15 04:17:50 2021] DELETE /identity/v3/projects/7620d025b3dc4f9d8780b5991054fd28 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 15 04:22:14.034866 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713422fe-d802-4712-87d7-64b31009f5a0 service neutron] Authenticating user token {{(pid=79362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 15 04:22:14.036277 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-713422fe-d802-4712-87d7-64b31009f5a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:22:14.148976 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713422fe-d802-4712-87d7-64b31009f5a0 service neutron] Validating token access rules against request {{(pid=79362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 15 04:22:14.202703 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac35f4a-a48a-4387-888a-e207ccc669f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bffc0480ffb942cdad426195eca0529e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f95c04b0a7b4a2d8fbb4b547f70dc20', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 15 04:22:14.203326 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac35f4a-a48a-4387-888a-e207ccc669f6 service placement] REQUEST_METHOD: `GET` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 15 04:22:14.203606 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac35f4a-a48a-4387-888a-e207ccc669f6 service placement] SCRIPT_NAME: `/identity` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 15 04:22:14.203910 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac35f4a-a48a-4387-888a-e207ccc669f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 15 04:22:14.205639 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.fernet_utils [None req-2ac35f4a-a48a-4387-888a-e207ccc669f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 15 04:22:14.216786 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac35f4a-a48a-4387-888a-e207ccc669f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 15 04:22:14.218344 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac35f4a-a48a-4387-888a-e207ccc669f6 service placement] RBAC: Authorization granted {{(pid=79362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 15 04:22:14.227926 dv-cinder-814100-1-iscsi devstack@keystone.service[79362]: [pid: 79362|app: 0|req: 1432/2858] 10.222.0.30 () {60 vars in 1365 bytes} [Fri Oct 15 04:22:14 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)